Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [........................................X.X.................] duration: 1.728081935s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:08:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.728120259s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.373926972s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:07:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.373960987s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.........................................X.X................] duration: 1.666140298s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:07:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.66616866s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.37813531s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:06:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.378163601s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.362008549s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:06:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.3620441s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..........................................X.X...............] duration: 1.64498297s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:06:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.645003303s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...........................................X.X..............] duration: 1.704390773s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:05:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.704419657s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.429884828s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:05:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.429916489s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [............................................X.X.............] duration: 1.755536167s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:05:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.755564089s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.343300128s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:05:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.343320539s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.357988781s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:04:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.358019581s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.............................................X.X............] duration: 2.155915232s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:04:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.155945241s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.401040238s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:04:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.40107431s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..............................................X.X...........] duration: 1.858225712s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:03:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.858246898s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.392688489s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:03:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.392718871s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...............................................X.X..........] duration: 1.727272538s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:03:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.727337752s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.424360287s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:02:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.424388425s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [................................................X.X.........] duration: 1.657831109s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:02:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.65785887s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.................................................X.X........] duration: 1.615450376s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:02:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.615483698s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.393849344s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:01:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.393883987s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..................................................X.X.......] duration: 2.13856388s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:01:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.138598453s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.424014222s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:01:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.424066736s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...................................................X.X......] duration: 1.58482307s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:00:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.584848537s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.448175395s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:00:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.448210131s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [....................................................X.X.....] duration: 1.569962785s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:00:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.570066939s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.443711636s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 04:59:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.443736105s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.....................................................X.X....] duration: 1.565625836s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 04:59:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.565655193s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.290875257s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 04:58:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.29089499s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [......................................................X.X...] duration: 1.666506744s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 04:58:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.666553258s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.......................................................X.X..] duration: 1.61983748s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 04:58:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.619861789s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [........................................................X.X.] duration: 1.554771724s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 04:57:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.554797368s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.349655577s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 04:57:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.34968119s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.411418151s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 04:57:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.411445363s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.........................................................X.X] duration: 5.000910281s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 04:57:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000938951s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.350025595s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 04:56:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.350059301s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.105458432s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 04:56:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.105485182s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........................................................X.] duration: 2.186015873s trace: https://jaeger.dev.storj.io/trace/3671af018e3fb7f2 FAIL (2026-02-10 04:56:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.186057284s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........................................................X] duration: 5.000583292s trace: https://jaeger.dev.storj.io/trace/3671af018e3fb7f2 FAIL (2026-02-10 04:56:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.00062664s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [X...........................................................] duration: 491.696541ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/4fc6968251dbda7e FAIL (2026-02-09 19:09:45 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 491.759747ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.X..........................................................] duration: 174.499526ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/4fc6968251dbda7e FAIL (2026-02-09 19:09:12 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 174.525271ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [..X.........................................................] duration: 171.609995ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/4fc6968251dbda7e FAIL (2026-02-09 19:08:05 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 171.651074ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [...X........................................................] duration: 186.093838ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/4fc6968251dbda7e FAIL (2026-02-09 19:07:38 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 186.138091ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [....X.......................................................] duration: 484.320446ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/4fc6968251dbda7e FAIL (2026-02-09 19:06:38 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 484.36725ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.....X......................................................] duration: 189.695543ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/4fc6968251dbda7e FAIL (2026-02-09 19:05:50 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 189.713357ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [......X.....................................................] duration: 489.515263ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/4fc6968251dbda7e FAIL (2026-02-09 19:05:15 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 489.550128ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.......X....................................................] duration: 213.930366ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/4fc6968251dbda7e FAIL (2026-02-09 19:04:16 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 213.953618ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [........X...................................................] duration: 813.886805ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/4fc6968251dbda7e FAIL (2026-02-09 19:03:29 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 813.913992ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.........X..................................................] duration: 218.663133ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/4fc6968251dbda7e FAIL (2026-02-09 19:02:29 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 218.711553ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [..........X.................................................] duration: 623.010794ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/4fc6968251dbda7e FAIL (2026-02-09 19:01:31 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 623.03758ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [...........X................................................] duration: 618.80558ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/4fc6968251dbda7e FAIL (2026-02-09 19:00:44 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 618.830809ms edge linksharing bgp ap1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)