Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..............X.X...........................................] duration: 1.691507146s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:27:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.691536182s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.385762811s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:26:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.38582302s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...............X.X..........................................] duration: 1.597647682s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:26:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.597672641s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.310000896s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:25:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.310046631s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [................X.X.........................................] duration: 1.651303413s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:25:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.65133102s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.331300692s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:25:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.331328799s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.................X.X........................................] duration: 1.686065589s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:25:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.686090078s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.363641177s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:24:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.363668664s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..................X.X.......................................] duration: 1.670925418s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:23:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.670952034s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.401360113s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:23:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.401388282s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.323048812s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:23:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.323084685s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.444637052s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:23:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.444671303s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...................X.X......................................] duration: 1.704810423s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:23:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.704835394s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.381731918s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:22:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.381759713s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [....................X.X.....................................] duration: 1.654844198s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:22:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.654937269s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.....................X.X....................................] duration: 1.668327979s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:21:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.668353993s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.273254114s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:21:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.273326456s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [......................X.X...................................] duration: 1.758112724s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:20:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.758138333s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.346668684s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:20:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.346701033s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.......................X.X..................................] duration: 1.616339216s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:19:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.616367128s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.314038031s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:19:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.314216062s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [........................X.X.................................] duration: 1.618536582s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:18:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.618560296s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.........................X.X................................] duration: 2.087019286s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:18:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.087075608s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.488257704s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:18:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.488296137s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..........................X.X...............................] duration: 2.111663174s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:17:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.111690108s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.341605743s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:17:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.34163716s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...........................X.X..............................] duration: 1.620854823s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:17:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.620925983s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.415560138s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:17:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.415585932s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [............................X.X.............................] duration: 1.676358893s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:16:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.676391128s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.415466174s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:16:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.415497663s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.............................X.X............................] duration: 1.562510732s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:16:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.562537242s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..............................X.X...........................] duration: 1.666304362s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:15:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.666334065s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.401263768s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:15:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.401292649s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...............................X.X..........................] duration: 1.680772693s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:14:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.680800087s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.341748217s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:14:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.34178155s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [................................X.X.........................] duration: 1.655496712s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:14:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.655522923s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.................................X.X........................] duration: 1.55881699s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:13:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.55884154s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.401312357s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:13:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.401338766s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..................................X.X.......................] duration: 1.672310368s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:13:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.672342287s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...................................X.X......................] duration: 1.660339866s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:12:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.660367s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.388933983s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:12:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.38896604s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.54928676s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:12:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.549313764s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [....................................X.X.....................] duration: 1.682126103s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:11:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.682154264s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.469119596s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:11:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.469150635s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.....................................X.X....................] duration: 1.670345339s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:10:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.670403123s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.333326394s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:10:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.333349412s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [......................................X.X...................] duration: 1.622653441s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:09:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.622690032s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.392044127s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:09:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.392094884s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.371979027s trace: https://jaeger.dev.storj.io/trace/5c513512a856fd10 FAIL (2026-02-10 05:08:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 10 04:56:26.407884743 (613h1m4.291838946s) [upload=539706]: Starting upload Feb 10 04:56:26.407962948 (613h1m4.291917147s) [upload=539706]: Done starting upload Feb 10 04:56:26.408281730 (613h1m4.292235929s) [upload=539706]: Uploading segments... Feb 10 04:56:26.408355658 (613h1m4.292309857s) [upload=539706]: Got next segment. Inline: false Feb 10 04:56:26.408391309 (613h1m4.29234551s) [upload=539706]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 10 04:56:26.408397227 (613h1m4.292351426s) [upload=539706]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 10 04:56:26.517830280 (613h1m4.401784487s) [seg_pos={0 0}, upload=539706]: Begin upload segment... Feb 10 04:56:26.517986937 (613h1m4.401941137s) [seg_pos={0 0}, upload=539706]: Done begin upload segment. Feb 10 04:56:26.518051397 (613h1m4.402005604s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.518683750 (613h1m4.402637959s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.519522687 (613h1m4.40347689s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520104774 (613h1m4.404058987s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520474071 (613h1m4.404428274s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520591983 (613h1m4.404546193s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.520889788 (613h1m4.404843987s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521201235 (613h1m4.405155444s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521363432 (613h1m4.405317639s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521678719 (613h1m4.405632953s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.521824152 (613h1m4.405778362s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.522382988 (613h1m4.406337191s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523006609 (613h1m4.406960819s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523530743 (613h1m4.407484953s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.523971213 (613h1m4.407925419s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:26.524555582 (613h1m4.408509767s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Uploading piece... Feb 10 04:56:27.125437351 (613h1m5.009391551s) [upload=539706]: Next returned nil segment Feb 10 04:56:27.125450506 (613h1m5.009404705s) [upload=539706]: Waiting for error group managing segments... Feb 10 04:56:27.265993299 (613h1m5.149947498s) [noise=true , address=145.79.227.29:4944 , piece_id=EBZDHA5GT2MNJIHBMRZ4AUCYO2C4FUSJYRH4EOAT57HUP6D7WPMA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.267144887 (613h1m5.151099086s) [noise=true , address=145.79.227.10:4406 , piece_id=JDJYLQKJHME5YUW3CBV2W7K55ZGWAIMV3DVYEDSMGWZUR2LCC22Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268411655 (613h1m5.152365846s) [noise=true , address=145.79.227.35:4487 , piece_id=GFW5XK6HDN3RPUFGZJR3GEFUGLYNZ2ZZIPNKSZZQ7QUKR6X6LW6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.268424437 (613h1m5.152378629s) [noise=true , address=145.79.227.24:4587 , piece_id=667GJB73DZEQQL7PPU2QFMV5F4PBO7T27CPQJT64VZOIGXTZHK6A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269455913 (613h1m5.153410113s) [noise=true , address=145.79.227.18:4010 , piece_id=TESZWTBZVOBPUVKONQ2UKXFHR6UCZCG5HODGQFRBPSGQ5FXXZSPA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.269891228 (613h1m5.153845428s) [noise=true , address=145.79.227.12:4771 , piece_id=PH55TD2FHH4OSOANKY4GYUFSJTPY6GESHT466MK6MNRKDJ7ULN7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.276930861 (613h1m5.16088507s) [noise=true , address=145.79.227.26:4659 , piece_id=JHPHXRSV4TPKSJKU4OTGHXQJPAQUQJYLAKSYHSL5X4JCBPNNW7DQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.283467915 (613h1m5.167422119s) [noise=true , address=145.79.227.11:4735 , piece_id=EKNFOD5CXZPORL2SD7LNNIGL6EHJLHSQCM7ISHVQIVX3LG7NXEDA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.300848770 (613h1m5.184802976s) [noise=true , address=145.79.227.52:4451 , piece_id=S7FYVRYGC7HJMBNK677OJX7UJMUQ5WNMVNJ2NLUGPINA4M56VR2Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:27.355574655 (613h1m5.239528859s) [noise=true , address=145.79.227.44:4198 , piece_id=63QX7GNACZGMRL7EADJ6IULDWHQVFQ6AFXCDQTSUEEPRBRNZFWWA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.017008104 (613h1m5.900962305s) [noise=true , address=145.79.227.6:4260 , piece_id=IQZBRBB7IOSM5WHIGCAGGJS53AFDPEQ6CV7U7FSJG62LT5HFOX7Q, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:28.766902450 (613h1m6.650856651s) [noise=true , address=79.127.219.38:4817 , piece_id=LGBUXYBCCNMQKB6KBS6K6RTUB6MKKBFGITSAO7S7MRSGJHKEAGUA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: <nil> Feb 10 04:56:56.130179108 (613h1m34.014133315s) [noise=true , address=77.90.31.12:4589 , piece_id=X63HQQ66ADLBBELZPBSUWLWRLDYIG3AAFMEPVUGPRGBVMC3THDZA, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60418->77.90.31.12:4589: use of closed network connection Feb 10 04:56:56.130215419 (613h1m34.014169624s) [noise=true , address=77.90.31.19:4844 , piece_id=OXWT333ZD33B3S6UGCWPHR62PLG5R2KDSOXLF6W5CBWBBBFTEH2A, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:57156->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130422685 (613h1m34.01437689s) [noise=true , address=77.90.31.13:4629 , piece_id=2WMG7SACVLNRXLVQLCM2QRXRHT3LV4VMK5YWLDQO5F5FBDT4PQNQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:35224->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130571357 (613h1m34.014525563s) [noise=true , address=77.90.31.11:4553 , piece_id=VNIM353YMYAT2ZHXUSJZJRBFWG4NN7VMVKP37JK6KNJAIIJ5UKGQ, seg_pos={0 0}, upload=539706]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:41684->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 10 04:56:56.130599829 (613h1m34.014554014s) [seg_pos={0 0}, upload=539706]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 10 04:56:56.233108051 (613h1m34.117062253s) [upload=539706]: Done uploading segments... Feb 10 04:56:56.233140386 (613h1m34.117094584s) [upload=539706]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.3720084s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.......................................X.X..................] duration: 1.670222973s trace: https://jaeger.dev.storj.io/trace/6390dd2a774c1a76 FAIL (2026-02-10 05:08:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.670269459s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)