Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.416498485s FAIL (2025-09-18 12:26:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 18 12:07:08.735787684 (477h59m29.228220126s) [upload=420418]: Starting upload Sep 18 12:07:08.735899020 (477h59m29.22833145s) [upload=420418]: Done starting upload Sep 18 12:07:08.736057737 (477h59m29.228490182s) [upload=420418]: Uploading segments... Sep 18 12:07:08.736321518 (477h59m29.228753961s) [upload=420418]: Got next segment. Inline: false Sep 18 12:07:08.736392296 (477h59m29.228824747s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 12:07:08.736399235 (477h59m29.228831689s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 12:07:08.930372355 (477h59m29.422804809s) [seg_pos={0 0}, upload=420418]: Begin upload segment... Sep 18 12:07:08.930443554 (477h59m29.422875999s) [seg_pos={0 0}, upload=420418]: Done begin upload segment. Sep 18 12:07:08.930473176 (477h59m29.422905628s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931053919 (477h59m29.423486372s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931480689 (477h59m29.423913141s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931789500 (477h59m29.424221954s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932054595 (477h59m29.424487047s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932586965 (477h59m29.425019419s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933390177 (477h59m29.425822629s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933871840 (477h59m29.426304284s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.934343701 (477h59m29.426776153s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935203513 (477h59m29.427635965s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935630258 (477h59m29.428062716s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936008164 (477h59m29.428440618s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936419982 (477h59m29.428852434s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936804865 (477h59m29.429237319s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.937214138 (477h59m29.429646586s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.938000742 (477h59m29.430433187s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:09.553174842 (477h59m30.04560729s) [upload=420418]: Next returned nil segment Sep 18 12:07:09.553195606 (477h59m30.045628055s) [upload=420418]: Waiting for error group managing segments... Sep 18 12:07:09.683174793 (477h59m30.175607222s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684609696 (477h59m30.177042135s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684730544 (477h59m30.177162975s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.693784688 (477h59m30.186217123s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700124727 (477h59m30.192557162s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700146946 (477h59m30.192579377s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.705598092 (477h59m30.198030535s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.717876650 (477h59m30.210309086s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.724419875 (477h59m30.216852303s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.725131855 (477h59m30.217564285s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.727163870 (477h59m30.219596303s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.728582990 (477h59m30.22101543s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730707710 (477h59m30.223140141s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730729775 (477h59m30.223162219s) [seg_pos={0 0}, upload=420418]: Segment reached optimal threshold of 13 pieces. Sep 18 12:07:09.730899902 (477h59m30.223332332s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731113757 (477h59m30.223546206s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731162317 (477h59m30.223594746s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731177764 (477h59m30.223610211s) [seg_pos={0 0}, upload=420418]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 18 12:07:09.731299129 (477h59m30.223731574s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 18 12:07:09.731304746 (477h59m30.223737192s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 18 12:07:49.679071319 (478h0m10.171503751s) [upload=420418]: Done uploading segments... Sep 18 12:07:49.679092842 (478h0m10.171525273s) [upload=420418]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.416527608s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.521937279s FAIL (2025-09-18 12:26:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 18 12:07:08.735787684 (477h59m29.228220126s) [upload=420418]: Starting upload Sep 18 12:07:08.735899020 (477h59m29.22833145s) [upload=420418]: Done starting upload Sep 18 12:07:08.736057737 (477h59m29.228490182s) [upload=420418]: Uploading segments... Sep 18 12:07:08.736321518 (477h59m29.228753961s) [upload=420418]: Got next segment. Inline: false Sep 18 12:07:08.736392296 (477h59m29.228824747s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 12:07:08.736399235 (477h59m29.228831689s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 12:07:08.930372355 (477h59m29.422804809s) [seg_pos={0 0}, upload=420418]: Begin upload segment... Sep 18 12:07:08.930443554 (477h59m29.422875999s) [seg_pos={0 0}, upload=420418]: Done begin upload segment. Sep 18 12:07:08.930473176 (477h59m29.422905628s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931053919 (477h59m29.423486372s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931480689 (477h59m29.423913141s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931789500 (477h59m29.424221954s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932054595 (477h59m29.424487047s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932586965 (477h59m29.425019419s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933390177 (477h59m29.425822629s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933871840 (477h59m29.426304284s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.934343701 (477h59m29.426776153s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935203513 (477h59m29.427635965s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935630258 (477h59m29.428062716s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936008164 (477h59m29.428440618s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936419982 (477h59m29.428852434s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936804865 (477h59m29.429237319s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.937214138 (477h59m29.429646586s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.938000742 (477h59m29.430433187s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:09.553174842 (477h59m30.04560729s) [upload=420418]: Next returned nil segment Sep 18 12:07:09.553195606 (477h59m30.045628055s) [upload=420418]: Waiting for error group managing segments... Sep 18 12:07:09.683174793 (477h59m30.175607222s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684609696 (477h59m30.177042135s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684730544 (477h59m30.177162975s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.693784688 (477h59m30.186217123s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700124727 (477h59m30.192557162s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700146946 (477h59m30.192579377s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.705598092 (477h59m30.198030535s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.717876650 (477h59m30.210309086s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.724419875 (477h59m30.216852303s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.725131855 (477h59m30.217564285s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.727163870 (477h59m30.219596303s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.728582990 (477h59m30.22101543s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730707710 (477h59m30.223140141s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730729775 (477h59m30.223162219s) [seg_pos={0 0}, upload=420418]: Segment reached optimal threshold of 13 pieces. Sep 18 12:07:09.730899902 (477h59m30.223332332s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731113757 (477h59m30.223546206s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731162317 (477h59m30.223594746s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731177764 (477h59m30.223610211s) [seg_pos={0 0}, upload=420418]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 18 12:07:09.731299129 (477h59m30.223731574s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 18 12:07:09.731304746 (477h59m30.223737192s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 18 12:07:49.679071319 (478h0m10.171503751s) [upload=420418]: Done uploading segments... Sep 18 12:07:49.679092842 (478h0m10.171525273s) [upload=420418]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.521974793s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.396888255s FAIL (2025-09-18 12:25:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 18 12:07:08.735787684 (477h59m29.228220126s) [upload=420418]: Starting upload Sep 18 12:07:08.735899020 (477h59m29.22833145s) [upload=420418]: Done starting upload Sep 18 12:07:08.736057737 (477h59m29.228490182s) [upload=420418]: Uploading segments... Sep 18 12:07:08.736321518 (477h59m29.228753961s) [upload=420418]: Got next segment. Inline: false Sep 18 12:07:08.736392296 (477h59m29.228824747s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 12:07:08.736399235 (477h59m29.228831689s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 12:07:08.930372355 (477h59m29.422804809s) [seg_pos={0 0}, upload=420418]: Begin upload segment... Sep 18 12:07:08.930443554 (477h59m29.422875999s) [seg_pos={0 0}, upload=420418]: Done begin upload segment. Sep 18 12:07:08.930473176 (477h59m29.422905628s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931053919 (477h59m29.423486372s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931480689 (477h59m29.423913141s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931789500 (477h59m29.424221954s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932054595 (477h59m29.424487047s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932586965 (477h59m29.425019419s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933390177 (477h59m29.425822629s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933871840 (477h59m29.426304284s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.934343701 (477h59m29.426776153s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935203513 (477h59m29.427635965s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935630258 (477h59m29.428062716s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936008164 (477h59m29.428440618s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936419982 (477h59m29.428852434s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936804865 (477h59m29.429237319s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.937214138 (477h59m29.429646586s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.938000742 (477h59m29.430433187s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:09.553174842 (477h59m30.04560729s) [upload=420418]: Next returned nil segment Sep 18 12:07:09.553195606 (477h59m30.045628055s) [upload=420418]: Waiting for error group managing segments... Sep 18 12:07:09.683174793 (477h59m30.175607222s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684609696 (477h59m30.177042135s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684730544 (477h59m30.177162975s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.693784688 (477h59m30.186217123s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700124727 (477h59m30.192557162s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700146946 (477h59m30.192579377s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.705598092 (477h59m30.198030535s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.717876650 (477h59m30.210309086s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.724419875 (477h59m30.216852303s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.725131855 (477h59m30.217564285s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.727163870 (477h59m30.219596303s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.728582990 (477h59m30.22101543s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730707710 (477h59m30.223140141s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730729775 (477h59m30.223162219s) [seg_pos={0 0}, upload=420418]: Segment reached optimal threshold of 13 pieces. Sep 18 12:07:09.730899902 (477h59m30.223332332s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731113757 (477h59m30.223546206s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731162317 (477h59m30.223594746s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731177764 (477h59m30.223610211s) [seg_pos={0 0}, upload=420418]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 18 12:07:09.731299129 (477h59m30.223731574s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 18 12:07:09.731304746 (477h59m30.223737192s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 18 12:07:49.679071319 (478h0m10.171503751s) [upload=420418]: Done uploading segments... Sep 18 12:07:49.679092842 (478h0m10.171525273s) [upload=420418]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.396920433s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.617240407s FAIL (2025-09-18 12:24:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 18 12:07:08.735787684 (477h59m29.228220126s) [upload=420418]: Starting upload Sep 18 12:07:08.735899020 (477h59m29.22833145s) [upload=420418]: Done starting upload Sep 18 12:07:08.736057737 (477h59m29.228490182s) [upload=420418]: Uploading segments... Sep 18 12:07:08.736321518 (477h59m29.228753961s) [upload=420418]: Got next segment. Inline: false Sep 18 12:07:08.736392296 (477h59m29.228824747s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 12:07:08.736399235 (477h59m29.228831689s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 12:07:08.930372355 (477h59m29.422804809s) [seg_pos={0 0}, upload=420418]: Begin upload segment... Sep 18 12:07:08.930443554 (477h59m29.422875999s) [seg_pos={0 0}, upload=420418]: Done begin upload segment. Sep 18 12:07:08.930473176 (477h59m29.422905628s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931053919 (477h59m29.423486372s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931480689 (477h59m29.423913141s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931789500 (477h59m29.424221954s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932054595 (477h59m29.424487047s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932586965 (477h59m29.425019419s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933390177 (477h59m29.425822629s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933871840 (477h59m29.426304284s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.934343701 (477h59m29.426776153s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935203513 (477h59m29.427635965s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935630258 (477h59m29.428062716s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936008164 (477h59m29.428440618s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936419982 (477h59m29.428852434s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936804865 (477h59m29.429237319s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.937214138 (477h59m29.429646586s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.938000742 (477h59m29.430433187s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:09.553174842 (477h59m30.04560729s) [upload=420418]: Next returned nil segment Sep 18 12:07:09.553195606 (477h59m30.045628055s) [upload=420418]: Waiting for error group managing segments... Sep 18 12:07:09.683174793 (477h59m30.175607222s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684609696 (477h59m30.177042135s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684730544 (477h59m30.177162975s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.693784688 (477h59m30.186217123s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700124727 (477h59m30.192557162s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700146946 (477h59m30.192579377s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.705598092 (477h59m30.198030535s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.717876650 (477h59m30.210309086s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.724419875 (477h59m30.216852303s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.725131855 (477h59m30.217564285s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.727163870 (477h59m30.219596303s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.728582990 (477h59m30.22101543s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730707710 (477h59m30.223140141s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730729775 (477h59m30.223162219s) [seg_pos={0 0}, upload=420418]: Segment reached optimal threshold of 13 pieces. Sep 18 12:07:09.730899902 (477h59m30.223332332s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731113757 (477h59m30.223546206s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731162317 (477h59m30.223594746s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731177764 (477h59m30.223610211s) [seg_pos={0 0}, upload=420418]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 18 12:07:09.731299129 (477h59m30.223731574s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 18 12:07:09.731304746 (477h59m30.223737192s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 18 12:07:49.679071319 (478h0m10.171503751s) [upload=420418]: Done uploading segments... Sep 18 12:07:49.679092842 (478h0m10.171525273s) [upload=420418]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.617277611s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.577461584s FAIL (2025-09-18 12:24:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 18 12:07:08.735787684 (477h59m29.228220126s) [upload=420418]: Starting upload Sep 18 12:07:08.735899020 (477h59m29.22833145s) [upload=420418]: Done starting upload Sep 18 12:07:08.736057737 (477h59m29.228490182s) [upload=420418]: Uploading segments... Sep 18 12:07:08.736321518 (477h59m29.228753961s) [upload=420418]: Got next segment. Inline: false Sep 18 12:07:08.736392296 (477h59m29.228824747s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 12:07:08.736399235 (477h59m29.228831689s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 12:07:08.930372355 (477h59m29.422804809s) [seg_pos={0 0}, upload=420418]: Begin upload segment... Sep 18 12:07:08.930443554 (477h59m29.422875999s) [seg_pos={0 0}, upload=420418]: Done begin upload segment. Sep 18 12:07:08.930473176 (477h59m29.422905628s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931053919 (477h59m29.423486372s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931480689 (477h59m29.423913141s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931789500 (477h59m29.424221954s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932054595 (477h59m29.424487047s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932586965 (477h59m29.425019419s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933390177 (477h59m29.425822629s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933871840 (477h59m29.426304284s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.934343701 (477h59m29.426776153s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935203513 (477h59m29.427635965s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935630258 (477h59m29.428062716s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936008164 (477h59m29.428440618s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936419982 (477h59m29.428852434s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936804865 (477h59m29.429237319s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.937214138 (477h59m29.429646586s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.938000742 (477h59m29.430433187s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:09.553174842 (477h59m30.04560729s) [upload=420418]: Next returned nil segment Sep 18 12:07:09.553195606 (477h59m30.045628055s) [upload=420418]: Waiting for error group managing segments... Sep 18 12:07:09.683174793 (477h59m30.175607222s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684609696 (477h59m30.177042135s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684730544 (477h59m30.177162975s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.693784688 (477h59m30.186217123s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700124727 (477h59m30.192557162s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700146946 (477h59m30.192579377s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.705598092 (477h59m30.198030535s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.717876650 (477h59m30.210309086s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.724419875 (477h59m30.216852303s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.725131855 (477h59m30.217564285s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.727163870 (477h59m30.219596303s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.728582990 (477h59m30.22101543s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730707710 (477h59m30.223140141s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730729775 (477h59m30.223162219s) [seg_pos={0 0}, upload=420418]: Segment reached optimal threshold of 13 pieces. Sep 18 12:07:09.730899902 (477h59m30.223332332s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731113757 (477h59m30.223546206s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731162317 (477h59m30.223594746s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731177764 (477h59m30.223610211s) [seg_pos={0 0}, upload=420418]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 18 12:07:09.731299129 (477h59m30.223731574s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 18 12:07:09.731304746 (477h59m30.223737192s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 18 12:07:49.679071319 (478h0m10.171503751s) [upload=420418]: Done uploading segments... Sep 18 12:07:49.679092842 (478h0m10.171525273s) [upload=420418]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.577600407s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 3.009091037s FAIL (2025-09-18 12:23:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 18 12:07:08.735787684 (477h59m29.228220126s) [upload=420418]: Starting upload Sep 18 12:07:08.735899020 (477h59m29.22833145s) [upload=420418]: Done starting upload Sep 18 12:07:08.736057737 (477h59m29.228490182s) [upload=420418]: Uploading segments... Sep 18 12:07:08.736321518 (477h59m29.228753961s) [upload=420418]: Got next segment. Inline: false Sep 18 12:07:08.736392296 (477h59m29.228824747s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 12:07:08.736399235 (477h59m29.228831689s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 12:07:08.930372355 (477h59m29.422804809s) [seg_pos={0 0}, upload=420418]: Begin upload segment... Sep 18 12:07:08.930443554 (477h59m29.422875999s) [seg_pos={0 0}, upload=420418]: Done begin upload segment. Sep 18 12:07:08.930473176 (477h59m29.422905628s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931053919 (477h59m29.423486372s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931480689 (477h59m29.423913141s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931789500 (477h59m29.424221954s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932054595 (477h59m29.424487047s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932586965 (477h59m29.425019419s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933390177 (477h59m29.425822629s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933871840 (477h59m29.426304284s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.934343701 (477h59m29.426776153s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935203513 (477h59m29.427635965s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935630258 (477h59m29.428062716s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936008164 (477h59m29.428440618s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936419982 (477h59m29.428852434s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936804865 (477h59m29.429237319s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.937214138 (477h59m29.429646586s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.938000742 (477h59m29.430433187s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:09.553174842 (477h59m30.04560729s) [upload=420418]: Next returned nil segment Sep 18 12:07:09.553195606 (477h59m30.045628055s) [upload=420418]: Waiting for error group managing segments... Sep 18 12:07:09.683174793 (477h59m30.175607222s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684609696 (477h59m30.177042135s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684730544 (477h59m30.177162975s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.693784688 (477h59m30.186217123s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700124727 (477h59m30.192557162s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700146946 (477h59m30.192579377s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.705598092 (477h59m30.198030535s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.717876650 (477h59m30.210309086s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.724419875 (477h59m30.216852303s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.725131855 (477h59m30.217564285s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.727163870 (477h59m30.219596303s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.728582990 (477h59m30.22101543s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730707710 (477h59m30.223140141s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730729775 (477h59m30.223162219s) [seg_pos={0 0}, upload=420418]: Segment reached optimal threshold of 13 pieces. Sep 18 12:07:09.730899902 (477h59m30.223332332s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731113757 (477h59m30.223546206s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731162317 (477h59m30.223594746s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731177764 (477h59m30.223610211s) [seg_pos={0 0}, upload=420418]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 18 12:07:09.731299129 (477h59m30.223731574s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 18 12:07:09.731304746 (477h59m30.223737192s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 18 12:07:49.679071319 (478h0m10.171503751s) [upload=420418]: Done uploading segments... Sep 18 12:07:49.679092842 (478h0m10.171525273s) [upload=420418]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.009125724s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.664695505s FAIL (2025-09-18 12:22:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 18 12:07:08.735787684 (477h59m29.228220126s) [upload=420418]: Starting upload Sep 18 12:07:08.735899020 (477h59m29.22833145s) [upload=420418]: Done starting upload Sep 18 12:07:08.736057737 (477h59m29.228490182s) [upload=420418]: Uploading segments... Sep 18 12:07:08.736321518 (477h59m29.228753961s) [upload=420418]: Got next segment. Inline: false Sep 18 12:07:08.736392296 (477h59m29.228824747s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 12:07:08.736399235 (477h59m29.228831689s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 12:07:08.930372355 (477h59m29.422804809s) [seg_pos={0 0}, upload=420418]: Begin upload segment... Sep 18 12:07:08.930443554 (477h59m29.422875999s) [seg_pos={0 0}, upload=420418]: Done begin upload segment. Sep 18 12:07:08.930473176 (477h59m29.422905628s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931053919 (477h59m29.423486372s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931480689 (477h59m29.423913141s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931789500 (477h59m29.424221954s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932054595 (477h59m29.424487047s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932586965 (477h59m29.425019419s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933390177 (477h59m29.425822629s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933871840 (477h59m29.426304284s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.934343701 (477h59m29.426776153s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935203513 (477h59m29.427635965s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935630258 (477h59m29.428062716s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936008164 (477h59m29.428440618s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936419982 (477h59m29.428852434s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936804865 (477h59m29.429237319s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.937214138 (477h59m29.429646586s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.938000742 (477h59m29.430433187s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:09.553174842 (477h59m30.04560729s) [upload=420418]: Next returned nil segment Sep 18 12:07:09.553195606 (477h59m30.045628055s) [upload=420418]: Waiting for error group managing segments... Sep 18 12:07:09.683174793 (477h59m30.175607222s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684609696 (477h59m30.177042135s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684730544 (477h59m30.177162975s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.693784688 (477h59m30.186217123s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700124727 (477h59m30.192557162s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700146946 (477h59m30.192579377s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.705598092 (477h59m30.198030535s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.717876650 (477h59m30.210309086s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.724419875 (477h59m30.216852303s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.725131855 (477h59m30.217564285s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.727163870 (477h59m30.219596303s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.728582990 (477h59m30.22101543s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730707710 (477h59m30.223140141s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730729775 (477h59m30.223162219s) [seg_pos={0 0}, upload=420418]: Segment reached optimal threshold of 13 pieces. Sep 18 12:07:09.730899902 (477h59m30.223332332s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731113757 (477h59m30.223546206s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731162317 (477h59m30.223594746s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731177764 (477h59m30.223610211s) [seg_pos={0 0}, upload=420418]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 18 12:07:09.731299129 (477h59m30.223731574s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 18 12:07:09.731304746 (477h59m30.223737192s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 18 12:07:49.679071319 (478h0m10.171503751s) [upload=420418]: Done uploading segments... Sep 18 12:07:49.679092842 (478h0m10.171525273s) [upload=420418]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.664725279s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 3.007782304s FAIL (2025-09-18 12:21:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 18 12:07:08.735787684 (477h59m29.228220126s) [upload=420418]: Starting upload Sep 18 12:07:08.735899020 (477h59m29.22833145s) [upload=420418]: Done starting upload Sep 18 12:07:08.736057737 (477h59m29.228490182s) [upload=420418]: Uploading segments... Sep 18 12:07:08.736321518 (477h59m29.228753961s) [upload=420418]: Got next segment. Inline: false Sep 18 12:07:08.736392296 (477h59m29.228824747s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 12:07:08.736399235 (477h59m29.228831689s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 12:07:08.930372355 (477h59m29.422804809s) [seg_pos={0 0}, upload=420418]: Begin upload segment... Sep 18 12:07:08.930443554 (477h59m29.422875999s) [seg_pos={0 0}, upload=420418]: Done begin upload segment. Sep 18 12:07:08.930473176 (477h59m29.422905628s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931053919 (477h59m29.423486372s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931480689 (477h59m29.423913141s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931789500 (477h59m29.424221954s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932054595 (477h59m29.424487047s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932586965 (477h59m29.425019419s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933390177 (477h59m29.425822629s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933871840 (477h59m29.426304284s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.934343701 (477h59m29.426776153s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935203513 (477h59m29.427635965s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935630258 (477h59m29.428062716s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936008164 (477h59m29.428440618s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936419982 (477h59m29.428852434s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936804865 (477h59m29.429237319s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.937214138 (477h59m29.429646586s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.938000742 (477h59m29.430433187s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:09.553174842 (477h59m30.04560729s) [upload=420418]: Next returned nil segment Sep 18 12:07:09.553195606 (477h59m30.045628055s) [upload=420418]: Waiting for error group managing segments... Sep 18 12:07:09.683174793 (477h59m30.175607222s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684609696 (477h59m30.177042135s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684730544 (477h59m30.177162975s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.693784688 (477h59m30.186217123s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700124727 (477h59m30.192557162s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700146946 (477h59m30.192579377s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.705598092 (477h59m30.198030535s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.717876650 (477h59m30.210309086s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.724419875 (477h59m30.216852303s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.725131855 (477h59m30.217564285s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.727163870 (477h59m30.219596303s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.728582990 (477h59m30.22101543s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730707710 (477h59m30.223140141s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730729775 (477h59m30.223162219s) [seg_pos={0 0}, upload=420418]: Segment reached optimal threshold of 13 pieces. Sep 18 12:07:09.730899902 (477h59m30.223332332s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731113757 (477h59m30.223546206s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731162317 (477h59m30.223594746s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731177764 (477h59m30.223610211s) [seg_pos={0 0}, upload=420418]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 18 12:07:09.731299129 (477h59m30.223731574s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 18 12:07:09.731304746 (477h59m30.223737192s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 18 12:07:49.679071319 (478h0m10.171503751s) [upload=420418]: Done uploading segments... Sep 18 12:07:49.679092842 (478h0m10.171525273s) [upload=420418]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.007811407s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.453178853s FAIL (2025-09-18 12:21:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 18 12:07:08.735787684 (477h59m29.228220126s) [upload=420418]: Starting upload Sep 18 12:07:08.735899020 (477h59m29.22833145s) [upload=420418]: Done starting upload Sep 18 12:07:08.736057737 (477h59m29.228490182s) [upload=420418]: Uploading segments... Sep 18 12:07:08.736321518 (477h59m29.228753961s) [upload=420418]: Got next segment. Inline: false Sep 18 12:07:08.736392296 (477h59m29.228824747s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 12:07:08.736399235 (477h59m29.228831689s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 12:07:08.930372355 (477h59m29.422804809s) [seg_pos={0 0}, upload=420418]: Begin upload segment... Sep 18 12:07:08.930443554 (477h59m29.422875999s) [seg_pos={0 0}, upload=420418]: Done begin upload segment. Sep 18 12:07:08.930473176 (477h59m29.422905628s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931053919 (477h59m29.423486372s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931480689 (477h59m29.423913141s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931789500 (477h59m29.424221954s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932054595 (477h59m29.424487047s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932586965 (477h59m29.425019419s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933390177 (477h59m29.425822629s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933871840 (477h59m29.426304284s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.934343701 (477h59m29.426776153s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935203513 (477h59m29.427635965s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935630258 (477h59m29.428062716s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936008164 (477h59m29.428440618s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936419982 (477h59m29.428852434s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936804865 (477h59m29.429237319s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.937214138 (477h59m29.429646586s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.938000742 (477h59m29.430433187s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:09.553174842 (477h59m30.04560729s) [upload=420418]: Next returned nil segment Sep 18 12:07:09.553195606 (477h59m30.045628055s) [upload=420418]: Waiting for error group managing segments... Sep 18 12:07:09.683174793 (477h59m30.175607222s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684609696 (477h59m30.177042135s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684730544 (477h59m30.177162975s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.693784688 (477h59m30.186217123s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700124727 (477h59m30.192557162s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700146946 (477h59m30.192579377s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.705598092 (477h59m30.198030535s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.717876650 (477h59m30.210309086s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.724419875 (477h59m30.216852303s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.725131855 (477h59m30.217564285s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.727163870 (477h59m30.219596303s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.728582990 (477h59m30.22101543s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730707710 (477h59m30.223140141s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730729775 (477h59m30.223162219s) [seg_pos={0 0}, upload=420418]: Segment reached optimal threshold of 13 pieces. Sep 18 12:07:09.730899902 (477h59m30.223332332s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731113757 (477h59m30.223546206s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731162317 (477h59m30.223594746s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731177764 (477h59m30.223610211s) [seg_pos={0 0}, upload=420418]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 18 12:07:09.731299129 (477h59m30.223731574s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 18 12:07:09.731304746 (477h59m30.223737192s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 18 12:07:49.679071319 (478h0m10.171503751s) [upload=420418]: Done uploading segments... Sep 18 12:07:49.679092842 (478h0m10.171525273s) [upload=420418]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.453214172s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.3948487s FAIL (2025-09-18 12:20:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 18 12:07:08.735787684 (477h59m29.228220126s) [upload=420418]: Starting upload Sep 18 12:07:08.735899020 (477h59m29.22833145s) [upload=420418]: Done starting upload Sep 18 12:07:08.736057737 (477h59m29.228490182s) [upload=420418]: Uploading segments... Sep 18 12:07:08.736321518 (477h59m29.228753961s) [upload=420418]: Got next segment. Inline: false Sep 18 12:07:08.736392296 (477h59m29.228824747s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 12:07:08.736399235 (477h59m29.228831689s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 12:07:08.930372355 (477h59m29.422804809s) [seg_pos={0 0}, upload=420418]: Begin upload segment... Sep 18 12:07:08.930443554 (477h59m29.422875999s) [seg_pos={0 0}, upload=420418]: Done begin upload segment. Sep 18 12:07:08.930473176 (477h59m29.422905628s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931053919 (477h59m29.423486372s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931480689 (477h59m29.423913141s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931789500 (477h59m29.424221954s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932054595 (477h59m29.424487047s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932586965 (477h59m29.425019419s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933390177 (477h59m29.425822629s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933871840 (477h59m29.426304284s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.934343701 (477h59m29.426776153s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935203513 (477h59m29.427635965s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935630258 (477h59m29.428062716s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936008164 (477h59m29.428440618s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936419982 (477h59m29.428852434s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936804865 (477h59m29.429237319s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.937214138 (477h59m29.429646586s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.938000742 (477h59m29.430433187s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:09.553174842 (477h59m30.04560729s) [upload=420418]: Next returned nil segment Sep 18 12:07:09.553195606 (477h59m30.045628055s) [upload=420418]: Waiting for error group managing segments... Sep 18 12:07:09.683174793 (477h59m30.175607222s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684609696 (477h59m30.177042135s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684730544 (477h59m30.177162975s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.693784688 (477h59m30.186217123s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700124727 (477h59m30.192557162s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700146946 (477h59m30.192579377s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.705598092 (477h59m30.198030535s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.717876650 (477h59m30.210309086s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.724419875 (477h59m30.216852303s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.725131855 (477h59m30.217564285s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.727163870 (477h59m30.219596303s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.728582990 (477h59m30.22101543s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730707710 (477h59m30.223140141s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730729775 (477h59m30.223162219s) [seg_pos={0 0}, upload=420418]: Segment reached optimal threshold of 13 pieces. Sep 18 12:07:09.730899902 (477h59m30.223332332s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731113757 (477h59m30.223546206s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731162317 (477h59m30.223594746s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731177764 (477h59m30.223610211s) [seg_pos={0 0}, upload=420418]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 18 12:07:09.731299129 (477h59m30.223731574s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 18 12:07:09.731304746 (477h59m30.223737192s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 18 12:07:49.679071319 (478h0m10.171503751s) [upload=420418]: Done uploading segments... Sep 18 12:07:49.679092842 (478h0m10.171525273s) [upload=420418]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.394879582s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.589293745s FAIL (2025-09-18 12:19:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 18 12:07:08.735787684 (477h59m29.228220126s) [upload=420418]: Starting upload Sep 18 12:07:08.735899020 (477h59m29.22833145s) [upload=420418]: Done starting upload Sep 18 12:07:08.736057737 (477h59m29.228490182s) [upload=420418]: Uploading segments... Sep 18 12:07:08.736321518 (477h59m29.228753961s) [upload=420418]: Got next segment. Inline: false Sep 18 12:07:08.736392296 (477h59m29.228824747s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 12:07:08.736399235 (477h59m29.228831689s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 12:07:08.930372355 (477h59m29.422804809s) [seg_pos={0 0}, upload=420418]: Begin upload segment... Sep 18 12:07:08.930443554 (477h59m29.422875999s) [seg_pos={0 0}, upload=420418]: Done begin upload segment. Sep 18 12:07:08.930473176 (477h59m29.422905628s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931053919 (477h59m29.423486372s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931480689 (477h59m29.423913141s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931789500 (477h59m29.424221954s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932054595 (477h59m29.424487047s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932586965 (477h59m29.425019419s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933390177 (477h59m29.425822629s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933871840 (477h59m29.426304284s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.934343701 (477h59m29.426776153s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935203513 (477h59m29.427635965s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935630258 (477h59m29.428062716s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936008164 (477h59m29.428440618s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936419982 (477h59m29.428852434s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936804865 (477h59m29.429237319s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.937214138 (477h59m29.429646586s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.938000742 (477h59m29.430433187s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:09.553174842 (477h59m30.04560729s) [upload=420418]: Next returned nil segment Sep 18 12:07:09.553195606 (477h59m30.045628055s) [upload=420418]: Waiting for error group managing segments... Sep 18 12:07:09.683174793 (477h59m30.175607222s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684609696 (477h59m30.177042135s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684730544 (477h59m30.177162975s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.693784688 (477h59m30.186217123s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700124727 (477h59m30.192557162s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700146946 (477h59m30.192579377s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.705598092 (477h59m30.198030535s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.717876650 (477h59m30.210309086s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.724419875 (477h59m30.216852303s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.725131855 (477h59m30.217564285s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.727163870 (477h59m30.219596303s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.728582990 (477h59m30.22101543s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730707710 (477h59m30.223140141s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730729775 (477h59m30.223162219s) [seg_pos={0 0}, upload=420418]: Segment reached optimal threshold of 13 pieces. Sep 18 12:07:09.730899902 (477h59m30.223332332s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731113757 (477h59m30.223546206s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731162317 (477h59m30.223594746s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731177764 (477h59m30.223610211s) [seg_pos={0 0}, upload=420418]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 18 12:07:09.731299129 (477h59m30.223731574s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 18 12:07:09.731304746 (477h59m30.223737192s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 18 12:07:49.679071319 (478h0m10.171503751s) [upload=420418]: Done uploading segments... Sep 18 12:07:49.679092842 (478h0m10.171525273s) [upload=420418]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.589368474s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.671359154s FAIL (2025-09-18 12:19:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 18 12:07:08.735787684 (477h59m29.228220126s) [upload=420418]: Starting upload Sep 18 12:07:08.735899020 (477h59m29.22833145s) [upload=420418]: Done starting upload Sep 18 12:07:08.736057737 (477h59m29.228490182s) [upload=420418]: Uploading segments... Sep 18 12:07:08.736321518 (477h59m29.228753961s) [upload=420418]: Got next segment. Inline: false Sep 18 12:07:08.736392296 (477h59m29.228824747s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 12:07:08.736399235 (477h59m29.228831689s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 12:07:08.930372355 (477h59m29.422804809s) [seg_pos={0 0}, upload=420418]: Begin upload segment... Sep 18 12:07:08.930443554 (477h59m29.422875999s) [seg_pos={0 0}, upload=420418]: Done begin upload segment. Sep 18 12:07:08.930473176 (477h59m29.422905628s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931053919 (477h59m29.423486372s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931480689 (477h59m29.423913141s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931789500 (477h59m29.424221954s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932054595 (477h59m29.424487047s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932586965 (477h59m29.425019419s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933390177 (477h59m29.425822629s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933871840 (477h59m29.426304284s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.934343701 (477h59m29.426776153s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935203513 (477h59m29.427635965s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935630258 (477h59m29.428062716s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936008164 (477h59m29.428440618s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936419982 (477h59m29.428852434s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936804865 (477h59m29.429237319s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.937214138 (477h59m29.429646586s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.938000742 (477h59m29.430433187s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:09.553174842 (477h59m30.04560729s) [upload=420418]: Next returned nil segment Sep 18 12:07:09.553195606 (477h59m30.045628055s) [upload=420418]: Waiting for error group managing segments... Sep 18 12:07:09.683174793 (477h59m30.175607222s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684609696 (477h59m30.177042135s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684730544 (477h59m30.177162975s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.693784688 (477h59m30.186217123s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700124727 (477h59m30.192557162s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700146946 (477h59m30.192579377s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.705598092 (477h59m30.198030535s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.717876650 (477h59m30.210309086s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.724419875 (477h59m30.216852303s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.725131855 (477h59m30.217564285s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.727163870 (477h59m30.219596303s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.728582990 (477h59m30.22101543s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730707710 (477h59m30.223140141s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730729775 (477h59m30.223162219s) [seg_pos={0 0}, upload=420418]: Segment reached optimal threshold of 13 pieces. Sep 18 12:07:09.730899902 (477h59m30.223332332s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731113757 (477h59m30.223546206s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731162317 (477h59m30.223594746s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731177764 (477h59m30.223610211s) [seg_pos={0 0}, upload=420418]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 18 12:07:09.731299129 (477h59m30.223731574s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 18 12:07:09.731304746 (477h59m30.223737192s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 18 12:07:49.679071319 (478h0m10.171503751s) [upload=420418]: Done uploading segments... Sep 18 12:07:49.679092842 (478h0m10.171525273s) [upload=420418]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.67141696s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.563034103s FAIL (2025-09-18 12:18:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 18 12:07:08.735787684 (477h59m29.228220126s) [upload=420418]: Starting upload Sep 18 12:07:08.735899020 (477h59m29.22833145s) [upload=420418]: Done starting upload Sep 18 12:07:08.736057737 (477h59m29.228490182s) [upload=420418]: Uploading segments... Sep 18 12:07:08.736321518 (477h59m29.228753961s) [upload=420418]: Got next segment. Inline: false Sep 18 12:07:08.736392296 (477h59m29.228824747s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 12:07:08.736399235 (477h59m29.228831689s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 12:07:08.930372355 (477h59m29.422804809s) [seg_pos={0 0}, upload=420418]: Begin upload segment... Sep 18 12:07:08.930443554 (477h59m29.422875999s) [seg_pos={0 0}, upload=420418]: Done begin upload segment. Sep 18 12:07:08.930473176 (477h59m29.422905628s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931053919 (477h59m29.423486372s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931480689 (477h59m29.423913141s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931789500 (477h59m29.424221954s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932054595 (477h59m29.424487047s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932586965 (477h59m29.425019419s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933390177 (477h59m29.425822629s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933871840 (477h59m29.426304284s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.934343701 (477h59m29.426776153s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935203513 (477h59m29.427635965s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935630258 (477h59m29.428062716s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936008164 (477h59m29.428440618s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936419982 (477h59m29.428852434s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936804865 (477h59m29.429237319s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.937214138 (477h59m29.429646586s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.938000742 (477h59m29.430433187s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:09.553174842 (477h59m30.04560729s) [upload=420418]: Next returned nil segment Sep 18 12:07:09.553195606 (477h59m30.045628055s) [upload=420418]: Waiting for error group managing segments... Sep 18 12:07:09.683174793 (477h59m30.175607222s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684609696 (477h59m30.177042135s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684730544 (477h59m30.177162975s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.693784688 (477h59m30.186217123s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700124727 (477h59m30.192557162s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700146946 (477h59m30.192579377s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.705598092 (477h59m30.198030535s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.717876650 (477h59m30.210309086s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.724419875 (477h59m30.216852303s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.725131855 (477h59m30.217564285s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.727163870 (477h59m30.219596303s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.728582990 (477h59m30.22101543s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730707710 (477h59m30.223140141s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730729775 (477h59m30.223162219s) [seg_pos={0 0}, upload=420418]: Segment reached optimal threshold of 13 pieces. Sep 18 12:07:09.730899902 (477h59m30.223332332s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731113757 (477h59m30.223546206s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731162317 (477h59m30.223594746s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731177764 (477h59m30.223610211s) [seg_pos={0 0}, upload=420418]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 18 12:07:09.731299129 (477h59m30.223731574s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 18 12:07:09.731304746 (477h59m30.223737192s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 18 12:07:49.679071319 (478h0m10.171503751s) [upload=420418]: Done uploading segments... Sep 18 12:07:49.679092842 (478h0m10.171525273s) [upload=420418]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.563071514s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.553958284s FAIL (2025-09-18 12:17:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 18 12:07:08.735787684 (477h59m29.228220126s) [upload=420418]: Starting upload Sep 18 12:07:08.735899020 (477h59m29.22833145s) [upload=420418]: Done starting upload Sep 18 12:07:08.736057737 (477h59m29.228490182s) [upload=420418]: Uploading segments... Sep 18 12:07:08.736321518 (477h59m29.228753961s) [upload=420418]: Got next segment. Inline: false Sep 18 12:07:08.736392296 (477h59m29.228824747s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 12:07:08.736399235 (477h59m29.228831689s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 12:07:08.930372355 (477h59m29.422804809s) [seg_pos={0 0}, upload=420418]: Begin upload segment... Sep 18 12:07:08.930443554 (477h59m29.422875999s) [seg_pos={0 0}, upload=420418]: Done begin upload segment. Sep 18 12:07:08.930473176 (477h59m29.422905628s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931053919 (477h59m29.423486372s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931480689 (477h59m29.423913141s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931789500 (477h59m29.424221954s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932054595 (477h59m29.424487047s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932586965 (477h59m29.425019419s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933390177 (477h59m29.425822629s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933871840 (477h59m29.426304284s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.934343701 (477h59m29.426776153s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935203513 (477h59m29.427635965s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935630258 (477h59m29.428062716s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936008164 (477h59m29.428440618s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936419982 (477h59m29.428852434s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936804865 (477h59m29.429237319s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.937214138 (477h59m29.429646586s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.938000742 (477h59m29.430433187s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:09.553174842 (477h59m30.04560729s) [upload=420418]: Next returned nil segment Sep 18 12:07:09.553195606 (477h59m30.045628055s) [upload=420418]: Waiting for error group managing segments... Sep 18 12:07:09.683174793 (477h59m30.175607222s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684609696 (477h59m30.177042135s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684730544 (477h59m30.177162975s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.693784688 (477h59m30.186217123s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700124727 (477h59m30.192557162s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700146946 (477h59m30.192579377s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.705598092 (477h59m30.198030535s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.717876650 (477h59m30.210309086s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.724419875 (477h59m30.216852303s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.725131855 (477h59m30.217564285s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.727163870 (477h59m30.219596303s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.728582990 (477h59m30.22101543s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730707710 (477h59m30.223140141s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730729775 (477h59m30.223162219s) [seg_pos={0 0}, upload=420418]: Segment reached optimal threshold of 13 pieces. Sep 18 12:07:09.730899902 (477h59m30.223332332s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731113757 (477h59m30.223546206s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731162317 (477h59m30.223594746s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731177764 (477h59m30.223610211s) [seg_pos={0 0}, upload=420418]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 18 12:07:09.731299129 (477h59m30.223731574s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 18 12:07:09.731304746 (477h59m30.223737192s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 18 12:07:49.679071319 (478h0m10.171503751s) [upload=420418]: Done uploading segments... Sep 18 12:07:49.679092842 (478h0m10.171525273s) [upload=420418]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.553994778s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.486061743s FAIL (2025-09-18 12:17:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 18 12:07:08.735787684 (477h59m29.228220126s) [upload=420418]: Starting upload Sep 18 12:07:08.735899020 (477h59m29.22833145s) [upload=420418]: Done starting upload Sep 18 12:07:08.736057737 (477h59m29.228490182s) [upload=420418]: Uploading segments... Sep 18 12:07:08.736321518 (477h59m29.228753961s) [upload=420418]: Got next segment. Inline: false Sep 18 12:07:08.736392296 (477h59m29.228824747s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 12:07:08.736399235 (477h59m29.228831689s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 12:07:08.930372355 (477h59m29.422804809s) [seg_pos={0 0}, upload=420418]: Begin upload segment... Sep 18 12:07:08.930443554 (477h59m29.422875999s) [seg_pos={0 0}, upload=420418]: Done begin upload segment. Sep 18 12:07:08.930473176 (477h59m29.422905628s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931053919 (477h59m29.423486372s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931480689 (477h59m29.423913141s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931789500 (477h59m29.424221954s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932054595 (477h59m29.424487047s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932586965 (477h59m29.425019419s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933390177 (477h59m29.425822629s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933871840 (477h59m29.426304284s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.934343701 (477h59m29.426776153s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935203513 (477h59m29.427635965s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935630258 (477h59m29.428062716s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936008164 (477h59m29.428440618s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936419982 (477h59m29.428852434s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936804865 (477h59m29.429237319s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.937214138 (477h59m29.429646586s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.938000742 (477h59m29.430433187s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:09.553174842 (477h59m30.04560729s) [upload=420418]: Next returned nil segment Sep 18 12:07:09.553195606 (477h59m30.045628055s) [upload=420418]: Waiting for error group managing segments... Sep 18 12:07:09.683174793 (477h59m30.175607222s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684609696 (477h59m30.177042135s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684730544 (477h59m30.177162975s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.693784688 (477h59m30.186217123s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700124727 (477h59m30.192557162s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700146946 (477h59m30.192579377s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.705598092 (477h59m30.198030535s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.717876650 (477h59m30.210309086s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.724419875 (477h59m30.216852303s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.725131855 (477h59m30.217564285s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.727163870 (477h59m30.219596303s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.728582990 (477h59m30.22101543s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730707710 (477h59m30.223140141s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730729775 (477h59m30.223162219s) [seg_pos={0 0}, upload=420418]: Segment reached optimal threshold of 13 pieces. Sep 18 12:07:09.730899902 (477h59m30.223332332s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731113757 (477h59m30.223546206s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731162317 (477h59m30.223594746s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731177764 (477h59m30.223610211s) [seg_pos={0 0}, upload=420418]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 18 12:07:09.731299129 (477h59m30.223731574s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 18 12:07:09.731304746 (477h59m30.223737192s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 18 12:07:49.679071319 (478h0m10.171503751s) [upload=420418]: Done uploading segments... Sep 18 12:07:49.679092842 (478h0m10.171525273s) [upload=420418]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.48609669s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.531964991s FAIL (2025-09-18 12:16:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 18 12:07:08.735787684 (477h59m29.228220126s) [upload=420418]: Starting upload Sep 18 12:07:08.735899020 (477h59m29.22833145s) [upload=420418]: Done starting upload Sep 18 12:07:08.736057737 (477h59m29.228490182s) [upload=420418]: Uploading segments... Sep 18 12:07:08.736321518 (477h59m29.228753961s) [upload=420418]: Got next segment. Inline: false Sep 18 12:07:08.736392296 (477h59m29.228824747s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 12:07:08.736399235 (477h59m29.228831689s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 12:07:08.930372355 (477h59m29.422804809s) [seg_pos={0 0}, upload=420418]: Begin upload segment... Sep 18 12:07:08.930443554 (477h59m29.422875999s) [seg_pos={0 0}, upload=420418]: Done begin upload segment. Sep 18 12:07:08.930473176 (477h59m29.422905628s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931053919 (477h59m29.423486372s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931480689 (477h59m29.423913141s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931789500 (477h59m29.424221954s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932054595 (477h59m29.424487047s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932586965 (477h59m29.425019419s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933390177 (477h59m29.425822629s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933871840 (477h59m29.426304284s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.934343701 (477h59m29.426776153s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935203513 (477h59m29.427635965s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935630258 (477h59m29.428062716s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936008164 (477h59m29.428440618s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936419982 (477h59m29.428852434s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936804865 (477h59m29.429237319s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.937214138 (477h59m29.429646586s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.938000742 (477h59m29.430433187s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:09.553174842 (477h59m30.04560729s) [upload=420418]: Next returned nil segment Sep 18 12:07:09.553195606 (477h59m30.045628055s) [upload=420418]: Waiting for error group managing segments... Sep 18 12:07:09.683174793 (477h59m30.175607222s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684609696 (477h59m30.177042135s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684730544 (477h59m30.177162975s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.693784688 (477h59m30.186217123s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700124727 (477h59m30.192557162s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700146946 (477h59m30.192579377s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.705598092 (477h59m30.198030535s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.717876650 (477h59m30.210309086s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.724419875 (477h59m30.216852303s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.725131855 (477h59m30.217564285s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.727163870 (477h59m30.219596303s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.728582990 (477h59m30.22101543s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730707710 (477h59m30.223140141s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730729775 (477h59m30.223162219s) [seg_pos={0 0}, upload=420418]: Segment reached optimal threshold of 13 pieces. Sep 18 12:07:09.730899902 (477h59m30.223332332s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731113757 (477h59m30.223546206s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731162317 (477h59m30.223594746s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731177764 (477h59m30.223610211s) [seg_pos={0 0}, upload=420418]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 18 12:07:09.731299129 (477h59m30.223731574s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 18 12:07:09.731304746 (477h59m30.223737192s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 18 12:07:49.679071319 (478h0m10.171503751s) [upload=420418]: Done uploading segments... Sep 18 12:07:49.679092842 (478h0m10.171525273s) [upload=420418]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.532081949s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.605162636s FAIL (2025-09-18 12:15:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 18 12:07:08.735787684 (477h59m29.228220126s) [upload=420418]: Starting upload Sep 18 12:07:08.735899020 (477h59m29.22833145s) [upload=420418]: Done starting upload Sep 18 12:07:08.736057737 (477h59m29.228490182s) [upload=420418]: Uploading segments... Sep 18 12:07:08.736321518 (477h59m29.228753961s) [upload=420418]: Got next segment. Inline: false Sep 18 12:07:08.736392296 (477h59m29.228824747s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 12:07:08.736399235 (477h59m29.228831689s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 12:07:08.930372355 (477h59m29.422804809s) [seg_pos={0 0}, upload=420418]: Begin upload segment... Sep 18 12:07:08.930443554 (477h59m29.422875999s) [seg_pos={0 0}, upload=420418]: Done begin upload segment. Sep 18 12:07:08.930473176 (477h59m29.422905628s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931053919 (477h59m29.423486372s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931480689 (477h59m29.423913141s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931789500 (477h59m29.424221954s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932054595 (477h59m29.424487047s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932586965 (477h59m29.425019419s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933390177 (477h59m29.425822629s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933871840 (477h59m29.426304284s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.934343701 (477h59m29.426776153s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935203513 (477h59m29.427635965s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935630258 (477h59m29.428062716s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936008164 (477h59m29.428440618s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936419982 (477h59m29.428852434s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936804865 (477h59m29.429237319s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.937214138 (477h59m29.429646586s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.938000742 (477h59m29.430433187s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:09.553174842 (477h59m30.04560729s) [upload=420418]: Next returned nil segment Sep 18 12:07:09.553195606 (477h59m30.045628055s) [upload=420418]: Waiting for error group managing segments... Sep 18 12:07:09.683174793 (477h59m30.175607222s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684609696 (477h59m30.177042135s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684730544 (477h59m30.177162975s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.693784688 (477h59m30.186217123s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700124727 (477h59m30.192557162s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700146946 (477h59m30.192579377s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.705598092 (477h59m30.198030535s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.717876650 (477h59m30.210309086s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.724419875 (477h59m30.216852303s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.725131855 (477h59m30.217564285s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.727163870 (477h59m30.219596303s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.728582990 (477h59m30.22101543s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730707710 (477h59m30.223140141s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730729775 (477h59m30.223162219s) [seg_pos={0 0}, upload=420418]: Segment reached optimal threshold of 13 pieces. Sep 18 12:07:09.730899902 (477h59m30.223332332s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731113757 (477h59m30.223546206s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731162317 (477h59m30.223594746s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731177764 (477h59m30.223610211s) [seg_pos={0 0}, upload=420418]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 18 12:07:09.731299129 (477h59m30.223731574s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 18 12:07:09.731304746 (477h59m30.223737192s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 18 12:07:49.679071319 (478h0m10.171503751s) [upload=420418]: Done uploading segments... Sep 18 12:07:49.679092842 (478h0m10.171525273s) [upload=420418]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.605208193s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.458650184s FAIL (2025-09-18 12:14:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 18 12:07:08.735787684 (477h59m29.228220126s) [upload=420418]: Starting upload Sep 18 12:07:08.735899020 (477h59m29.22833145s) [upload=420418]: Done starting upload Sep 18 12:07:08.736057737 (477h59m29.228490182s) [upload=420418]: Uploading segments... Sep 18 12:07:08.736321518 (477h59m29.228753961s) [upload=420418]: Got next segment. Inline: false Sep 18 12:07:08.736392296 (477h59m29.228824747s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 12:07:08.736399235 (477h59m29.228831689s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 12:07:08.930372355 (477h59m29.422804809s) [seg_pos={0 0}, upload=420418]: Begin upload segment... Sep 18 12:07:08.930443554 (477h59m29.422875999s) [seg_pos={0 0}, upload=420418]: Done begin upload segment. Sep 18 12:07:08.930473176 (477h59m29.422905628s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931053919 (477h59m29.423486372s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931480689 (477h59m29.423913141s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931789500 (477h59m29.424221954s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932054595 (477h59m29.424487047s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932586965 (477h59m29.425019419s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933390177 (477h59m29.425822629s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933871840 (477h59m29.426304284s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.934343701 (477h59m29.426776153s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935203513 (477h59m29.427635965s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935630258 (477h59m29.428062716s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936008164 (477h59m29.428440618s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936419982 (477h59m29.428852434s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936804865 (477h59m29.429237319s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.937214138 (477h59m29.429646586s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.938000742 (477h59m29.430433187s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:09.553174842 (477h59m30.04560729s) [upload=420418]: Next returned nil segment Sep 18 12:07:09.553195606 (477h59m30.045628055s) [upload=420418]: Waiting for error group managing segments... Sep 18 12:07:09.683174793 (477h59m30.175607222s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684609696 (477h59m30.177042135s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684730544 (477h59m30.177162975s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.693784688 (477h59m30.186217123s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700124727 (477h59m30.192557162s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700146946 (477h59m30.192579377s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.705598092 (477h59m30.198030535s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.717876650 (477h59m30.210309086s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.724419875 (477h59m30.216852303s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.725131855 (477h59m30.217564285s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.727163870 (477h59m30.219596303s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.728582990 (477h59m30.22101543s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730707710 (477h59m30.223140141s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730729775 (477h59m30.223162219s) [seg_pos={0 0}, upload=420418]: Segment reached optimal threshold of 13 pieces. Sep 18 12:07:09.730899902 (477h59m30.223332332s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731113757 (477h59m30.223546206s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731162317 (477h59m30.223594746s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731177764 (477h59m30.223610211s) [seg_pos={0 0}, upload=420418]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 18 12:07:09.731299129 (477h59m30.223731574s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 18 12:07:09.731304746 (477h59m30.223737192s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 18 12:07:49.679071319 (478h0m10.171503751s) [upload=420418]: Done uploading segments... Sep 18 12:07:49.679092842 (478h0m10.171525273s) [upload=420418]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.458708218s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.471912304s FAIL (2025-09-18 12:13:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 18 12:07:08.735787684 (477h59m29.228220126s) [upload=420418]: Starting upload Sep 18 12:07:08.735899020 (477h59m29.22833145s) [upload=420418]: Done starting upload Sep 18 12:07:08.736057737 (477h59m29.228490182s) [upload=420418]: Uploading segments... Sep 18 12:07:08.736321518 (477h59m29.228753961s) [upload=420418]: Got next segment. Inline: false Sep 18 12:07:08.736392296 (477h59m29.228824747s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 12:07:08.736399235 (477h59m29.228831689s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 12:07:08.930372355 (477h59m29.422804809s) [seg_pos={0 0}, upload=420418]: Begin upload segment... Sep 18 12:07:08.930443554 (477h59m29.422875999s) [seg_pos={0 0}, upload=420418]: Done begin upload segment. Sep 18 12:07:08.930473176 (477h59m29.422905628s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931053919 (477h59m29.423486372s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931480689 (477h59m29.423913141s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931789500 (477h59m29.424221954s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932054595 (477h59m29.424487047s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932586965 (477h59m29.425019419s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933390177 (477h59m29.425822629s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933871840 (477h59m29.426304284s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.934343701 (477h59m29.426776153s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935203513 (477h59m29.427635965s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935630258 (477h59m29.428062716s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936008164 (477h59m29.428440618s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936419982 (477h59m29.428852434s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936804865 (477h59m29.429237319s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.937214138 (477h59m29.429646586s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.938000742 (477h59m29.430433187s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:09.553174842 (477h59m30.04560729s) [upload=420418]: Next returned nil segment Sep 18 12:07:09.553195606 (477h59m30.045628055s) [upload=420418]: Waiting for error group managing segments... Sep 18 12:07:09.683174793 (477h59m30.175607222s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684609696 (477h59m30.177042135s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684730544 (477h59m30.177162975s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.693784688 (477h59m30.186217123s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700124727 (477h59m30.192557162s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700146946 (477h59m30.192579377s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.705598092 (477h59m30.198030535s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.717876650 (477h59m30.210309086s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.724419875 (477h59m30.216852303s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.725131855 (477h59m30.217564285s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.727163870 (477h59m30.219596303s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.728582990 (477h59m30.22101543s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730707710 (477h59m30.223140141s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730729775 (477h59m30.223162219s) [seg_pos={0 0}, upload=420418]: Segment reached optimal threshold of 13 pieces. Sep 18 12:07:09.730899902 (477h59m30.223332332s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731113757 (477h59m30.223546206s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731162317 (477h59m30.223594746s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731177764 (477h59m30.223610211s) [seg_pos={0 0}, upload=420418]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 18 12:07:09.731299129 (477h59m30.223731574s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 18 12:07:09.731304746 (477h59m30.223737192s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 18 12:07:49.679071319 (478h0m10.171503751s) [upload=420418]: Done uploading segments... Sep 18 12:07:49.679092842 (478h0m10.171525273s) [upload=420418]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.472018587s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.485028166s FAIL (2025-09-18 12:12:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 18 12:07:08.735787684 (477h59m29.228220126s) [upload=420418]: Starting upload Sep 18 12:07:08.735899020 (477h59m29.22833145s) [upload=420418]: Done starting upload Sep 18 12:07:08.736057737 (477h59m29.228490182s) [upload=420418]: Uploading segments... Sep 18 12:07:08.736321518 (477h59m29.228753961s) [upload=420418]: Got next segment. Inline: false Sep 18 12:07:08.736392296 (477h59m29.228824747s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 12:07:08.736399235 (477h59m29.228831689s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 12:07:08.930372355 (477h59m29.422804809s) [seg_pos={0 0}, upload=420418]: Begin upload segment... Sep 18 12:07:08.930443554 (477h59m29.422875999s) [seg_pos={0 0}, upload=420418]: Done begin upload segment. Sep 18 12:07:08.930473176 (477h59m29.422905628s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931053919 (477h59m29.423486372s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931480689 (477h59m29.423913141s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931789500 (477h59m29.424221954s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932054595 (477h59m29.424487047s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932586965 (477h59m29.425019419s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933390177 (477h59m29.425822629s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933871840 (477h59m29.426304284s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.934343701 (477h59m29.426776153s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935203513 (477h59m29.427635965s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935630258 (477h59m29.428062716s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936008164 (477h59m29.428440618s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936419982 (477h59m29.428852434s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936804865 (477h59m29.429237319s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.937214138 (477h59m29.429646586s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.938000742 (477h59m29.430433187s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:09.553174842 (477h59m30.04560729s) [upload=420418]: Next returned nil segment Sep 18 12:07:09.553195606 (477h59m30.045628055s) [upload=420418]: Waiting for error group managing segments... Sep 18 12:07:09.683174793 (477h59m30.175607222s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684609696 (477h59m30.177042135s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684730544 (477h59m30.177162975s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.693784688 (477h59m30.186217123s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700124727 (477h59m30.192557162s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700146946 (477h59m30.192579377s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.705598092 (477h59m30.198030535s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.717876650 (477h59m30.210309086s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.724419875 (477h59m30.216852303s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.725131855 (477h59m30.217564285s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.727163870 (477h59m30.219596303s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.728582990 (477h59m30.22101543s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730707710 (477h59m30.223140141s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730729775 (477h59m30.223162219s) [seg_pos={0 0}, upload=420418]: Segment reached optimal threshold of 13 pieces. Sep 18 12:07:09.730899902 (477h59m30.223332332s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731113757 (477h59m30.223546206s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731162317 (477h59m30.223594746s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731177764 (477h59m30.223610211s) [seg_pos={0 0}, upload=420418]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 18 12:07:09.731299129 (477h59m30.223731574s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 18 12:07:09.731304746 (477h59m30.223737192s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 18 12:07:49.679071319 (478h0m10.171503751s) [upload=420418]: Done uploading segments... Sep 18 12:07:49.679092842 (478h0m10.171525273s) [upload=420418]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.485079487s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.730168229s FAIL (2025-09-18 12:11:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 18 12:07:08.735787684 (477h59m29.228220126s) [upload=420418]: Starting upload Sep 18 12:07:08.735899020 (477h59m29.22833145s) [upload=420418]: Done starting upload Sep 18 12:07:08.736057737 (477h59m29.228490182s) [upload=420418]: Uploading segments... Sep 18 12:07:08.736321518 (477h59m29.228753961s) [upload=420418]: Got next segment. Inline: false Sep 18 12:07:08.736392296 (477h59m29.228824747s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 12:07:08.736399235 (477h59m29.228831689s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 12:07:08.930372355 (477h59m29.422804809s) [seg_pos={0 0}, upload=420418]: Begin upload segment... Sep 18 12:07:08.930443554 (477h59m29.422875999s) [seg_pos={0 0}, upload=420418]: Done begin upload segment. Sep 18 12:07:08.930473176 (477h59m29.422905628s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931053919 (477h59m29.423486372s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931480689 (477h59m29.423913141s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931789500 (477h59m29.424221954s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932054595 (477h59m29.424487047s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932586965 (477h59m29.425019419s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933390177 (477h59m29.425822629s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933871840 (477h59m29.426304284s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.934343701 (477h59m29.426776153s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935203513 (477h59m29.427635965s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935630258 (477h59m29.428062716s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936008164 (477h59m29.428440618s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936419982 (477h59m29.428852434s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936804865 (477h59m29.429237319s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.937214138 (477h59m29.429646586s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.938000742 (477h59m29.430433187s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:09.553174842 (477h59m30.04560729s) [upload=420418]: Next returned nil segment Sep 18 12:07:09.553195606 (477h59m30.045628055s) [upload=420418]: Waiting for error group managing segments... Sep 18 12:07:09.683174793 (477h59m30.175607222s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684609696 (477h59m30.177042135s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684730544 (477h59m30.177162975s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.693784688 (477h59m30.186217123s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700124727 (477h59m30.192557162s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700146946 (477h59m30.192579377s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.705598092 (477h59m30.198030535s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.717876650 (477h59m30.210309086s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.724419875 (477h59m30.216852303s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.725131855 (477h59m30.217564285s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.727163870 (477h59m30.219596303s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.728582990 (477h59m30.22101543s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730707710 (477h59m30.223140141s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730729775 (477h59m30.223162219s) [seg_pos={0 0}, upload=420418]: Segment reached optimal threshold of 13 pieces. Sep 18 12:07:09.730899902 (477h59m30.223332332s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731113757 (477h59m30.223546206s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731162317 (477h59m30.223594746s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731177764 (477h59m30.223610211s) [seg_pos={0 0}, upload=420418]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 18 12:07:09.731299129 (477h59m30.223731574s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 18 12:07:09.731304746 (477h59m30.223737192s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 18 12:07:49.679071319 (478h0m10.171503751s) [upload=420418]: Done uploading segments... Sep 18 12:07:49.679092842 (478h0m10.171525273s) [upload=420418]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.730205282s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.426378035s FAIL (2025-09-18 12:10:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 18 12:07:08.735787684 (477h59m29.228220126s) [upload=420418]: Starting upload Sep 18 12:07:08.735899020 (477h59m29.22833145s) [upload=420418]: Done starting upload Sep 18 12:07:08.736057737 (477h59m29.228490182s) [upload=420418]: Uploading segments... Sep 18 12:07:08.736321518 (477h59m29.228753961s) [upload=420418]: Got next segment. Inline: false Sep 18 12:07:08.736392296 (477h59m29.228824747s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 12:07:08.736399235 (477h59m29.228831689s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 12:07:08.930372355 (477h59m29.422804809s) [seg_pos={0 0}, upload=420418]: Begin upload segment... Sep 18 12:07:08.930443554 (477h59m29.422875999s) [seg_pos={0 0}, upload=420418]: Done begin upload segment. Sep 18 12:07:08.930473176 (477h59m29.422905628s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931053919 (477h59m29.423486372s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931480689 (477h59m29.423913141s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931789500 (477h59m29.424221954s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932054595 (477h59m29.424487047s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932586965 (477h59m29.425019419s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933390177 (477h59m29.425822629s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933871840 (477h59m29.426304284s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.934343701 (477h59m29.426776153s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935203513 (477h59m29.427635965s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935630258 (477h59m29.428062716s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936008164 (477h59m29.428440618s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936419982 (477h59m29.428852434s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936804865 (477h59m29.429237319s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.937214138 (477h59m29.429646586s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.938000742 (477h59m29.430433187s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:09.553174842 (477h59m30.04560729s) [upload=420418]: Next returned nil segment Sep 18 12:07:09.553195606 (477h59m30.045628055s) [upload=420418]: Waiting for error group managing segments... Sep 18 12:07:09.683174793 (477h59m30.175607222s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684609696 (477h59m30.177042135s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684730544 (477h59m30.177162975s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.693784688 (477h59m30.186217123s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700124727 (477h59m30.192557162s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700146946 (477h59m30.192579377s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.705598092 (477h59m30.198030535s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.717876650 (477h59m30.210309086s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.724419875 (477h59m30.216852303s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.725131855 (477h59m30.217564285s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.727163870 (477h59m30.219596303s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.728582990 (477h59m30.22101543s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730707710 (477h59m30.223140141s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730729775 (477h59m30.223162219s) [seg_pos={0 0}, upload=420418]: Segment reached optimal threshold of 13 pieces. Sep 18 12:07:09.730899902 (477h59m30.223332332s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731113757 (477h59m30.223546206s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731162317 (477h59m30.223594746s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731177764 (477h59m30.223610211s) [seg_pos={0 0}, upload=420418]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 18 12:07:09.731299129 (477h59m30.223731574s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 18 12:07:09.731304746 (477h59m30.223737192s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 18 12:07:49.679071319 (478h0m10.171503751s) [upload=420418]: Done uploading segments... Sep 18 12:07:49.679092842 (478h0m10.171525273s) [upload=420418]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.426417584s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.520693051s FAIL (2025-09-18 12:09:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 18 12:07:08.735787684 (477h59m29.228220126s) [upload=420418]: Starting upload Sep 18 12:07:08.735899020 (477h59m29.22833145s) [upload=420418]: Done starting upload Sep 18 12:07:08.736057737 (477h59m29.228490182s) [upload=420418]: Uploading segments... Sep 18 12:07:08.736321518 (477h59m29.228753961s) [upload=420418]: Got next segment. Inline: false Sep 18 12:07:08.736392296 (477h59m29.228824747s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 12:07:08.736399235 (477h59m29.228831689s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 12:07:08.930372355 (477h59m29.422804809s) [seg_pos={0 0}, upload=420418]: Begin upload segment... Sep 18 12:07:08.930443554 (477h59m29.422875999s) [seg_pos={0 0}, upload=420418]: Done begin upload segment. Sep 18 12:07:08.930473176 (477h59m29.422905628s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931053919 (477h59m29.423486372s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931480689 (477h59m29.423913141s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931789500 (477h59m29.424221954s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932054595 (477h59m29.424487047s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932586965 (477h59m29.425019419s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933390177 (477h59m29.425822629s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933871840 (477h59m29.426304284s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.934343701 (477h59m29.426776153s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935203513 (477h59m29.427635965s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935630258 (477h59m29.428062716s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936008164 (477h59m29.428440618s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936419982 (477h59m29.428852434s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936804865 (477h59m29.429237319s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.937214138 (477h59m29.429646586s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.938000742 (477h59m29.430433187s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:09.553174842 (477h59m30.04560729s) [upload=420418]: Next returned nil segment Sep 18 12:07:09.553195606 (477h59m30.045628055s) [upload=420418]: Waiting for error group managing segments... Sep 18 12:07:09.683174793 (477h59m30.175607222s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684609696 (477h59m30.177042135s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684730544 (477h59m30.177162975s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.693784688 (477h59m30.186217123s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700124727 (477h59m30.192557162s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700146946 (477h59m30.192579377s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.705598092 (477h59m30.198030535s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.717876650 (477h59m30.210309086s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.724419875 (477h59m30.216852303s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.725131855 (477h59m30.217564285s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.727163870 (477h59m30.219596303s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.728582990 (477h59m30.22101543s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730707710 (477h59m30.223140141s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730729775 (477h59m30.223162219s) [seg_pos={0 0}, upload=420418]: Segment reached optimal threshold of 13 pieces. Sep 18 12:07:09.730899902 (477h59m30.223332332s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731113757 (477h59m30.223546206s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731162317 (477h59m30.223594746s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731177764 (477h59m30.223610211s) [seg_pos={0 0}, upload=420418]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 18 12:07:09.731299129 (477h59m30.223731574s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 18 12:07:09.731304746 (477h59m30.223737192s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 18 12:07:49.679071319 (478h0m10.171503751s) [upload=420418]: Done uploading segments... Sep 18 12:07:49.679092842 (478h0m10.171525273s) [upload=420418]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.520740188s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.493237466s FAIL (2025-09-18 12:09:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 18 12:07:08.735787684 (477h59m29.228220126s) [upload=420418]: Starting upload Sep 18 12:07:08.735899020 (477h59m29.22833145s) [upload=420418]: Done starting upload Sep 18 12:07:08.736057737 (477h59m29.228490182s) [upload=420418]: Uploading segments... Sep 18 12:07:08.736321518 (477h59m29.228753961s) [upload=420418]: Got next segment. Inline: false Sep 18 12:07:08.736392296 (477h59m29.228824747s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 12:07:08.736399235 (477h59m29.228831689s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 12:07:08.930372355 (477h59m29.422804809s) [seg_pos={0 0}, upload=420418]: Begin upload segment... Sep 18 12:07:08.930443554 (477h59m29.422875999s) [seg_pos={0 0}, upload=420418]: Done begin upload segment. Sep 18 12:07:08.930473176 (477h59m29.422905628s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931053919 (477h59m29.423486372s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931480689 (477h59m29.423913141s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931789500 (477h59m29.424221954s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932054595 (477h59m29.424487047s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932586965 (477h59m29.425019419s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933390177 (477h59m29.425822629s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933871840 (477h59m29.426304284s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.934343701 (477h59m29.426776153s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935203513 (477h59m29.427635965s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935630258 (477h59m29.428062716s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936008164 (477h59m29.428440618s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936419982 (477h59m29.428852434s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936804865 (477h59m29.429237319s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.937214138 (477h59m29.429646586s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.938000742 (477h59m29.430433187s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:09.553174842 (477h59m30.04560729s) [upload=420418]: Next returned nil segment Sep 18 12:07:09.553195606 (477h59m30.045628055s) [upload=420418]: Waiting for error group managing segments... Sep 18 12:07:09.683174793 (477h59m30.175607222s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684609696 (477h59m30.177042135s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684730544 (477h59m30.177162975s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.693784688 (477h59m30.186217123s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700124727 (477h59m30.192557162s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700146946 (477h59m30.192579377s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.705598092 (477h59m30.198030535s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.717876650 (477h59m30.210309086s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.724419875 (477h59m30.216852303s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.725131855 (477h59m30.217564285s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.727163870 (477h59m30.219596303s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.728582990 (477h59m30.22101543s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730707710 (477h59m30.223140141s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730729775 (477h59m30.223162219s) [seg_pos={0 0}, upload=420418]: Segment reached optimal threshold of 13 pieces. Sep 18 12:07:09.730899902 (477h59m30.223332332s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731113757 (477h59m30.223546206s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731162317 (477h59m30.223594746s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731177764 (477h59m30.223610211s) [seg_pos={0 0}, upload=420418]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 18 12:07:09.731299129 (477h59m30.223731574s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 18 12:07:09.731304746 (477h59m30.223737192s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 18 12:07:49.679071319 (478h0m10.171503751s) [upload=420418]: Done uploading segments... Sep 18 12:07:49.679092842 (478h0m10.171525273s) [upload=420418]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.493282927s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.751019689s FAIL (2025-09-18 12:08:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 18 12:07:08.735787684 (477h59m29.228220126s) [upload=420418]: Starting upload Sep 18 12:07:08.735899020 (477h59m29.22833145s) [upload=420418]: Done starting upload Sep 18 12:07:08.736057737 (477h59m29.228490182s) [upload=420418]: Uploading segments... Sep 18 12:07:08.736321518 (477h59m29.228753961s) [upload=420418]: Got next segment. Inline: false Sep 18 12:07:08.736392296 (477h59m29.228824747s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 12:07:08.736399235 (477h59m29.228831689s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 12:07:08.930372355 (477h59m29.422804809s) [seg_pos={0 0}, upload=420418]: Begin upload segment... Sep 18 12:07:08.930443554 (477h59m29.422875999s) [seg_pos={0 0}, upload=420418]: Done begin upload segment. Sep 18 12:07:08.930473176 (477h59m29.422905628s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931053919 (477h59m29.423486372s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931480689 (477h59m29.423913141s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931789500 (477h59m29.424221954s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932054595 (477h59m29.424487047s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932586965 (477h59m29.425019419s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933390177 (477h59m29.425822629s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933871840 (477h59m29.426304284s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.934343701 (477h59m29.426776153s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935203513 (477h59m29.427635965s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935630258 (477h59m29.428062716s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936008164 (477h59m29.428440618s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936419982 (477h59m29.428852434s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936804865 (477h59m29.429237319s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.937214138 (477h59m29.429646586s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.938000742 (477h59m29.430433187s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:09.553174842 (477h59m30.04560729s) [upload=420418]: Next returned nil segment Sep 18 12:07:09.553195606 (477h59m30.045628055s) [upload=420418]: Waiting for error group managing segments... Sep 18 12:07:09.683174793 (477h59m30.175607222s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684609696 (477h59m30.177042135s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684730544 (477h59m30.177162975s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.693784688 (477h59m30.186217123s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700124727 (477h59m30.192557162s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700146946 (477h59m30.192579377s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.705598092 (477h59m30.198030535s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.717876650 (477h59m30.210309086s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.724419875 (477h59m30.216852303s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.725131855 (477h59m30.217564285s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.727163870 (477h59m30.219596303s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.728582990 (477h59m30.22101543s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730707710 (477h59m30.223140141s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730729775 (477h59m30.223162219s) [seg_pos={0 0}, upload=420418]: Segment reached optimal threshold of 13 pieces. Sep 18 12:07:09.730899902 (477h59m30.223332332s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731113757 (477h59m30.223546206s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731162317 (477h59m30.223594746s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731177764 (477h59m30.223610211s) [seg_pos={0 0}, upload=420418]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 18 12:07:09.731299129 (477h59m30.223731574s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 18 12:07:09.731304746 (477h59m30.223737192s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 18 12:07:49.679071319 (478h0m10.171503751s) [upload=420418]: Done uploading segments... Sep 18 12:07:49.679092842 (478h0m10.171525273s) [upload=420418]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.751054946s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 41.265233911s FAIL (2025-09-18 12:07:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 18 12:07:08.735787684 (477h59m29.228220126s) [upload=420418]: Starting upload Sep 18 12:07:08.735899020 (477h59m29.22833145s) [upload=420418]: Done starting upload Sep 18 12:07:08.736057737 (477h59m29.228490182s) [upload=420418]: Uploading segments... Sep 18 12:07:08.736321518 (477h59m29.228753961s) [upload=420418]: Got next segment. Inline: false Sep 18 12:07:08.736392296 (477h59m29.228824747s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 12:07:08.736399235 (477h59m29.228831689s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 12:07:08.930372355 (477h59m29.422804809s) [seg_pos={0 0}, upload=420418]: Begin upload segment... Sep 18 12:07:08.930443554 (477h59m29.422875999s) [seg_pos={0 0}, upload=420418]: Done begin upload segment. Sep 18 12:07:08.930473176 (477h59m29.422905628s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931053919 (477h59m29.423486372s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931480689 (477h59m29.423913141s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.931789500 (477h59m29.424221954s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932054595 (477h59m29.424487047s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.932586965 (477h59m29.425019419s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933390177 (477h59m29.425822629s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.933871840 (477h59m29.426304284s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.934343701 (477h59m29.426776153s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935203513 (477h59m29.427635965s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.935630258 (477h59m29.428062716s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936008164 (477h59m29.428440618s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936419982 (477h59m29.428852434s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.936804865 (477h59m29.429237319s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.937214138 (477h59m29.429646586s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:08.938000742 (477h59m29.430433187s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Uploading piece... Sep 18 12:07:09.553174842 (477h59m30.04560729s) [upload=420418]: Next returned nil segment Sep 18 12:07:09.553195606 (477h59m30.045628055s) [upload=420418]: Waiting for error group managing segments... Sep 18 12:07:09.683174793 (477h59m30.175607222s) [noise=true , address=45.91.116.13:4154 , piece_id=3OHFC4M6BKEJTJG3XZTAEQMTVTQF7UDB7LIQHVMKMSAAIDJXIVTA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684609696 (477h59m30.177042135s) [noise=true , address=45.91.116.11:4119 , piece_id=OAM2Z2JFAHI6OWTOH262IYAGKD3DBMRUCKZT6WMP4RR73WQODFJA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.684730544 (477h59m30.177162975s) [noise=true , address=45.91.116.7:4009 , piece_id=OI6EVWCAN6EMDIQKV2DFCRLCESAYR2O525QQ5FX74N4LMNH2PSRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.693784688 (477h59m30.186217123s) [noise=true , address=77.90.31.12:4592 , piece_id=47WQJCO3CJGF27IS2LVRFSR5CV24GRRE2MMHK6KIC4CWCWNG5DEA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700124727 (477h59m30.192557162s) [noise=true , address=45.91.116.14:4191 , piece_id=M3IMCDINZZ4ZQPMBILWADIE3MUYVRJHOM2TWPHHIJIU7THV5HCIQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.700146946 (477h59m30.192579377s) [noise=true , address=45.91.116.4:4938 , piece_id=RAHQZ67TQUOVFAOAAA45HYG3AGNX23MDVACR5RWG6PMTLL4B6VCA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.705598092 (477h59m30.198030535s) [noise=true , address=77.90.31.17:4772 , piece_id=FYECKYY5CTHNO54PEYVFY2PT44KIESN4MX5ARQM33E2WEKC5UQRQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.717876650 (477h59m30.210309086s) [noise=true , address=45.91.116.11:4118 , piece_id=AX7S4UDZLWRVSTWNBNB6LZ2PO3RYRUPYXMNVH4OCDUEMAEJIAZYQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.724419875 (477h59m30.216852303s) [noise=true , address=145.79.227.4:4186 , piece_id=VH7FM3SXNSEFQV4PM5AHHQXDKVKZRGTKVHKNVWP4456S4YYLSAIA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.725131855 (477h59m30.217564285s) [noise=true , address=45.91.116.5:4299 , piece_id=6FPTS4PFCTYO35YHEVFGFZJSMUOMHJTWUJUAHYQ7SCEN25V727OQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.727163870 (477h59m30.219596303s) [noise=true , address=145.79.227.14:4839 , piece_id=PTHTTZG26M2T3PGAZTNUTUKMQIOEPU4DDG2Z4LSTCGOLWNTR7POA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.728582990 (477h59m30.22101543s) [noise=true , address=145.79.227.19:4077 , piece_id=JYAZ6KTE3XS7RB2YPUP2EDHC2354UH7BNXFMM2JZ73OE4DQ5DBKQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730707710 (477h59m30.223140141s) [noise=true , address=145.79.227.7:4295 , piece_id=MHH45JVFWWC5RCCXFUYTI2F7PALWBFW7KBAEQBPMRV4GF3DEVJXA, seg_pos={0 0}, upload=420418]: Done uploading piece. err: <nil> Sep 18 12:07:09.730729775 (477h59m30.223162219s) [seg_pos={0 0}, upload=420418]: Segment reached optimal threshold of 13 pieces. Sep 18 12:07:09.730899902 (477h59m30.223332332s) [noise=true , address=45.91.116.5:4297 , piece_id=DOLZD3OBYWPRN5UKIMDPOHO2PJEDH56AIBXHEWL6WEH35LRZKMQQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731113757 (477h59m30.223546206s) [noise=true , address=145.79.227.11:4730 , piece_id=IP5W5PLWD7QJGUOGCHZWAJFQ7GHL7XMBHSF7JGFN647242BTMC4A, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731162317 (477h59m30.223594746s) [noise=true , address=145.79.227.5:4222 , piece_id=TVYZF3Y7246FLFPI46POOJX67BOROZ64WTC23KTE7IBZL7PIVIJQ, seg_pos={0 0}, upload=420418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Sep 18 12:07:09.731177764 (477h59m30.223610211s) [seg_pos={0 0}, upload=420418]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 18 12:07:09.731299129 (477h59m30.223731574s) [upload=420418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 18 12:07:09.731304746 (477h59m30.223737192s) [upload=420418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 18 12:07:49.679071319 (478h0m10.171503751s) [upload=420418]: Done uploading segments... Sep 18 12:07:49.679092842 (478h0m10.171525273s) [upload=420418]: Upload finished. err: metaclient: context deadline exceeded Duration: 41.265281174s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.571321954s FAIL (2025-09-18 07:04:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606164283 (472h12m51.098596735s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606697593 (472h12m51.099130037s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608051611 (472h12m51.100484056s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608678493 (472h12m51.101110944s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.609893324 (472h12m51.102325779s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.610954207 (472h12m51.103386656s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611458361 (472h12m51.103890813s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611966832 (472h12m51.104399283s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.615074539 (472h12m51.107506985s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.617371261 (472h12m51.109803715s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.618213880 (472h12m51.110646334s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.619133336 (472h12m51.111565791s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:31.285536041 (472h12m51.77796849s) [upload=415363]: Next returned nil segment Sep 18 06:20:31.285571077 (472h12m51.778003528s) [upload=415363]: Waiting for error group managing segments... Sep 18 06:20:31.397318156 (472h12m51.889750585s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.409603457 (472h12m51.902035902s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.412562303 (472h12m51.904994735s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:21:00.171009301 (472h13m20.663441758s) [noise=true , address=45.91.116.12:4226 , piece_id=7NKKWSTZ3WTW4NA7VTRWSSPSNBLXW3NJBOCEDT34NKYSGVD7UFCA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:54302->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.171668056 (472h13m20.664100511s) [noise=true , address=45.91.116.10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: read tcp 139.59.144.22:37718->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172033515 (472h13m20.664465965s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172061093 (472h13m20.664493549s) [noise=true , address=45.91.116.5:4297 , piece_id=4XPFFRMWOX6NW2ZB6AVJ2NZH2MPSQLW67SAMJFT7BCYOEQKL4SOA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172531910 (472h13m20.664964367s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172634427 (472h13m20.665066857s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:37268->45.91.116.7:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172651500 (472h13m20.66508395s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 139.59.144.22:45276->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172708335 (472h13m20.665140789s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 139.59.144.22:59692->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172770932 (472h13m20.665203365s) [noise=true , address=45.91.116.4:4939 , piece_id=IQCTRATIFNKF7YEGNYP52PUXCMT2N23AFVSX37BBW42IK6MXTBXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 139.59.144.22:43042->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172832116 (472h13m20.665264567s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 139.59.144.22:49606->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172871254 (472h13m20.665303689s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 139.59.144.22:55146->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172885844 (472h13m20.665318284s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: read tcp 139.59.144.22:59448->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172898443 (472h13m20.665330883s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 139.59.144.22:55382->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172972913 (472h13m20.665405371s) [seg_pos={0 0}, upload=415363]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 18 06:21:00.285796348 (472h13m20.778228783s) [upload=415363]: Done uploading segments... Sep 18 06:21:00.285852252 (472h13m20.778284705s) [upload=415363]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 2.571356566s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 3.283571586s FAIL (2025-09-18 07:04:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.283605298s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.653846744s FAIL (2025-09-18 07:04:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606164283 (472h12m51.098596735s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606697593 (472h12m51.099130037s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608051611 (472h12m51.100484056s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608678493 (472h12m51.101110944s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.609893324 (472h12m51.102325779s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.610954207 (472h12m51.103386656s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611458361 (472h12m51.103890813s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611966832 (472h12m51.104399283s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.615074539 (472h12m51.107506985s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.617371261 (472h12m51.109803715s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.618213880 (472h12m51.110646334s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.619133336 (472h12m51.111565791s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:31.285536041 (472h12m51.77796849s) [upload=415363]: Next returned nil segment Sep 18 06:20:31.285571077 (472h12m51.778003528s) [upload=415363]: Waiting for error group managing segments... Sep 18 06:20:31.397318156 (472h12m51.889750585s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.409603457 (472h12m51.902035902s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.412562303 (472h12m51.904994735s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:21:00.171009301 (472h13m20.663441758s) [noise=true , address=45.91.116.12:4226 , piece_id=7NKKWSTZ3WTW4NA7VTRWSSPSNBLXW3NJBOCEDT34NKYSGVD7UFCA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:54302->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.171668056 (472h13m20.664100511s) [noise=true , address=45.91.116.10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: read tcp 139.59.144.22:37718->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172033515 (472h13m20.664465965s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172061093 (472h13m20.664493549s) [noise=true , address=45.91.116.5:4297 , piece_id=4XPFFRMWOX6NW2ZB6AVJ2NZH2MPSQLW67SAMJFT7BCYOEQKL4SOA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172531910 (472h13m20.664964367s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172634427 (472h13m20.665066857s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:37268->45.91.116.7:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172651500 (472h13m20.66508395s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 139.59.144.22:45276->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172708335 (472h13m20.665140789s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 139.59.144.22:59692->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172770932 (472h13m20.665203365s) [noise=true , address=45.91.116.4:4939 , piece_id=IQCTRATIFNKF7YEGNYP52PUXCMT2N23AFVSX37BBW42IK6MXTBXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 139.59.144.22:43042->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172832116 (472h13m20.665264567s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 139.59.144.22:49606->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172871254 (472h13m20.665303689s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 139.59.144.22:55146->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172885844 (472h13m20.665318284s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: read tcp 139.59.144.22:59448->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172898443 (472h13m20.665330883s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 139.59.144.22:55382->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172972913 (472h13m20.665405371s) [seg_pos={0 0}, upload=415363]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 18 06:21:00.285796348 (472h13m20.778228783s) [upload=415363]: Done uploading segments... Sep 18 06:21:00.285852252 (472h13m20.778284705s) [upload=415363]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 2.653880806s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.683709098s FAIL (2025-09-18 07:03:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606164283 (472h12m51.098596735s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606697593 (472h12m51.099130037s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608051611 (472h12m51.100484056s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608678493 (472h12m51.101110944s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.609893324 (472h12m51.102325779s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.610954207 (472h12m51.103386656s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611458361 (472h12m51.103890813s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611966832 (472h12m51.104399283s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.615074539 (472h12m51.107506985s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.617371261 (472h12m51.109803715s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.618213880 (472h12m51.110646334s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.619133336 (472h12m51.111565791s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:31.285536041 (472h12m51.77796849s) [upload=415363]: Next returned nil segment Sep 18 06:20:31.285571077 (472h12m51.778003528s) [upload=415363]: Waiting for error group managing segments... Sep 18 06:20:31.397318156 (472h12m51.889750585s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.409603457 (472h12m51.902035902s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.412562303 (472h12m51.904994735s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:21:00.171009301 (472h13m20.663441758s) [noise=true , address=45.91.116.12:4226 , piece_id=7NKKWSTZ3WTW4NA7VTRWSSPSNBLXW3NJBOCEDT34NKYSGVD7UFCA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:54302->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.171668056 (472h13m20.664100511s) [noise=true , address=45.91.116.10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: read tcp 139.59.144.22:37718->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172033515 (472h13m20.664465965s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172061093 (472h13m20.664493549s) [noise=true , address=45.91.116.5:4297 , piece_id=4XPFFRMWOX6NW2ZB6AVJ2NZH2MPSQLW67SAMJFT7BCYOEQKL4SOA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172531910 (472h13m20.664964367s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172634427 (472h13m20.665066857s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:37268->45.91.116.7:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172651500 (472h13m20.66508395s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 139.59.144.22:45276->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172708335 (472h13m20.665140789s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 139.59.144.22:59692->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172770932 (472h13m20.665203365s) [noise=true , address=45.91.116.4:4939 , piece_id=IQCTRATIFNKF7YEGNYP52PUXCMT2N23AFVSX37BBW42IK6MXTBXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 139.59.144.22:43042->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172832116 (472h13m20.665264567s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 139.59.144.22:49606->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172871254 (472h13m20.665303689s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 139.59.144.22:55146->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172885844 (472h13m20.665318284s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: read tcp 139.59.144.22:59448->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172898443 (472h13m20.665330883s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 139.59.144.22:55382->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172972913 (472h13m20.665405371s) [seg_pos={0 0}, upload=415363]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 18 06:21:00.285796348 (472h13m20.778228783s) [upload=415363]: Done uploading segments... Sep 18 06:21:00.285852252 (472h13m20.778284705s) [upload=415363]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 2.683745662s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 3.009876683s FAIL (2025-09-18 07:03:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.009904635s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.525441479s FAIL (2025-09-18 07:03:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606164283 (472h12m51.098596735s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606697593 (472h12m51.099130037s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608051611 (472h12m51.100484056s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608678493 (472h12m51.101110944s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.609893324 (472h12m51.102325779s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.610954207 (472h12m51.103386656s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611458361 (472h12m51.103890813s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611966832 (472h12m51.104399283s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.615074539 (472h12m51.107506985s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.617371261 (472h12m51.109803715s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.618213880 (472h12m51.110646334s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.619133336 (472h12m51.111565791s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:31.285536041 (472h12m51.77796849s) [upload=415363]: Next returned nil segment Sep 18 06:20:31.285571077 (472h12m51.778003528s) [upload=415363]: Waiting for error group managing segments... Sep 18 06:20:31.397318156 (472h12m51.889750585s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.409603457 (472h12m51.902035902s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.412562303 (472h12m51.904994735s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:21:00.171009301 (472h13m20.663441758s) [noise=true , address=45.91.116.12:4226 , piece_id=7NKKWSTZ3WTW4NA7VTRWSSPSNBLXW3NJBOCEDT34NKYSGVD7UFCA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:54302->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.171668056 (472h13m20.664100511s) [noise=true , address=45.91.116.10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: read tcp 139.59.144.22:37718->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172033515 (472h13m20.664465965s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172061093 (472h13m20.664493549s) [noise=true , address=45.91.116.5:4297 , piece_id=4XPFFRMWOX6NW2ZB6AVJ2NZH2MPSQLW67SAMJFT7BCYOEQKL4SOA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172531910 (472h13m20.664964367s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172634427 (472h13m20.665066857s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:37268->45.91.116.7:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172651500 (472h13m20.66508395s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 139.59.144.22:45276->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172708335 (472h13m20.665140789s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 139.59.144.22:59692->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172770932 (472h13m20.665203365s) [noise=true , address=45.91.116.4:4939 , piece_id=IQCTRATIFNKF7YEGNYP52PUXCMT2N23AFVSX37BBW42IK6MXTBXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 139.59.144.22:43042->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172832116 (472h13m20.665264567s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 139.59.144.22:49606->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172871254 (472h13m20.665303689s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 139.59.144.22:55146->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172885844 (472h13m20.665318284s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: read tcp 139.59.144.22:59448->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172898443 (472h13m20.665330883s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 139.59.144.22:55382->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172972913 (472h13m20.665405371s) [seg_pos={0 0}, upload=415363]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 18 06:21:00.285796348 (472h13m20.778228783s) [upload=415363]: Done uploading segments... Sep 18 06:21:00.285852252 (472h13m20.778284705s) [upload=415363]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 2.525492785s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 3.126276438s FAIL (2025-09-18 07:02:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.126369704s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.653937093s FAIL (2025-09-18 07:02:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606164283 (472h12m51.098596735s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606697593 (472h12m51.099130037s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608051611 (472h12m51.100484056s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608678493 (472h12m51.101110944s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.609893324 (472h12m51.102325779s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.610954207 (472h12m51.103386656s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611458361 (472h12m51.103890813s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611966832 (472h12m51.104399283s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.615074539 (472h12m51.107506985s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.617371261 (472h12m51.109803715s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.618213880 (472h12m51.110646334s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.619133336 (472h12m51.111565791s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:31.285536041 (472h12m51.77796849s) [upload=415363]: Next returned nil segment Sep 18 06:20:31.285571077 (472h12m51.778003528s) [upload=415363]: Waiting for error group managing segments... Sep 18 06:20:31.397318156 (472h12m51.889750585s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.409603457 (472h12m51.902035902s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.412562303 (472h12m51.904994735s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:21:00.171009301 (472h13m20.663441758s) [noise=true , address=45.91.116.12:4226 , piece_id=7NKKWSTZ3WTW4NA7VTRWSSPSNBLXW3NJBOCEDT34NKYSGVD7UFCA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:54302->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.171668056 (472h13m20.664100511s) [noise=true , address=45.91.116.10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: read tcp 139.59.144.22:37718->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172033515 (472h13m20.664465965s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172061093 (472h13m20.664493549s) [noise=true , address=45.91.116.5:4297 , piece_id=4XPFFRMWOX6NW2ZB6AVJ2NZH2MPSQLW67SAMJFT7BCYOEQKL4SOA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172531910 (472h13m20.664964367s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172634427 (472h13m20.665066857s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:37268->45.91.116.7:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172651500 (472h13m20.66508395s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 139.59.144.22:45276->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172708335 (472h13m20.665140789s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 139.59.144.22:59692->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172770932 (472h13m20.665203365s) [noise=true , address=45.91.116.4:4939 , piece_id=IQCTRATIFNKF7YEGNYP52PUXCMT2N23AFVSX37BBW42IK6MXTBXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 139.59.144.22:43042->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172832116 (472h13m20.665264567s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 139.59.144.22:49606->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172871254 (472h13m20.665303689s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 139.59.144.22:55146->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172885844 (472h13m20.665318284s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: read tcp 139.59.144.22:59448->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172898443 (472h13m20.665330883s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 139.59.144.22:55382->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172972913 (472h13m20.665405371s) [seg_pos={0 0}, upload=415363]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 18 06:21:00.285796348 (472h13m20.778228783s) [upload=415363]: Done uploading segments... Sep 18 06:21:00.285852252 (472h13m20.778284705s) [upload=415363]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 2.653977263s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.73155758s FAIL (2025-09-18 07:01:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606164283 (472h12m51.098596735s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606697593 (472h12m51.099130037s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608051611 (472h12m51.100484056s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608678493 (472h12m51.101110944s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.609893324 (472h12m51.102325779s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.610954207 (472h12m51.103386656s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611458361 (472h12m51.103890813s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611966832 (472h12m51.104399283s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.615074539 (472h12m51.107506985s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.617371261 (472h12m51.109803715s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.618213880 (472h12m51.110646334s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.619133336 (472h12m51.111565791s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:31.285536041 (472h12m51.77796849s) [upload=415363]: Next returned nil segment Sep 18 06:20:31.285571077 (472h12m51.778003528s) [upload=415363]: Waiting for error group managing segments... Sep 18 06:20:31.397318156 (472h12m51.889750585s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.409603457 (472h12m51.902035902s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.412562303 (472h12m51.904994735s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:21:00.171009301 (472h13m20.663441758s) [noise=true , address=45.91.116.12:4226 , piece_id=7NKKWSTZ3WTW4NA7VTRWSSPSNBLXW3NJBOCEDT34NKYSGVD7UFCA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:54302->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.171668056 (472h13m20.664100511s) [noise=true , address=45.91.116.10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: read tcp 139.59.144.22:37718->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172033515 (472h13m20.664465965s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172061093 (472h13m20.664493549s) [noise=true , address=45.91.116.5:4297 , piece_id=4XPFFRMWOX6NW2ZB6AVJ2NZH2MPSQLW67SAMJFT7BCYOEQKL4SOA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172531910 (472h13m20.664964367s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172634427 (472h13m20.665066857s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:37268->45.91.116.7:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172651500 (472h13m20.66508395s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 139.59.144.22:45276->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172708335 (472h13m20.665140789s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 139.59.144.22:59692->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172770932 (472h13m20.665203365s) [noise=true , address=45.91.116.4:4939 , piece_id=IQCTRATIFNKF7YEGNYP52PUXCMT2N23AFVSX37BBW42IK6MXTBXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 139.59.144.22:43042->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172832116 (472h13m20.665264567s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 139.59.144.22:49606->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172871254 (472h13m20.665303689s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 139.59.144.22:55146->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172885844 (472h13m20.665318284s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: read tcp 139.59.144.22:59448->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172898443 (472h13m20.665330883s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 139.59.144.22:55382->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172972913 (472h13m20.665405371s) [seg_pos={0 0}, upload=415363]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 18 06:21:00.285796348 (472h13m20.778228783s) [upload=415363]: Done uploading segments... Sep 18 06:21:00.285852252 (472h13m20.778284705s) [upload=415363]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 2.731600411s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.861269761s FAIL (2025-09-18 07:01:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.861327647s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.633047332s FAIL (2025-09-18 07:01:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606164283 (472h12m51.098596735s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606697593 (472h12m51.099130037s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608051611 (472h12m51.100484056s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608678493 (472h12m51.101110944s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.609893324 (472h12m51.102325779s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.610954207 (472h12m51.103386656s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611458361 (472h12m51.103890813s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611966832 (472h12m51.104399283s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.615074539 (472h12m51.107506985s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.617371261 (472h12m51.109803715s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.618213880 (472h12m51.110646334s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.619133336 (472h12m51.111565791s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:31.285536041 (472h12m51.77796849s) [upload=415363]: Next returned nil segment Sep 18 06:20:31.285571077 (472h12m51.778003528s) [upload=415363]: Waiting for error group managing segments... Sep 18 06:20:31.397318156 (472h12m51.889750585s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.409603457 (472h12m51.902035902s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.412562303 (472h12m51.904994735s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:21:00.171009301 (472h13m20.663441758s) [noise=true , address=45.91.116.12:4226 , piece_id=7NKKWSTZ3WTW4NA7VTRWSSPSNBLXW3NJBOCEDT34NKYSGVD7UFCA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:54302->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.171668056 (472h13m20.664100511s) [noise=true , address=45.91.116.10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: read tcp 139.59.144.22:37718->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172033515 (472h13m20.664465965s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172061093 (472h13m20.664493549s) [noise=true , address=45.91.116.5:4297 , piece_id=4XPFFRMWOX6NW2ZB6AVJ2NZH2MPSQLW67SAMJFT7BCYOEQKL4SOA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172531910 (472h13m20.664964367s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172634427 (472h13m20.665066857s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:37268->45.91.116.7:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172651500 (472h13m20.66508395s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 139.59.144.22:45276->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172708335 (472h13m20.665140789s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 139.59.144.22:59692->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172770932 (472h13m20.665203365s) [noise=true , address=45.91.116.4:4939 , piece_id=IQCTRATIFNKF7YEGNYP52PUXCMT2N23AFVSX37BBW42IK6MXTBXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 139.59.144.22:43042->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172832116 (472h13m20.665264567s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 139.59.144.22:49606->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172871254 (472h13m20.665303689s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 139.59.144.22:55146->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172885844 (472h13m20.665318284s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: read tcp 139.59.144.22:59448->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172898443 (472h13m20.665330883s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 139.59.144.22:55382->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172972913 (472h13m20.665405371s) [seg_pos={0 0}, upload=415363]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 18 06:21:00.285796348 (472h13m20.778228783s) [upload=415363]: Done uploading segments... Sep 18 06:21:00.285852252 (472h13m20.778284705s) [upload=415363]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 2.633092898s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.621483s FAIL (2025-09-18 07:00:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606164283 (472h12m51.098596735s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606697593 (472h12m51.099130037s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608051611 (472h12m51.100484056s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608678493 (472h12m51.101110944s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.609893324 (472h12m51.102325779s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.610954207 (472h12m51.103386656s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611458361 (472h12m51.103890813s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611966832 (472h12m51.104399283s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.615074539 (472h12m51.107506985s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.617371261 (472h12m51.109803715s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.618213880 (472h12m51.110646334s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.619133336 (472h12m51.111565791s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:31.285536041 (472h12m51.77796849s) [upload=415363]: Next returned nil segment Sep 18 06:20:31.285571077 (472h12m51.778003528s) [upload=415363]: Waiting for error group managing segments... Sep 18 06:20:31.397318156 (472h12m51.889750585s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.409603457 (472h12m51.902035902s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.412562303 (472h12m51.904994735s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:21:00.171009301 (472h13m20.663441758s) [noise=true , address=45.91.116.12:4226 , piece_id=7NKKWSTZ3WTW4NA7VTRWSSPSNBLXW3NJBOCEDT34NKYSGVD7UFCA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:54302->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.171668056 (472h13m20.664100511s) [noise=true , address=45.91.116.10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: read tcp 139.59.144.22:37718->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172033515 (472h13m20.664465965s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172061093 (472h13m20.664493549s) [noise=true , address=45.91.116.5:4297 , piece_id=4XPFFRMWOX6NW2ZB6AVJ2NZH2MPSQLW67SAMJFT7BCYOEQKL4SOA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172531910 (472h13m20.664964367s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172634427 (472h13m20.665066857s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:37268->45.91.116.7:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172651500 (472h13m20.66508395s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 139.59.144.22:45276->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172708335 (472h13m20.665140789s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 139.59.144.22:59692->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172770932 (472h13m20.665203365s) [noise=true , address=45.91.116.4:4939 , piece_id=IQCTRATIFNKF7YEGNYP52PUXCMT2N23AFVSX37BBW42IK6MXTBXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 139.59.144.22:43042->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172832116 (472h13m20.665264567s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 139.59.144.22:49606->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172871254 (472h13m20.665303689s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 139.59.144.22:55146->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172885844 (472h13m20.665318284s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: read tcp 139.59.144.22:59448->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172898443 (472h13m20.665330883s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 139.59.144.22:55382->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172972913 (472h13m20.665405371s) [seg_pos={0 0}, upload=415363]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 18 06:21:00.285796348 (472h13m20.778228783s) [upload=415363]: Done uploading segments... Sep 18 06:21:00.285852252 (472h13m20.778284705s) [upload=415363]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 2.621518607s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 3.27808922s FAIL (2025-09-18 07:00:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.278192335s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.913981293s FAIL (2025-09-18 07:00:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.914016858s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.787703s FAIL (2025-09-18 06:59:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.787752637s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.944557663s FAIL (2025-09-18 06:59:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.944606941s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.651299566s FAIL (2025-09-18 06:59:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606164283 (472h12m51.098596735s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606697593 (472h12m51.099130037s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608051611 (472h12m51.100484056s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608678493 (472h12m51.101110944s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.609893324 (472h12m51.102325779s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.610954207 (472h12m51.103386656s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611458361 (472h12m51.103890813s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611966832 (472h12m51.104399283s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.615074539 (472h12m51.107506985s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.617371261 (472h12m51.109803715s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.618213880 (472h12m51.110646334s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.619133336 (472h12m51.111565791s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:31.285536041 (472h12m51.77796849s) [upload=415363]: Next returned nil segment Sep 18 06:20:31.285571077 (472h12m51.778003528s) [upload=415363]: Waiting for error group managing segments... Sep 18 06:20:31.397318156 (472h12m51.889750585s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.409603457 (472h12m51.902035902s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.412562303 (472h12m51.904994735s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:21:00.171009301 (472h13m20.663441758s) [noise=true , address=45.91.116.12:4226 , piece_id=7NKKWSTZ3WTW4NA7VTRWSSPSNBLXW3NJBOCEDT34NKYSGVD7UFCA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:54302->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.171668056 (472h13m20.664100511s) [noise=true , address=45.91.116.10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: read tcp 139.59.144.22:37718->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172033515 (472h13m20.664465965s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172061093 (472h13m20.664493549s) [noise=true , address=45.91.116.5:4297 , piece_id=4XPFFRMWOX6NW2ZB6AVJ2NZH2MPSQLW67SAMJFT7BCYOEQKL4SOA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172531910 (472h13m20.664964367s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172634427 (472h13m20.665066857s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:37268->45.91.116.7:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172651500 (472h13m20.66508395s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 139.59.144.22:45276->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172708335 (472h13m20.665140789s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 139.59.144.22:59692->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172770932 (472h13m20.665203365s) [noise=true , address=45.91.116.4:4939 , piece_id=IQCTRATIFNKF7YEGNYP52PUXCMT2N23AFVSX37BBW42IK6MXTBXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 139.59.144.22:43042->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172832116 (472h13m20.665264567s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 139.59.144.22:49606->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172871254 (472h13m20.665303689s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 139.59.144.22:55146->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172885844 (472h13m20.665318284s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: read tcp 139.59.144.22:59448->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172898443 (472h13m20.665330883s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 139.59.144.22:55382->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172972913 (472h13m20.665405371s) [seg_pos={0 0}, upload=415363]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 18 06:21:00.285796348 (472h13m20.778228783s) [upload=415363]: Done uploading segments... Sep 18 06:21:00.285852252 (472h13m20.778284705s) [upload=415363]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 2.65133919s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.747147725s FAIL (2025-09-18 06:59:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.747192649s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.706404977s FAIL (2025-09-18 06:58:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.706431468s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.688836219s FAIL (2025-09-18 06:58:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.688863157s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.891966466s FAIL (2025-09-18 06:58:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606164283 (472h12m51.098596735s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606697593 (472h12m51.099130037s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608051611 (472h12m51.100484056s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608678493 (472h12m51.101110944s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.609893324 (472h12m51.102325779s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.610954207 (472h12m51.103386656s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611458361 (472h12m51.103890813s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611966832 (472h12m51.104399283s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.615074539 (472h12m51.107506985s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.617371261 (472h12m51.109803715s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.618213880 (472h12m51.110646334s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.619133336 (472h12m51.111565791s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:31.285536041 (472h12m51.77796849s) [upload=415363]: Next returned nil segment Sep 18 06:20:31.285571077 (472h12m51.778003528s) [upload=415363]: Waiting for error group managing segments... Sep 18 06:20:31.397318156 (472h12m51.889750585s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.409603457 (472h12m51.902035902s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.412562303 (472h12m51.904994735s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:21:00.171009301 (472h13m20.663441758s) [noise=true , address=45.91.116.12:4226 , piece_id=7NKKWSTZ3WTW4NA7VTRWSSPSNBLXW3NJBOCEDT34NKYSGVD7UFCA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:54302->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.171668056 (472h13m20.664100511s) [noise=true , address=45.91.116.10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: read tcp 139.59.144.22:37718->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172033515 (472h13m20.664465965s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172061093 (472h13m20.664493549s) [noise=true , address=45.91.116.5:4297 , piece_id=4XPFFRMWOX6NW2ZB6AVJ2NZH2MPSQLW67SAMJFT7BCYOEQKL4SOA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172531910 (472h13m20.664964367s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172634427 (472h13m20.665066857s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:37268->45.91.116.7:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172651500 (472h13m20.66508395s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 139.59.144.22:45276->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172708335 (472h13m20.665140789s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 139.59.144.22:59692->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172770932 (472h13m20.665203365s) [noise=true , address=45.91.116.4:4939 , piece_id=IQCTRATIFNKF7YEGNYP52PUXCMT2N23AFVSX37BBW42IK6MXTBXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 139.59.144.22:43042->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172832116 (472h13m20.665264567s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 139.59.144.22:49606->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172871254 (472h13m20.665303689s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 139.59.144.22:55146->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172885844 (472h13m20.665318284s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: read tcp 139.59.144.22:59448->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172898443 (472h13m20.665330883s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 139.59.144.22:55382->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172972913 (472h13m20.665405371s) [seg_pos={0 0}, upload=415363]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 18 06:21:00.285796348 (472h13m20.778228783s) [upload=415363]: Done uploading segments... Sep 18 06:21:00.285852252 (472h13m20.778284705s) [upload=415363]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 2.892007937s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 3.083832878s FAIL (2025-09-18 06:58:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.083869519s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.415640922s FAIL (2025-09-18 06:57:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606164283 (472h12m51.098596735s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606697593 (472h12m51.099130037s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608051611 (472h12m51.100484056s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608678493 (472h12m51.101110944s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.609893324 (472h12m51.102325779s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.610954207 (472h12m51.103386656s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611458361 (472h12m51.103890813s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611966832 (472h12m51.104399283s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.615074539 (472h12m51.107506985s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.617371261 (472h12m51.109803715s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.618213880 (472h12m51.110646334s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.619133336 (472h12m51.111565791s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:31.285536041 (472h12m51.77796849s) [upload=415363]: Next returned nil segment Sep 18 06:20:31.285571077 (472h12m51.778003528s) [upload=415363]: Waiting for error group managing segments... Sep 18 06:20:31.397318156 (472h12m51.889750585s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.409603457 (472h12m51.902035902s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.412562303 (472h12m51.904994735s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:21:00.171009301 (472h13m20.663441758s) [noise=true , address=45.91.116.12:4226 , piece_id=7NKKWSTZ3WTW4NA7VTRWSSPSNBLXW3NJBOCEDT34NKYSGVD7UFCA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:54302->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.171668056 (472h13m20.664100511s) [noise=true , address=45.91.116.10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: read tcp 139.59.144.22:37718->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172033515 (472h13m20.664465965s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172061093 (472h13m20.664493549s) [noise=true , address=45.91.116.5:4297 , piece_id=4XPFFRMWOX6NW2ZB6AVJ2NZH2MPSQLW67SAMJFT7BCYOEQKL4SOA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172531910 (472h13m20.664964367s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172634427 (472h13m20.665066857s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:37268->45.91.116.7:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172651500 (472h13m20.66508395s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 139.59.144.22:45276->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172708335 (472h13m20.665140789s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 139.59.144.22:59692->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172770932 (472h13m20.665203365s) [noise=true , address=45.91.116.4:4939 , piece_id=IQCTRATIFNKF7YEGNYP52PUXCMT2N23AFVSX37BBW42IK6MXTBXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 139.59.144.22:43042->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172832116 (472h13m20.665264567s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 139.59.144.22:49606->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172871254 (472h13m20.665303689s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 139.59.144.22:55146->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172885844 (472h13m20.665318284s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: read tcp 139.59.144.22:59448->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172898443 (472h13m20.665330883s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 139.59.144.22:55382->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172972913 (472h13m20.665405371s) [seg_pos={0 0}, upload=415363]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 18 06:21:00.285796348 (472h13m20.778228783s) [upload=415363]: Done uploading segments... Sep 18 06:21:00.285852252 (472h13m20.778284705s) [upload=415363]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 2.415678922s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 3.032348769s FAIL (2025-09-18 06:57:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.032383853s edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)