Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.529254317s FAIL (2025-09-30 22:02:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.529285576s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.661395662s FAIL (2025-09-30 22:02:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.66142462s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.499102897s FAIL (2025-09-30 22:02:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.499141156s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.754613311s FAIL (2025-09-30 22:00:46 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.754646536s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.57906118s FAIL (2025-09-30 22:00:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.579100315s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.615058834s FAIL (2025-09-30 21:59:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.615087899s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.491570131s FAIL (2025-09-30 21:59:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.491611926s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.499232576s FAIL (2025-09-30 21:58:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.499283439s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.496107777s FAIL (2025-09-30 21:57:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.496135675s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.645505459s FAIL (2025-09-30 21:57:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.645534514s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.396911042s FAIL (2025-09-30 21:56:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.396941315s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.558514186s FAIL (2025-09-30 21:56:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.558549994s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.551286295s FAIL (2025-09-30 21:55:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.551319807s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.644267472s FAIL (2025-09-30 21:54:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.644299622s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.624739884s FAIL (2025-09-30 21:53:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.624885819s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.621903169s FAIL (2025-09-30 21:53:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.62197869s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.639117115s FAIL (2025-09-30 21:52:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.63922201s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.517671301s FAIL (2025-09-30 21:51:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.51770127s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.496602428s FAIL (2025-09-30 21:50:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.496634188s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.444473409s FAIL (2025-09-30 21:49:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.444496612s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.600604015s FAIL (2025-09-30 21:48:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.600637061s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.385182957s FAIL (2025-09-30 21:47:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.385217421s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.776805096s FAIL (2025-09-30 21:46:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.776839955s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.568787628s FAIL (2025-09-30 21:45:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.568823491s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.413069095s FAIL (2025-09-30 21:44:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.413106406s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.391944049s FAIL (2025-09-30 21:43:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.391979847s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.487273835s FAIL (2025-09-30 21:43:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.487364003s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.481479004s FAIL (2025-09-30 21:42:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.48150987s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.534622152s FAIL (2025-09-30 21:42:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.534737852s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.394620061s FAIL (2025-09-30 21:41:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.394654408s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.625247347s FAIL (2025-09-30 21:40:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.625282155s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.449988231s FAIL (2025-09-30 21:39:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.450411225s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.550652984s FAIL (2025-09-30 21:38:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.550682599s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.478618223s FAIL (2025-09-30 21:37:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.478654731s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.436368757s FAIL (2025-09-30 21:36:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.436404039s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.49377888s FAIL (2025-09-30 21:35:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.493819439s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.601263539s FAIL (2025-09-30 21:35:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.60129807s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.620557657s FAIL (2025-09-30 21:33:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.62058366s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.409520398s FAIL (2025-09-30 21:32:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.409554388s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.327439428s FAIL (2025-09-30 21:32:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.327472427s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.536286575s FAIL (2025-09-30 21:31:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.536337386s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.457028692s FAIL (2025-09-30 21:30:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 2.457057898s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 19.280662029s FAIL (2025-09-30 21:30:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 19.280683681s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.003917139s FAIL (2025-09-30 21:29:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 30 21:29:22.797897319 (175h59m10.601361902s) [upload=154939]: Starting upload Sep 30 21:29:22.798006215 (175h59m10.601470808s) [upload=154939]: Done starting upload Sep 30 21:29:22.798081644 (175h59m10.601546229s) [upload=154939]: Uploading segments... Sep 30 21:29:22.798290989 (175h59m10.60175557s) [upload=154939]: Got next segment. Inline: false Sep 30 21:29:22.798331474 (175h59m10.601796067s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 30 21:29:22.798339902 (175h59m10.601804489s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 30 21:29:22.915769149 (175h59m10.719233752s) [seg_pos={0 0}, upload=154939]: Begin upload segment... Sep 30 21:29:22.915871743 (175h59m10.719336336s) [seg_pos={0 0}, upload=154939]: Done begin upload segment. Sep 30 21:29:22.915919849 (175h59m10.719384451s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917360095 (175h59m10.720824697s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.917523118 (175h59m10.720987717s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918065655 (175h59m10.721530259s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918188240 (175h59m10.721652839s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918605397 (175h59m10.722069997s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.918717812 (175h59m10.722182405s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919113523 (175h59m10.722578125s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919331578 (175h59m10.722796181s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.919626618 (175h59m10.72309122s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920025044 (175h59m10.723489653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920253240 (175h59m10.723717844s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.920729685 (175h59m10.724194286s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.921315566 (175h59m10.724780168s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923000023 (175h59m10.726464628s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:22.923798468 (175h59m10.727263073s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Uploading piece... Sep 30 21:29:23.539151225 (175h59m11.342615808s) [upload=154939]: Next returned nil segment Sep 30 21:29:23.539169161 (175h59m11.34263376s) [upload=154939]: Waiting for error group managing segments... Sep 30 21:29:23.685441552 (175h59m11.488906147s) [noise=true , address=45.91.116.4:4940 , piece_id=7DW6Y2G3IUR74PJ2ENFV6XLGTBZTISG4BQFI53KSUJ7HUMYIOSTA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.688251132 (175h59m11.491715718s) [noise=true , address=145.79.227.7:4295 , piece_id=VLXVHJOSXZ627O6VCWPEL3H3QPLLSK7OZWGRCSRRT3MIPJDB5YBQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.691906915 (175h59m11.495371495s) [noise=true , address=145.79.227.16:4910 , piece_id=TBS644O7MTLBU7635SRB2N46WHQK6X5KYRYVITTZZAUFPEKC7GDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698112841 (175h59m11.501577422s) [noise=true , address=145.79.227.6:4257 , piece_id=5YAEQS2PX6L4EXAKWT33WBMWXFRFDKTFKV7CBCPLO4BYCZKKA53A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.698258894 (175h59m11.501723478s) [noise=true , address=145.79.227.2:4114 , piece_id=V2U5JQ6Y5XJOQSXE6EKKQOA7F3ENKEKWTFOQ65LZV6BBRSK6YD5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.702276005 (175h59m11.505740586s) [noise=true , address=45.91.116.10:4081 , piece_id=WJKNHHM37DDABHFA6LPCF35FUW4SEMNMINZTPXDMJULW7TAL22OQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.707342122 (175h59m11.51080671s) [noise=true , address=145.79.227.13:4802 , piece_id=Y5SXFQYQF32UFPHKIMIMI3V7WYDHGSZCPONZTZS5EVVKYSPSQONA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.711442145 (175h59m11.51490673s) [noise=true , address=145.79.227.11:4731 , piece_id=EDPUPZOFFO7TQWD7MI5MYMZSDONWB22VGCMZBZPMZA5MB3LOWXAA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.719319539 (175h59m11.522784123s) [noise=true , address=145.79.227.3:4151 , piece_id=LOVPJ4STVGHTGVOBIS5IMXQDUT7QNS55EFEDPZKD65WLBKTEO3OA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:23.988493881 (175h59m11.791958458s) [noise=true , address=45.91.116.5:4298 , piece_id=DUBHMFQQHF23TXRYMRODBVKGVCLAE6TG7IPEKTBHUE72WEX5O2SA, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.038956565 (175h59m11.842421143s) [noise=true , address=45.91.116.10:4082 , piece_id=UWRIMN2P47HUKBYHCATAARGFTJXFGQZ7KRV5MUMIQ4GQRFQO7D6Q, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:24.589378044 (175h59m12.392842628s) [noise=true , address=145.79.227.18:4005 , piece_id=IYY76ITHCMY4Z22VRD7WRX3Y6BDVLFKOQ2PCQRU7WFBE6VDQKV5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194244661 (175h59m12.99770926s) [noise=true , address=145.79.227.13:4801 , piece_id=2W5CLWLLIUYIFCFUW7BBO5MGURJ6YBUNAQDVJCJ2F2LSVX3SLI5A, seg_pos={0 0}, upload=154939]: Done uploading piece. err: <nil> Sep 30 21:29:25.194299398 (175h59m12.997763991s) [seg_pos={0 0}, upload=154939]: Segment reached optimal threshold of 13 pieces. Sep 30 21:29:25.194653994 (175h59m12.99811859s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: read tcp 139.59.144.22:34818->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194670346 (175h59m12.998134947s) [noise=true , address=145.79.227.19:4077 , piece_id=RXBHUITPAT44CYFM7EERUMQ6VZXJH5POUVI7Z2LFHQ3CR57UINDQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194691442 (175h59m12.99815604s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: read tcp 139.59.144.22:59584->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 30 21:29:25.194706378 (175h59m12.998170983s) [noise=true , address=77.90.31.17:4770 , piece_id=HP4IPR5XEHIHHPYLVTXLDKBMS6KBQY7A6YWVTAV2BMHMSUYI4CAQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194911052 (175h59m12.998375653s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: context canceled; context canceled Sep 30 21:29:25.194921667 (175h59m12.998386269s) [noise=true , address=145.79.227.16:4912 , piece_id=3YQRDFPWCLI52GJIOYFBWSH2CWKIJW3I2C4S3Q27EJQHXHZT7BHQ, seg_pos={0 0}, upload=154939]: Long tail cancellation due to optimal threshold Sep 30 21:29:25.194946997 (175h59m12.998411575s) [seg_pos={0 0}, upload=154939]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 30 21:29:25.195081879 (175h59m12.998546481s) [upload=154939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 30 21:29:25.195089364 (175h59m12.998553965s) [upload=154939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 30 21:29:25.348637798 (175h59m13.1521024s) [upload=154939]: Done uploading segments... Sep 30 21:29:25.348680254 (175h59m13.152144854s) [upload=154939]: Upload finished. err: <nil> Duration: 30.00394808s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.891579249s FAIL (2025-09-30 09:32:04 UTC) orbiter warning: read tcp 139.59.144.22:58130->45.38.24.2:443: read: connection reset by peer Duration: 2.891663949s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.687943375s FAIL (2025-09-30 09:31:32 UTC) orbiter warning: read tcp 139.59.144.22:58130->45.38.24.2:443: read: connection reset by peer Duration: 2.687975353s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.490864157s FAIL (2025-09-30 09:31:13 UTC) orbiter warning: read tcp 139.59.144.22:58130->45.38.24.2:443: read: connection reset by peer Duration: 2.490890286s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.690948435s FAIL (2025-09-30 09:30:47 UTC) orbiter warning: read tcp 139.59.144.22:58130->45.38.24.2:443: read: connection reset by peer Duration: 2.69104017s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.613187358s FAIL (2025-09-30 09:30:00 UTC) orbiter warning: read tcp 139.59.144.22:58130->45.38.24.2:443: read: connection reset by peer Duration: 2.613224623s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.847563045s FAIL (2025-09-30 09:29:44 UTC) orbiter warning: read tcp 139.59.144.22:58130->45.38.24.2:443: read: connection reset by peer Duration: 2.847592521s edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)