Orbiter History

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [...X...........] duration: 211.297939ms remote: "tcp:35.152.117.67:443" response headers: Date=Sat, 27 Sep 2025 21:11:58 GMT Content-Type=text/html Content-Length=154 Cf-Cache-Status=BYPASS Cache-Control=private Vary=Accept-Encoding Cf-Ray=985dff1d5cba1575-MXP Set-Cookie=_cfuvid=5lOU9hweyVCfnO0eH.vpAJXvHHUYCMS8R3m42kTCtF4-1759007518451-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=eu-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-09-27 21:19:05 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "<html>\r\n<head><title>502 Bad Gateway</title></head>\r\n<body>\r\n<center><h1>502 Bad Gateway</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 211.326719ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [....X..........] duration: 197.159303ms remote: "tcp:35.152.117.67:443" response headers: Date=Sat, 27 Sep 2025 21:11:58 GMT Content-Type=text/html Content-Length=154 Cf-Cache-Status=BYPASS Cache-Control=private Vary=Accept-Encoding Cf-Ray=985dff1d5cba1575-MXP Set-Cookie=_cfuvid=5lOU9hweyVCfnO0eH.vpAJXvHHUYCMS8R3m42kTCtF4-1759007518451-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=eu-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-09-27 21:18:49 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "<html>\r\n<head><title>502 Bad Gateway</title></head>\r\n<body>\r\n<center><h1>502 Bad Gateway</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 197.191799ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.....X.........] duration: 208.135091ms remote: "tcp:35.152.117.67:443" response headers: Date=Sat, 27 Sep 2025 21:11:58 GMT Content-Type=text/html Content-Length=154 Cf-Cache-Status=BYPASS Cache-Control=private Vary=Accept-Encoding Cf-Ray=985dff1d5cba1575-MXP Set-Cookie=_cfuvid=5lOU9hweyVCfnO0eH.vpAJXvHHUYCMS8R3m42kTCtF4-1759007518451-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=eu-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-09-27 21:18:07 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "<html>\r\n<head><title>502 Bad Gateway</title></head>\r\n<body>\r\n<center><h1>502 Bad Gateway</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 208.165633ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [......X........] duration: 223.101986ms remote: "tcp:35.152.117.67:443" response headers: Date=Sat, 27 Sep 2025 21:11:58 GMT Content-Type=text/html Content-Length=154 Cf-Cache-Status=BYPASS Cache-Control=private Vary=Accept-Encoding Cf-Ray=985dff1d5cba1575-MXP Set-Cookie=_cfuvid=5lOU9hweyVCfnO0eH.vpAJXvHHUYCMS8R3m42kTCtF4-1759007518451-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=eu-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-09-27 21:17:36 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "<html>\r\n<head><title>502 Bad Gateway</title></head>\r\n<body>\r\n<center><h1>502 Bad Gateway</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 223.13756ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.......X.......] duration: 195.151343ms remote: "tcp:35.152.117.67:443" response headers: Date=Sat, 27 Sep 2025 21:11:58 GMT Content-Type=text/html Content-Length=154 Cf-Cache-Status=BYPASS Cache-Control=private Vary=Accept-Encoding Cf-Ray=985dff1d5cba1575-MXP Set-Cookie=_cfuvid=5lOU9hweyVCfnO0eH.vpAJXvHHUYCMS8R3m42kTCtF4-1759007518451-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=eu-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-09-27 21:17:07 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "<html>\r\n<head><title>502 Bad Gateway</title></head>\r\n<body>\r\n<center><h1>502 Bad Gateway</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 195.17393ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [........X......] duration: 192.695916ms remote: "tcp:35.152.117.67:443" response headers: Date=Sat, 27 Sep 2025 21:11:58 GMT Content-Type=text/html Content-Length=154 Cf-Cache-Status=BYPASS Cache-Control=private Vary=Accept-Encoding Cf-Ray=985dff1d5cba1575-MXP Set-Cookie=_cfuvid=5lOU9hweyVCfnO0eH.vpAJXvHHUYCMS8R3m42kTCtF4-1759007518451-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=eu-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-09-27 21:15:52 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "<html>\r\n<head><title>502 Bad Gateway</title></head>\r\n<body>\r\n<center><h1>502 Bad Gateway</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 192.737826ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.........X.....] duration: 212.636454ms remote: "tcp:35.152.117.67:443" response headers: Date=Sat, 27 Sep 2025 21:11:58 GMT Content-Type=text/html Content-Length=154 Cf-Cache-Status=BYPASS Cache-Control=private Vary=Accept-Encoding Cf-Ray=985dff1d5cba1575-MXP Set-Cookie=_cfuvid=5lOU9hweyVCfnO0eH.vpAJXvHHUYCMS8R3m42kTCtF4-1759007518451-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=eu-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-09-27 21:15:20 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "<html>\r\n<head><title>502 Bad Gateway</title></head>\r\n<body>\r\n<center><h1>502 Bad Gateway</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 212.668936ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [..........X....] duration: 217.304041ms remote: "tcp:35.152.117.67:443" response headers: Date=Sat, 27 Sep 2025 21:11:58 GMT Content-Type=text/html Content-Length=154 Cf-Cache-Status=BYPASS Cache-Control=private Vary=Accept-Encoding Cf-Ray=985dff1d5cba1575-MXP Set-Cookie=_cfuvid=5lOU9hweyVCfnO0eH.vpAJXvHHUYCMS8R3m42kTCtF4-1759007518451-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=eu-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-09-27 21:14:56 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "<html>\r\n<head><title>502 Bad Gateway</title></head>\r\n<body>\r\n<center><h1>502 Bad Gateway</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 217.342741ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [...........X...] duration: 204.312721ms remote: "tcp:35.152.117.67:443" response headers: Date=Sat, 27 Sep 2025 21:11:58 GMT Content-Type=text/html Content-Length=154 Cf-Cache-Status=BYPASS Cache-Control=private Vary=Accept-Encoding Cf-Ray=985dff1d5cba1575-MXP Set-Cookie=_cfuvid=5lOU9hweyVCfnO0eH.vpAJXvHHUYCMS8R3m42kTCtF4-1759007518451-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=eu-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-09-27 21:14:12 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "<html>\r\n<head><title>502 Bad Gateway</title></head>\r\n<body>\r\n<center><h1>502 Bad Gateway</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 204.343928ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [............X..] duration: 186.753032ms remote: "tcp:35.152.117.67:443" response headers: Date=Sat, 27 Sep 2025 21:11:58 GMT Content-Type=text/html Content-Length=154 Cf-Cache-Status=BYPASS Cache-Control=private Vary=Accept-Encoding Cf-Ray=985dff1d5cba1575-MXP Set-Cookie=_cfuvid=5lOU9hweyVCfnO0eH.vpAJXvHHUYCMS8R3m42kTCtF4-1759007518451-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=eu-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-09-27 21:13:38 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "<html>\r\n<head><title>502 Bad Gateway</title></head>\r\n<body>\r\n<center><h1>502 Bad Gateway</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 186.82543ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.............X.] duration: 202.628028ms remote: "tcp:35.152.117.67:443" response headers: Date=Sat, 27 Sep 2025 21:11:58 GMT Content-Type=text/html Content-Length=154 Cf-Cache-Status=BYPASS Cache-Control=private Vary=Accept-Encoding Cf-Ray=985dff1d5cba1575-MXP Set-Cookie=_cfuvid=5lOU9hweyVCfnO0eH.vpAJXvHHUYCMS8R3m42kTCtF4-1759007518451-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=eu-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-09-27 21:12:28 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "<html>\r\n<head><title>502 Bad Gateway</title></head>\r\n<body>\r\n<center><h1>502 Bad Gateway</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 202.673574ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [..............X] duration: 203.653056ms remote: "tcp:35.152.117.67:443" response headers: Date=Sat, 27 Sep 2025 21:11:58 GMT Content-Type=text/html Content-Length=154 Cf-Cache-Status=BYPASS Cache-Control=private Vary=Accept-Encoding Cf-Ray=985dff1d5cba1575-MXP Set-Cookie=_cfuvid=5lOU9hweyVCfnO0eH.vpAJXvHHUYCMS8R3m42kTCtF4-1759007518451-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=eu-south-1-prod-hosting-red target: https://www.storj.io/dcs-satellites FAIL (2025-09-27 21:11:58 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "<html>\r\n<head><title>502 Bad Gateway</title></head>\r\n<body>\r\n<center><h1>502 Bad Gateway</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n" Duration: 203.686362ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.593076956s FAIL (2025-09-27 06:28:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.593105835s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.405724705s FAIL (2025-09-27 06:27:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.405768417s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.549207051s FAIL (2025-09-27 06:27:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.549279731s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.44171613s FAIL (2025-09-27 06:26:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.441749736s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.564836603s FAIL (2025-09-27 06:26:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.564875824s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.332165234s FAIL (2025-09-27 06:25:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.332199468s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.568104295s FAIL (2025-09-27 06:24:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.568140182s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.446065923s FAIL (2025-09-27 06:24:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.446095246s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.600609078s FAIL (2025-09-27 06:23:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.600690271s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.625753485s FAIL (2025-09-27 06:23:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.62580901s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.540819089s FAIL (2025-09-27 06:22:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.540852177s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.465180378s FAIL (2025-09-27 06:21:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.465211679s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.430968217s FAIL (2025-09-27 06:21:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.43100168s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.409198644s FAIL (2025-09-27 06:20:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.409235009s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.491615887s FAIL (2025-09-27 06:19:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.491705176s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.445348546s FAIL (2025-09-27 06:18:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.445384119s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.638167684s FAIL (2025-09-27 06:17:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.63819892s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.384046656s FAIL (2025-09-27 06:17:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.384072541s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.500687037s FAIL (2025-09-27 06:16:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.500713845s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.443361962s FAIL (2025-09-27 06:15:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.443418647s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.580459663s FAIL (2025-09-27 06:15:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.580496936s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.538659945s FAIL (2025-09-27 06:14:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.538696007s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.42530987s FAIL (2025-09-27 06:14:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.425343175s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.346088723s FAIL (2025-09-27 06:12:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.346121048s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.564343932s FAIL (2025-09-27 06:12:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.564378364s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.43786939s FAIL (2025-09-27 06:11:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.437899677s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.474685974s FAIL (2025-09-27 06:10:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.474715613s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.602329538s FAIL (2025-09-27 06:10:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.602368145s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.452085791s FAIL (2025-09-27 06:09:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.45212003s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.444101474s FAIL (2025-09-27 06:07:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.444135156s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.441456524s FAIL (2025-09-27 06:07:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.441490109s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.532374097s FAIL (2025-09-27 06:06:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.532400715s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.711689689s FAIL (2025-09-27 06:05:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.711762615s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.4775927s FAIL (2025-09-27 06:04:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.477631179s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.458787581s FAIL (2025-09-27 06:03:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.458812603s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.443210824s FAIL (2025-09-27 06:02:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.443240339s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.446857865s FAIL (2025-09-27 06:01:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.446908002s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.582712899s FAIL (2025-09-27 06:01:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.543304456 (88h10m57.346769059s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544025349 (88h10m57.347489947s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544147406 (88h10m57.347612009s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544550705 (88h10m57.348015298s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544828495 (88h10m57.348293099s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.544973535 (88h10m57.348438139s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545455182 (88h10m57.348919773s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.545955137 (88h10m57.349419729s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546402706 (88h10m57.349867307s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.546861764 (88h10m57.350326368s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547646999 (88h10m57.3511116s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.547769226 (88h10m57.35123383s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548352171 (88h10m57.351816764s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.548766193 (88h10m57.352230787s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.549149819 (88h10m57.35261442s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.550265532 (88h10m57.353730126s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:09.551510554 (88h10m57.354975154s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Uploading piece... Sep 27 05:41:10.107038148 (88h10m57.91050275s) [upload=77507]: Next returned nil segment Sep 27 05:41:10.107063914 (88h10m57.910528517s) [upload=77507]: Waiting for error group managing segments... Sep 27 05:41:10.249539722 (88h10m58.053004306s) [noise=true , address=45.91.116.12:4246 , piece_id=R4XK6B7W6A3ZRDXQVY3G6ZPCBLQGPDD7CUHA2KXRHBXKC2EEOE6Q, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.252866595 (88h10m58.056331175s) [noise=true , address=77.90.31.10:4541 , piece_id=7DQEG6M4YENM3UQDIKNRRC4PUB2OTOVXAN4V4WC7MZUNHC6YBPLQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.253752544 (88h10m58.057217129s) [noise=true , address=77.90.31.15:4707 , piece_id=AKQ5THQBUBSLLS3ZUJ26VQDRPEA7LYXFF4MAF4PXOWOLVD2QWGCA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.254453322 (88h10m58.057917905s) [noise=true , address=45.91.116.5:4324 , piece_id=BLB2MDBKUQGVXWGJRVBH4J4WVLOCRN2OTTQ5PCNUDM7QZTQHMZGQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256234398 (88h10m58.059698986s) [noise=true , address=77.90.31.14:4680 , piece_id=PO3UURJNUCXUKPLU2UR72TF5R2MSE4DM6WWZGZZLDLFDFTMDOLVA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.256687454 (88h10m58.060152037s) [noise=true , address=45.91.116.8:4052 , piece_id=G3B6UT46TFXSPGXG5PUN3CSAJXUNNB2GY7WW2RNOHHHVPKJYNRWQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258113170 (88h10m58.061577766s) [noise=true , address=77.90.31.13:4625 , piece_id=5ZJ5YVD3MO3HJ6PUZMHQ7CTLKFSGY57QORE5RINKVFMX4TPY6RNA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.258673160 (88h10m58.062137745s) [noise=true , address=77.90.31.19:4857 , piece_id=IIHDIQ5JC53WYBKCNUMTSKWIQRAD7IDWTWQCWZTLPLANMYXXCEHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259252558 (88h10m58.062717149s) [noise=true , address=77.90.31.12:4610 , piece_id=7BVMCYL6YMJVZNK53NIC66ML353J4NKNGANCILWULEB6UUKEEV5A, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.259794927 (88h10m58.063259508s) [noise=true , address=45.91.116.13:4168 , piece_id=Q4OACUH2JK7BWH5TVEUULNRILY7H6Z7CVAYQOHRIOLWIDF5OAJFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.260346107 (88h10m58.063810687s) [noise=true , address=45.91.116.11:4139 , piece_id=SAJF2K42JTF5GOHTQBH63ZCSBPVIM2FP5MBMHR44L4HGXLLFRVRQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.297667511 (88h10m58.101132096s) [noise=true , address=145.79.227.7:4300 , piece_id=VQUNPNW33XNLZHCEM7HSYNRLYDJ47OP4FNKMK2OOL74EZAWEJUHQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.303331831 (88h10m58.106796415s) [noise=true , address=145.79.227.41:4099 , piece_id=MWJ3SAUDCICVWCTOQGXSRWCAVOM3KX6UEYL7W2LYG3B7XY4UERXQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304157589 (88h10m58.107622174s) [noise=true , address=145.79.227.3:4181 , piece_id=6JYAQGTPQBO2WOUSTWQNVVP2QUFP5SDZA2DDQD5MJXZOU3K57IDQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: <nil> Sep 27 05:41:10.304194309 (88h10m58.107658901s) [seg_pos={0 0}, upload=77507]: Segment reached optimal threshold of 14 pieces. Sep 27 05:41:10.304348961 (88h10m58.107813552s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304362975 (88h10m58.107827576s) [noise=true , address=145.79.227.52:4451 , piece_id=O5MGWMCOT3HVK3LAWVBB75LQWLK2GW4WLSJJD7LP4LLXBR5HBNMQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304382528 (88h10m58.107847109s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Zz78xER2nL3XBQemnLxWTPUxtVySJv9yK2e7FfUcNeg5XK1r4): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304395269 (88h10m58.10785987s) [noise=true , address=145.79.227.29:4967 , piece_id=GT3KFLXMSEB4GYFWSRLY5OS45ESMJCPDM6VADISUWTJXOLT7VUFA, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304431598 (88h10m58.107896179s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125SMhDsEZruNu6LkmQn2M7R6WzvXTdk86DRsKf522u8BNiANq3): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304439463 (88h10m58.107904054s) [noise=true , address=145.79.227.43:4171 , piece_id=6MCKDWRSW5HVEB4PIK7CJSM5UN6UU4BRJYFIFZZEXHUJ6SVIPZIQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304454096 (88h10m58.107918688s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY): protocol: expected piece hash; context canceled; EOF Sep 27 05:41:10.304460894 (88h10m58.107925488s) [noise=true , address=145.79.227.18:4034 , piece_id=KWLM2H4ORWERWASJEVQWXLTUH2BAGO573754R2LVQ2Y7BQ2CDUQQ, seg_pos={0 0}, upload=77507]: Long tail cancellation due to optimal threshold Sep 27 05:41:10.304476470 (88h10m58.107941053s) [seg_pos={0 0}, upload=77507]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 27 05:41:10.304555875 (88h10m58.108020466s) [upload=77507]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 05:41:10.304562879 (88h10m58.108027474s) [upload=77507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 05:43:52.740307410 (88h13m40.543771993s) [upload=77507]: Done uploading segments... Sep 27 05:43:52.740338563 (88h13m40.54380317s) [upload=77507]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.582798977s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)