Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
6 out of 15 is failed (threshold=6) [.........XXXXXX] duration:
265.025785ms remote:
"tcp:35.152.117.67:443" response headers:
Etag="68cad71b-3c1" Vary=Accept-Encoding Set-Cookie=_cfuvid=4LibhqWOenabM9PMP4VrVcr8AphU4QL0hX.n0CAaIKQ-1758220231599-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Date=Thu, 18 Sep 2025 18:30:31 GMT Content-Length=961 Cf-Cache-Status=BYPASS Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=eu-south-1-prod-hosting-red Content-Type=text/html Cf-Ray=9812ea3e28890e1b-MXP Cache-Control=private target:
https://www.storj.io/
FAIL (2025-09-18 18:30:31 UTC)
unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>500 - Something unexpected happened</title>\n <meta content=\"The page you requested unexpectedly failed to load.\" name=\"description\">\n <meta content=\"width=device-width, initial-scale=1\" name=\"viewport\">\n\n <link href=\"https://app-assets.website-files.com/css/webflow-https-errors.webflow.css\" rel=\"stylesheet\" type=\"text/css\">\n\n <link href=\"https://app-assets.website-files.com/static/favicon_designer.88fce7c7f8.png\" rel=\"shortcut icon\" type=\"image/x-icon\">\n</head>\n\n<body>\n<div class=\"utility-wrapper\">\n <div class=\"utility-container\">\n <div class=\"text-mono\">500</div>\n <div class=\"utility-content\">\n <h1>Something unexpected happened<br></h1>\n <p>The page you requested unexpectedly failed to load. Contact the site owner or support for more assistance.</p>\n </div>\n <div></div>\n </div>\n</div>\n</body>\n\n</html>\n"
Duration: 265.057306ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
5 out of 15 is failed (threshold=6) [..........XXXXX] duration:
311.876906ms remote:
"tcp:15.160.106.203:443" response headers:
Date=Thu, 18 Sep 2025 18:29:55 GMT Content-Type=text/html Cf-Ray=9812e95d59620e57-MXP Cf-Cache-Status=BYPASS Cache-Control=private Etag="68cad71b-3c1" Alt-Svc=h3=":443"; ma=86400 Content-Length=961 Vary=Accept-Encoding Set-Cookie=_cfuvid=wH9LSzCgLIV04iB9CENzfhJVUJPP4Yf9Tlvld3FZwGM-1758220195676-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None X-Cluster-Name=eu-south-1-prod-hosting-red target:
https://www.storj.io/
FAIL (2025-09-18 18:29:55 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>500 - Something unexpected happened</title>\n <meta content=\"The page you requested unexpectedly failed to load.\" name=\"description\">\n <meta content=\"width=device-width, initial-scale=1\" name=\"viewport\">\n\n <link href=\"https://app-assets.website-files.com/css/webflow-https-errors.webflow.css\" rel=\"stylesheet\" type=\"text/css\">\n\n <link href=\"https://app-assets.website-files.com/static/favicon_designer.88fce7c7f8.png\" rel=\"shortcut icon\" type=\"image/x-icon\">\n</head>\n\n<body>\n<div class=\"utility-wrapper\">\n <div class=\"utility-container\">\n <div class=\"text-mono\">500</div>\n <div class=\"utility-content\">\n <h1>Something unexpected happened<br></h1>\n <p>The page you requested unexpectedly failed to load. Contact the site owner or support for more assistance.</p>\n </div>\n <div></div>\n </div>\n</div>\n</body>\n\n</html>\n"
Duration: 311.91778ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
4 out of 15 is failed (threshold=6) [...........XXXX] duration:
231.430916ms remote:
"tcp:15.161.34.42:443" response headers:
Content-Type=text/html Content-Length=961 Cf-Ray=9812e7a23c6cee9f-MXP Cache-Control=private Etag="68cad71b-3c1" Vary=Accept-Encoding X-Cluster-Name=eu-south-1-prod-hosting-red Date=Thu, 18 Sep 2025 18:28:44 GMT Cf-Cache-Status=BYPASS Set-Cookie=_cfuvid=CvR2lnM6vDIUxP9RANpj8Wx53YUm21JiyaxuIa7T56o-1758220124686-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 target:
https://www.storj.io/
FAIL (2025-09-18 18:28:44 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>500 - Something unexpected happened</title>\n <meta content=\"The page you requested unexpectedly failed to load.\" name=\"description\">\n <meta content=\"width=device-width, initial-scale=1\" name=\"viewport\">\n\n <link href=\"https://app-assets.website-files.com/css/webflow-https-errors.webflow.css\" rel=\"stylesheet\" type=\"text/css\">\n\n <link href=\"https://app-assets.website-files.com/static/favicon_designer.88fce7c7f8.png\" rel=\"shortcut icon\" type=\"image/x-icon\">\n</head>\n\n<body>\n<div class=\"utility-wrapper\">\n <div class=\"utility-container\">\n <div class=\"text-mono\">500</div>\n <div class=\"utility-content\">\n <h1>Something unexpected happened<br></h1>\n <p>The page you requested unexpectedly failed to load. Contact the site owner or support for more assistance.</p>\n </div>\n <div></div>\n </div>\n</div>\n</body>\n\n</html>\n"
Duration: 231.477574ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
3 out of 15 is failed (threshold=6) [............XXX] duration:
456.226414ms remote:
"tcp:35.152.117.67:443" response headers:
X-Cluster-Name=eu-south-1-prod-hosting-red Cf-Ray=9812e700fba85837-MXP Cf-Cache-Status=BYPASS Cache-Control=private Vary=Accept-Encoding Alt-Svc=h3=":443"; ma=86400 Date=Thu, 18 Sep 2025 18:28:19 GMT Content-Type=text/html Content-Length=961 Etag="68cad71b-3c1" Set-Cookie=_cfuvid=RjsNzYnGhsi8oFgJXsqz93kVOjdfKATp953oGbg7EPc-1758220099042-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None target:
https://www.storj.io/
FAIL (2025-09-18 18:28:19 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>500 - Something unexpected happened</title>\n <meta content=\"The page you requested unexpectedly failed to load.\" name=\"description\">\n <meta content=\"width=device-width, initial-scale=1\" name=\"viewport\">\n\n <link href=\"https://app-assets.website-files.com/css/webflow-https-errors.webflow.css\" rel=\"stylesheet\" type=\"text/css\">\n\n <link href=\"https://app-assets.website-files.com/static/favicon_designer.88fce7c7f8.png\" rel=\"shortcut icon\" type=\"image/x-icon\">\n</head>\n\n<body>\n<div class=\"utility-wrapper\">\n <div class=\"utility-container\">\n <div class=\"text-mono\">500</div>\n <div class=\"utility-content\">\n <h1>Something unexpected happened<br></h1>\n <p>The page you requested unexpectedly failed to load. Contact the site owner or support for more assistance.</p>\n </div>\n <div></div>\n </div>\n</div>\n</body>\n\n</html>\n"
Duration: 456.271702ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [.............XX] duration:
401.607567ms remote:
"tcp:15.160.106.203:443" response headers:
Content-Type=text/html Content-Length=961 Cf-Cache-Status=BYPASS Etag="68cad71b-3c1" Cf-Ray=9812e5ec2fbf0e21-MXP Cache-Control=private Vary=Accept-Encoding Set-Cookie=_cfuvid=Kgzz8ylqnhK5AWdw6vAMyAG_TRVuCJ3v6DBIegoJKBI-1758220054778-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=eu-south-1-prod-hosting-red Date=Thu, 18 Sep 2025 18:27:34 GMT target:
https://www.storj.io/
FAIL (2025-09-18 18:27:34 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>500 - Something unexpected happened</title>\n <meta content=\"The page you requested unexpectedly failed to load.\" name=\"description\">\n <meta content=\"width=device-width, initial-scale=1\" name=\"viewport\">\n\n <link href=\"https://app-assets.website-files.com/css/webflow-https-errors.webflow.css\" rel=\"stylesheet\" type=\"text/css\">\n\n <link href=\"https://app-assets.website-files.com/static/favicon_designer.88fce7c7f8.png\" rel=\"shortcut icon\" type=\"image/x-icon\">\n</head>\n\n<body>\n<div class=\"utility-wrapper\">\n <div class=\"utility-container\">\n <div class=\"text-mono\">500</div>\n <div class=\"utility-content\">\n <h1>Something unexpected happened<br></h1>\n <p>The page you requested unexpectedly failed to load. Contact the site owner or support for more assistance.</p>\n </div>\n <div></div>\n </div>\n</div>\n</body>\n\n</html>\n"
Duration: 401.635177ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [..............X] duration:
297.657367ms remote:
"tcp:35.152.117.67:443" response headers:
Content-Length=961 Cf-Ray=9812e49e59a05270-MXP Vary=Accept-Encoding Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=eu-south-1-prod-hosting-red Date=Thu, 18 Sep 2025 18:26:41 GMT Cf-Cache-Status=BYPASS Cache-Control=private Etag="68cad71b-3c1" Set-Cookie=_cfuvid=Of7HuaOKyVsjXkxMyi.4WbRb9DwIINLpbxx_65md_.0-1758220001192-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Content-Type=text/html target:
https://www.storj.io/
FAIL (2025-09-18 18:26:41 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>500 - Something unexpected happened</title>\n <meta content=\"The page you requested unexpectedly failed to load.\" name=\"description\">\n <meta content=\"width=device-width, initial-scale=1\" name=\"viewport\">\n\n <link href=\"https://app-assets.website-files.com/css/webflow-https-errors.webflow.css\" rel=\"stylesheet\" type=\"text/css\">\n\n <link href=\"https://app-assets.website-files.com/static/favicon_designer.88fce7c7f8.png\" rel=\"shortcut icon\" type=\"image/x-icon\">\n</head>\n\n<body>\n<div class=\"utility-wrapper\">\n <div class=\"utility-container\">\n <div class=\"text-mono\">500</div>\n <div class=\"utility-content\">\n <h1>Something unexpected happened<br></h1>\n <p>The page you requested unexpectedly failed to load. Contact the site owner or support for more assistance.</p>\n </div>\n <div></div>\n </div>\n</div>\n</body>\n\n</html>\n"
Duration: 297.684953ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.514054618s
FAIL (2025-09-18 18:03:01 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.514095183s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.493874136s
FAIL (2025-09-18 18:02:27 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.493901772s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
4.153478196s
FAIL (2025-09-18 18:02:09 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 4.153521823s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.429343336s
FAIL (2025-09-18 18:01:08 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.42940187s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.639567673s
FAIL (2025-09-18 18:00:07 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.639606889s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.437803947s
FAIL (2025-09-18 17:59:27 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.437852019s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.451739323s
FAIL (2025-09-18 17:59:01 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.451772022s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.580697156s
FAIL (2025-09-18 17:58:44 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.580733958s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.806632559s
FAIL (2025-09-18 17:57:35 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.806665555s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.363201992s
FAIL (2025-09-18 17:57:13 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.363239203s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.495695232s
FAIL (2025-09-18 17:56:54 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.49577873s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
2.488523403s
FAIL (2025-09-18 17:55:48 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.488553496s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.469435871s
FAIL (2025-09-18 17:55:11 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.469472371s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
2.713060172s
FAIL (2025-09-18 17:54:09 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.713087931s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
2.656257877s
FAIL (2025-09-18 17:53:06 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.656300562s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
2.658893468s
FAIL (2025-09-18 17:52:25 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.658936985s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.323518545s
FAIL (2025-09-18 17:52:07 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.3235472s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
2.553928729s
FAIL (2025-09-18 17:51:30 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.553962187s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
2.493217206s
FAIL (2025-09-18 17:51:01 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.493276993s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
2.502478095s
FAIL (2025-09-18 17:50:45 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.502505274s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
2.561752124s
FAIL (2025-09-18 17:49:39 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.56179132s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
3.259057939s
FAIL (2025-09-18 17:48:42 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 3.259095746s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
2.480307572s
FAIL (2025-09-18 17:48:24 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.480409605s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
2.557031086s
FAIL (2025-09-18 17:47:54 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.557133433s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
2.546613334s
FAIL (2025-09-18 17:46:49 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.54672435s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
2.509995939s
FAIL (2025-09-18 17:46:33 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.510027664s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
2.419817758s
FAIL (2025-09-18 17:45:57 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.419937492s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
2.567843821s
FAIL (2025-09-18 17:45:10 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.567879893s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
2.667872349s
FAIL (2025-09-18 17:43:55 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.667950443s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.508307165s
FAIL (2025-09-18 17:43:07 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.508342479s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.407472507s
FAIL (2025-09-18 17:42:27 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.407527429s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.738393553s
FAIL (2025-09-18 17:41:44 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.738419551s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.57647859s
FAIL (2025-09-18 17:41:21 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.576510916s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.398100682s
FAIL (2025-09-18 17:40:31 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.398128836s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.633971712s
FAIL (2025-09-18 17:39:55 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.6340093s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
3.207776053s
FAIL (2025-09-18 17:38:48 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 3.207813732s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.576324745s
FAIL (2025-09-18 17:37:41 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.576360213s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.755688051s
FAIL (2025-09-18 17:36:35 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.755824464s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.498863776s
FAIL (2025-09-18 17:36:08 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.498924443s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.560572027s
FAIL (2025-09-18 17:35:02 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.560612699s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.885894326s
FAIL (2025-09-18 17:34:11 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.885922411s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
2.33412639s
FAIL (2025-09-18 17:33:18 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.334168273s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.482153351s
FAIL (2025-09-18 17:32:17 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.482195364s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.441111508s
FAIL (2025-09-18 17:32:02 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep 18 17:19:31.743202384 (483h11m52.235634817s) [upload=424985]: Starting upload
Sep 18 17:19:31.743313083 (483h11m52.235745528s) [upload=424985]: Done starting upload
Sep 18 17:19:31.743460530 (483h11m52.235892964s) [upload=424985]: Uploading segments...
Sep 18 17:19:31.743805785 (483h11m52.236238214s) [upload=424985]: Got next segment. Inline: false
Sep 18 17:19:31.743892212 (483h11m52.236324643s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 18 17:19:31.743899045 (483h11m52.236331488s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 18 17:19:40.444388670 (483h12m0.936821122s) [seg_pos={0 0}, upload=424985]: Begin upload segment...
Sep 18 17:19:40.444455091 (483h12m0.936887537s) [seg_pos={0 0}, upload=424985]: Done begin upload segment.
Sep 18 17:19:40.444525077 (483h12m0.936957522s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445066264 (483h12m0.937498715s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445211148 (483h12m0.937643593s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445547208 (483h12m0.937979653s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445638329 (483h12m0.938070774s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.445980815 (483h12m0.938413257s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446073731 (483h12m0.938506176s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446318367 (483h12m0.938750816s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446485696 (483h12m0.938918141s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446617126 (483h12m0.939049568s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446879135 (483h12m0.939311608s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.446896519 (483h12m0.939328962s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447174433 (483h12m0.939606878s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447377528 (483h12m0.939809971s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.447684714 (483h12m0.940117166s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:40.450463813 (483h12m0.942896259s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Uploading piece...
Sep 18 17:19:41.059589841 (483h12m1.552022274s) [upload=424985]: Next returned nil segment
Sep 18 17:19:41.059613687 (483h12m1.552046137s) [upload=424985]: Waiting for error group managing segments...
Sep 18 17:19:41.193515923 (483h12m1.685948357s) [noise=true , address=45.91.116.12:4226 , piece_id=5G2U53LIRTHZDIGJSVQ5JE7F5EOYAHLOFTX4WNNC54K75Y4PLOZA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.196716740 (483h12m1.689149168s) [noise=true , address=77.90.31.13:4626 , piece_id=G6WOFNF4PHA7BUKRZRPSAJ42WSDPEMAWXBJR7GS6IP5YTLRPHZ4A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197292914 (483h12m1.68972535s) [noise=true , address=45.91.116.4:4937 , piece_id=HKXOUZMVQYGCWJUPC4VFMPFIDWAPOMKIHCLCCZA5KKYCYKUJI53Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.197486999 (483h12m1.689919442s) [noise=true , address=45.91.116.13:4153 , piece_id=42B74GLXQUIDSD5COP5ICV7O4H2NCS2ZOULLXF6B7ML3SAIO5E3A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198075079 (483h12m1.690507508s) [noise=true , address=45.91.116.11:4118 , piece_id=YCHHN64F7O64EYBGNVXCNWGD6Z3Z7AMGHVBQTUQ7ONVGMGBOGQFA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198111449 (483h12m1.690543884s) [noise=true , address=45.91.116.8:4047 , piece_id=4DJXJILG5YPETBKLUF5SVCF4LMLIFXZS7JQQY3QO3DZT7NVGW2LQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.198830803 (483h12m1.691263247s) [noise=true , address=45.91.116.5:4299 , piece_id=676UHKCCLX47ZLJEPRCEXNMNRKJ6KC4LX436U5FTNL4HXUZV4N6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201137920 (483h12m1.693570353s) [noise=true , address=77.90.31.21:4878 , piece_id=276ZLWI33GSQZQHWCBJN4BM3TP4OKWYAQ22K3XBUTAVQLQP4AZ6A, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.201201092 (483h12m1.693633524s) [noise=true , address=45.91.116.7:4009 , piece_id=MBRZHVVDOCCYXAGCGFFNFO6RVSALL4NJVF3HYCB65T6HH6KREPNQ, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.204259848 (483h12m1.69669228s) [noise=true , address=77.90.31.15:4697 , piece_id=TJ2SLPSM77NC7LU2AC3GK5E7YLDV357KTFFTOVCOMILTU32Y2W5Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.207217173 (483h12m1.699649602s) [noise=true , address=45.91.116.9:4261 , piece_id=YZ5G27H2QS6XHWLFFBSTPFVGZ25BHRQWRVD5ZZ65JFIAVUOXWBMA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.209303062 (483h12m1.701735492s) [noise=true , address=77.90.31.11:4555 , piece_id=VLNW4YAG5HJVWMWN2QUI3QUE7ZIYZ5JIMCFUJF5FQQHFWQYBOZ4Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210024246 (483h12m1.702456676s) [noise=true , address=77.90.31.12:4592 , piece_id=ENENBPNIXXEHZPU34BMVZR4CQSAVCQS6JEIIES3L755K5QMMDLHA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: <nil>
Sep 18 17:19:41.210042275 (483h12m1.702474717s) [seg_pos={0 0}, upload=424985]: Segment reached optimal threshold of 13 pieces.
Sep 18 17:19:41.210200637 (483h12m1.702633066s) [noise=true , address=45.91.116.6:4973 , piece_id=NLQHEQMBLBNNZLOKQEXNEQXIIDK2BWU22OZJJWQV4JTM2DJQXP3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210224010 (483h12m1.702656452s) [noise=true , address=145.79.227.16:4911 , piece_id=BCPESW5MMIWMSJ5BPHXFINV3FIF4X2RQH5UFMR7Z2I2FGQV77M3Q, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210272060 (483h12m1.702704488s) [noise=true , address=45.91.116.9:4263 , piece_id=YZLWFTZ7OFDHLSWQC4MUPXFD6UTJJJ6UZUQX6CEC6XCCYEMSS3CA, seg_pos={0 0}, upload=424985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Sep 18 17:19:41.210288138 (483h12m1.702720567s) [seg_pos={0 0}, upload=424985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 18 17:19:41.210351279 (483h12m1.702783721s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 18 17:19:41.210355638 (483h12m1.702788079s) [upload=424985]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 18 17:20:00.103104267 (483h12m20.595536727s) [upload=424985]: Done uploading segments...
Sep 18 17:20:00.103134210 (483h12m20.595566654s) [upload=424985]: Upload finished. err: <nil>
Duration: 2.441148247s
core
uplink
us-select-1
|