Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.374348673s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 15:09:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.37437325s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
2.362928654s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 15:08:39 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.362955434s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
2.325643523s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 15:07:33 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.325673491s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
2.359524399s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 15:07:03 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.359552952s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.409510309s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 15:06:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.409539807s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
2.370001325s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 15:06:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.370029131s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
2.394925447s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 15:05:57 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.394950474s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
2.419867226s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 15:04:49 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.41989283s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
2.403700092s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 15:03:58 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.40379336s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
2.782604043s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 15:03:10 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.782632254s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
2.526604513s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 15:02:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.526635584s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
2.42788055s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 15:01:31 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.427912756s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
2.291685093s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 15:00:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.291725739s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
2.346868659s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:59:42 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.346960328s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
2.468994232s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:58:56 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.469018386s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
2.48804044s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:58:01 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.488111784s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
2.440146809s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:57:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.440178897s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.41925388s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:56:40 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.419287227s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.686542082s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:55:46 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.686571414s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.419021365s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:55:28 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.419059146s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.381976494s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:54:48 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.382013262s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.40001436s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:54:14 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.400036221s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.429333059s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:53:20 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.429351885s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.416340696s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:52:31 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.416369575s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.35621793s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:52:14 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.356247962s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.445537649s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:51:40 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.445572217s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.314316096s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:50:53 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.314346784s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.431378369s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:50:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.431410182s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.346342265s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:49:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.346366727s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
2.379748901s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:49:29 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.379781437s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.382920004s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:48:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.382945178s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.367190501s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:47:50 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.367215821s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.273658675s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:47:29 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.273689812s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.389359217s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:47:10 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.389386831s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.358045218s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:46:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.358082951s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.586064913s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:45:06 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.586157739s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.331384276s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:44:34 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.331414056s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.388439914s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:43:27 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.388479939s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.373280823s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:42:31 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.373298913s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.353600118s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:41:41 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.353637014s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.404070377s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:41:15 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.404104477s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.424548081s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:40:26 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.42457523s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.37569401s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:40:01 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.375710879s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.34241777s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:39:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.342461616s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.303871036s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:38:56 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.303907195s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.412197017s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:38:06 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.412231435s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
3.648222427s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:37:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 3.648239979s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.112750541s trace:
https://jaeger.dev.storj.io/trace/4f80b6a61042b070
FAIL (2026-02-05 14:37:15 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
EYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296466682 (502h40m53.180420883s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296481616 (502h40m53.180435819s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296926488 (502h40m53.18088069s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.296968403 (502h40m53.180922593s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297426299 (502h40m53.181380499s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.297897205 (502h40m53.181851407s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298370884 (502h40m53.18232509s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.298829660 (502h40m53.18278386s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299500633 (502h40m53.183454832s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.299731371 (502h40m53.183685622s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300335040 (502h40m53.184289248s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.300689585 (502h40m53.184643784s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301045740 (502h40m53.184999942s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.301080591 (502h40m53.185034798s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Uploading piece...
Feb 5 14:36:15.846369298 (502h40m53.730323498s) [upload=442378]: Next returned nil segment
Feb 5 14:36:15.846383362 (502h40m53.730337561s) [upload=442378]: Waiting for error group managing segments...
Feb 5 14:36:15.991034835 (502h40m53.874989035s) [noise=true , address=145.79.227.4:4214 , piece_id=VEYVHP7KJK3EEGTEDGQZZNVCVNCCW7R6WBPQPAICTU6KYZ6OISDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991506801 (502h40m53.875460999s) [noise=true , address=45.91.116.5:4315 , piece_id=4V27KYXKHBDYICJIRIWOJR2R2RV4YKCRZU3W7MSLIF2HH7OQQNRQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.991878338 (502h40m53.875832537s) [noise=true , address=45.91.116.8:4050 , piece_id=5UZPKYZULDQQOURJ2J7CRTLQADVS5PKB7FYT4HOPSQ4CWKWR76LQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.992282367 (502h40m53.876236566s) [noise=true , address=145.79.227.12:4774 , piece_id=PXQZ762B75IMFCL3CFVP2EQWGWAGE5D2EZBABWJLIWU7RUEE4FWQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993519574 (502h40m53.877473773s) [noise=true , address=45.91.116.6:4003 , piece_id=S262OTJSGVBARSC2VZFLWLTE5EMHKNIBUYIYSQOTJMZ5XF5EFXDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.993619055 (502h40m53.877573258s) [noise=true , address=45.91.116.9:4291 , piece_id=OTSJYP2CX5XTDBMUIEGB4SNEFUHKHLESKZ7ZCJ2OMCRE54R67SBA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:15.999430452 (502h40m53.883384652s) [noise=true , address=145.79.227.3:4183 , piece_id=GAV5KAZHZXJRYPBZT33JAKQLTGOWNULCKRJEL4SROY3NCIJEZAJA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.541168789 (502h40m54.425122989s) [noise=true , address=64.49.13.139:4473 , piece_id=DRESKG6KSAABJYZPURFO2KZVBBP5RFRM3RS7LCPNSKTYZU3LH4WA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:36:16.972433407 (502h40m54.85638761s) [noise=true , address=145.79.227.36:4529 , piece_id=VTHAZGTH7ZVZDGWY2JPMEW7HM2WWLGJVIA4SSJVW32HUB3AZJX4Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: <nil>
Feb 5 14:37:14.895326754 (502h41m52.779280956s) [noise=true , address=77.90.31.21:4885 , piece_id=NEPUDYTPIOPPFEGZ4UUMPWI2OSBLBJKU634WRVW5ECYMCILNSRSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55180->77.90.31.21:4885: use of closed network connection
Feb 5 14:37:14.895531613 (502h41m52.779485821s) [noise=true , address=79.127.219.41:4938 , piece_id=UBHJ2WFNTMGOCPONWVZIZOHS2QEGL7NFPDJRSEO6JBOL3BTVZGDQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1i1jd6QKiced1UhGW9CfJgGSik6zbQqZ6CxJLpY8W3GmwNaNTZ, address:79.127.219.41:4938): protocol: rpc: dial tcp 79.127.219.41:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895606624 (502h41m52.779560826s) [noise=true , address=79.127.219.46:4923 , piece_id=KWQICUFLW23IOI5ZA6JYVAYEGO4QWDKZNEOU2KARD2ST2QJI3YSA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:119Fb9Jq5RnkczcG7JXdMiPUPXuWve3yZZLAaLicNvvs5Rft6q, address:79.127.219.46:4923): protocol: read tcp 139.59.144.22:57358->79.127.219.46:4923: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895794682 (502h41m52.779748884s) [noise=true , address=77.90.31.16:4739 , piece_id=37CWORFXH67UBZODDSOE7UYQ3GR6BUKDETVDBPT4RWHTICTIGBDA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb, address:77.90.31.16:4739): protocol: read tcp 139.59.144.22:52752->77.90.31.16:4739: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895910741 (502h41m52.77986494s) [noise=true , address=77.90.31.10:4550 , piece_id=INCQW2KYHTW74SNC4SQN2WOMAZU3N7ADN5ZEHV5D5H6B5HVJCZPQ, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 139.59.144.22:59232->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.895990613 (502h41m52.779944815s) [noise=true , address=77.90.31.11:4573 , piece_id=RQ2X5GX222MKJDZU24XESD3L6UVB2Y3HYG6QN6DLDCEOVZUP3J3Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: read tcp 139.59.144.22:51480->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896014466 (502h41m52.77996872s) [noise=true , address=77.90.31.14:4667 , piece_id=GGOOTZSLORQQRYDN2RLB2MCRFNGAOI6N2BY2WEWVTSKOU5ZIKJXA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12R5gJFhsmocYPNZf4yNnYqJwcwAKt9yiHmmqGMk3btzVjkFV4S, address:77.90.31.14:4667): protocol: read tcp 139.59.144.22:38948->77.90.31.14:4667: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896124548 (502h41m52.780078747s) [noise=true , address=79.127.219.45:4876 , piece_id=2MET3PQR34XMUTZ6X5QIUR4BORWJDVCURWY3OYAD7DS2IHTSP45Q, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12w6fSyqhYU4t8x1dfb3a5rdNxRQMbGXrNFvYeb94HkpTrLYYnu, address:79.127.219.45:4876): protocol: read tcp 139.59.144.22:60858->79.127.219.45:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896158083 (502h41m52.780112282s) [noise=true , address=77.90.31.13:4656 , piece_id=XY2UN2INC6B6JMB5Y5TYST2UFNQWOVTJTIB7ZMHK6DVJZSHRVRYA, seg_pos={0 0}, upload=442378]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: read tcp 139.59.144.22:49062->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 14:37:14.896194720 (502h41m52.780148912s) [seg_pos={0 0}, upload=442378]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Feb 5 14:37:15.006642515 (502h41m52.890596715s) [upload=442378]: Done uploading segments...
Feb 5 14:37:15.006689135 (502h41m52.890643334s) [upload=442378]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 1m0.112771146s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.722470081s trace:
https://jaeger.dev.storj.io/trace/46d137b0026288ae
FAIL (2026-02-05 07:04:47 UTC)
orbiter warning: unexpected EOF
Duration: 2.722499438s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.749462818s trace:
https://jaeger.dev.storj.io/trace/46d137b0026288ae
FAIL (2026-02-05 07:04:18 UTC)
orbiter warning: unexpected EOF
Duration: 2.749551683s
edge
gateway
us-select-1
|