Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 196925 reports (Page 38 of 3939)
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [.....XX.....................................................]
duration:
1.614207332s
trace:
https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b
FAIL (2026-02-09 02:35:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.614235098s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................]
duration:
3.016150212s
trace:
https://jaeger.dev.storj.io/trace/2bd884fc977f2556
FAIL (2026-02-09 02:35:05 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.016179561s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................]
duration:
2.269893682s
trace:
https://jaeger.dev.storj.io/trace/5174e2e9d0983e17
FAIL (2026-02-09 02:34:43 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 10)
======LOGS======
Feb  9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload
Feb  9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload
Feb  9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments...
Feb  9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false
Feb  9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb  9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb  9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment...
Feb  9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment.
Feb  9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080     , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664     , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894   , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152    , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661     , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947     , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773     , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820   , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296     , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927   , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818   , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024     , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841     , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856   , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629     , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627     , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment
Feb  9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments...
Feb  9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296     , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947     , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152    , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080     , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024     , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820   , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927   , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894   , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856   , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818   , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841     , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627     , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773     , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661     , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664     , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629     , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil>
Feb  9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments...
Feb  9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10)
Duration: 2.269916641s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [......XX....................................................]
duration:
1.65723626s
trace:
https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b
FAIL (2026-02-09 02:34:30 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.657270038s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................]
duration:
2.894080424s
trace:
https://jaeger.dev.storj.io/trace/2bd884fc977f2556
FAIL (2026-02-09 02:34:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.894115398s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................]
duration:
2.283402713s
trace:
https://jaeger.dev.storj.io/trace/5174e2e9d0983e17
FAIL (2026-02-09 02:33:44 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 10)
======LOGS======
Feb  9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload
Feb  9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload
Feb  9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments...
Feb  9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false
Feb  9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb  9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb  9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment...
Feb  9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment.
Feb  9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080     , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664     , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894   , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152    , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661     , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947     , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773     , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820   , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296     , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927   , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818   , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024     , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841     , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856   , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629     , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627     , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment
Feb  9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments...
Feb  9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296     , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947     , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152    , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080     , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024     , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820   , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927   , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894   , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856   , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818   , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841     , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627     , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773     , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661     , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664     , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629     , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil>
Feb  9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments...
Feb  9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10)
Duration: 2.283427352s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [.......XX...................................................]
duration:
1.899851197s
trace:
https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b
FAIL (2026-02-09 02:33:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.899891093s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................]
duration:
2.596978935s
trace:
https://jaeger.dev.storj.io/trace/2bd884fc977f2556
FAIL (2026-02-09 02:33:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.597035011s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [........XX..................................................]
duration:
1.721229592s
trace:
https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b
FAIL (2026-02-09 02:33:17 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.721259954s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................]
duration:
2.675486921s
trace:
https://jaeger.dev.storj.io/trace/2bd884fc977f2556
FAIL (2026-02-09 02:32:56 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.675913567s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................]
duration:
2.481627372s
trace:
https://jaeger.dev.storj.io/trace/5174e2e9d0983e17
FAIL (2026-02-09 02:32:50 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 10)
======LOGS======
Feb  9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload
Feb  9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload
Feb  9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments...
Feb  9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false
Feb  9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb  9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb  9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment...
Feb  9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment.
Feb  9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080     , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664     , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894   , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152    , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661     , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947     , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773     , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820   , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296     , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927   , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818   , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024     , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841     , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856   , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629     , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627     , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment
Feb  9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments...
Feb  9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296     , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947     , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152    , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080     , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024     , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820   , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927   , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894   , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856   , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818   , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841     , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627     , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773     , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661     , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664     , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629     , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil>
Feb  9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments...
Feb  9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10)
Duration: 2.481652315s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [.........XX.................................................]
duration:
1.719767392s
trace:
https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b
FAIL (2026-02-09 02:32:38 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.719794278s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................]
duration:
2.412355997s
trace:
https://jaeger.dev.storj.io/trace/5174e2e9d0983e17
FAIL (2026-02-09 02:32:34 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 10)
======LOGS======
Feb  9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload
Feb  9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload
Feb  9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments...
Feb  9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false
Feb  9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb  9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb  9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment...
Feb  9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment.
Feb  9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080     , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664     , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894   , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152    , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661     , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947     , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773     , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820   , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296     , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927   , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818   , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024     , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841     , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856   , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629     , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627     , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment
Feb  9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments...
Feb  9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296     , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947     , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152    , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080     , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024     , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820   , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927   , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894   , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856   , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818   , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841     , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627     , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773     , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661     , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664     , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629     , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil>
Feb  9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments...
Feb  9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10)
Duration: 2.412402916s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................]
duration:
2.725091858s
trace:
https://jaeger.dev.storj.io/trace/2bd884fc977f2556
FAIL (2026-02-09 02:32:10 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.725128494s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................]
duration:
2.267845351s
trace:
https://jaeger.dev.storj.io/trace/5174e2e9d0983e17
FAIL (2026-02-09 02:31:47 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 10)
======LOGS======
Feb  9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload
Feb  9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload
Feb  9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments...
Feb  9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false
Feb  9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb  9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb  9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment...
Feb  9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment.
Feb  9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080     , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664     , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894   , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152    , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661     , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947     , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773     , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820   , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296     , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927   , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818   , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024     , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841     , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856   , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629     , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627     , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment
Feb  9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments...
Feb  9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296     , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947     , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152    , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080     , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024     , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820   , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927   , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894   , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856   , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818   , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841     , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627     , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773     , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661     , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664     , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629     , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil>
Feb  9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments...
Feb  9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10)
Duration: 2.267872636s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [..........XX................................................]
duration:
1.577287012s
trace:
https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b
FAIL (2026-02-09 02:31:24 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.577304903s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................]
duration:
2.704489991s
trace:
https://jaeger.dev.storj.io/trace/2bd884fc977f2556
FAIL (2026-02-09 02:31:15 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.704516401s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................]
duration:
2.31357112s
trace:
https://jaeger.dev.storj.io/trace/5174e2e9d0983e17
FAIL (2026-02-09 02:30:58 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 10)
======LOGS======
Feb  9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload
Feb  9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload
Feb  9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments...
Feb  9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false
Feb  9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb  9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb  9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment...
Feb  9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment.
Feb  9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080     , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664     , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894   , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152    , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661     , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947     , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773     , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820   , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296     , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927   , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818   , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024     , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841     , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856   , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629     , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627     , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment
Feb  9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments...
Feb  9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296     , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947     , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152    , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080     , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024     , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820   , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927   , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894   , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856   , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818   , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841     , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627     , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773     , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661     , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664     , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629     , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil>
Feb  9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments...
Feb  9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10)
Duration: 2.313599435s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................]
duration:
2.832913291s
trace:
https://jaeger.dev.storj.io/trace/2bd884fc977f2556
FAIL (2026-02-09 02:30:53 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.832935179s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [...........XX...............................................]
duration:
2.112197199s
trace:
https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b
FAIL (2026-02-09 02:30:50 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.112313018s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................]
duration:
2.716782162s
trace:
https://jaeger.dev.storj.io/trace/2bd884fc977f2556
FAIL (2026-02-09 02:30:26 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.716910397s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................]
duration:
2.278514716s
trace:
https://jaeger.dev.storj.io/trace/5174e2e9d0983e17
FAIL (2026-02-09 02:29:55 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 10)
======LOGS======
Feb  9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload
Feb  9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload
Feb  9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments...
Feb  9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false
Feb  9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb  9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb  9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment...
Feb  9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment.
Feb  9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080     , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664     , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894   , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152    , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661     , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947     , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773     , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820   , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296     , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927   , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818   , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024     , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841     , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856   , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629     , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627     , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment
Feb  9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments...
Feb  9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296     , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947     , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152    , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080     , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024     , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820   , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927   , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894   , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856   , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818   , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841     , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627     , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773     , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661     , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664     , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629     , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil>
Feb  9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments...
Feb  9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10)
Duration: 2.278540981s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................]
duration:
2.675248615s
trace:
https://jaeger.dev.storj.io/trace/2bd884fc977f2556
FAIL (2026-02-09 02:29:54 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.675294367s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [............XX..............................................]
duration:
2.180676888s
trace:
https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b
FAIL (2026-02-09 02:29:38 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.180702085s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................]
duration:
2.289783323s
trace:
https://jaeger.dev.storj.io/trace/5174e2e9d0983e17
FAIL (2026-02-09 02:29:15 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 10)
======LOGS======
Feb  9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload
Feb  9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload
Feb  9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments...
Feb  9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false
Feb  9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb  9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb  9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment...
Feb  9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment.
Feb  9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080     , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664     , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894   , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152    , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661     , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947     , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773     , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820   , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296     , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927   , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818   , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024     , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841     , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856   , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629     , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627     , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment
Feb  9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments...
Feb  9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296     , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947     , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152    , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080     , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024     , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820   , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927   , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894   , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856   , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818   , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841     , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627     , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773     , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661     , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664     , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629     , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil>
Feb  9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments...
Feb  9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10)
Duration: 2.289814019s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................]
duration:
2.800983605s
trace:
https://jaeger.dev.storj.io/trace/2bd884fc977f2556
FAIL (2026-02-09 02:28:53 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.801011634s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [.............XX.............................................]
duration:
1.699571749s
trace:
https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b
FAIL (2026-02-09 02:28:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.69959346s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................]
duration:
2.292004533s
trace:
https://jaeger.dev.storj.io/trace/5174e2e9d0983e17
FAIL (2026-02-09 02:28:29 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 10)
======LOGS======
Feb  9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload
Feb  9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload
Feb  9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments...
Feb  9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false
Feb  9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb  9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb  9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment...
Feb  9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment.
Feb  9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080     , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664     , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894   , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152    , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661     , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947     , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773     , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820   , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296     , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927   , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818   , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024     , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841     , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856   , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629     , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627     , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment
Feb  9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments...
Feb  9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296     , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947     , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152    , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080     , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024     , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820   , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927   , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894   , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856   , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818   , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841     , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627     , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773     , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661     , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664     , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629     , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil>
Feb  9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments...
Feb  9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10)
Duration: 2.292037568s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................]
duration:
2.68153108s
trace:
https://jaeger.dev.storj.io/trace/2bd884fc977f2556
FAIL (2026-02-09 02:28:11 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.681554252s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [..............XX............................................]
duration:
1.635522613s
trace:
https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b
FAIL (2026-02-09 02:27:55 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.63559418s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................]
duration:
2.311296964s
trace:
https://jaeger.dev.storj.io/trace/5174e2e9d0983e17
FAIL (2026-02-09 02:27:53 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 10)
======LOGS======
Feb  9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload
Feb  9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload
Feb  9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments...
Feb  9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false
Feb  9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb  9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb  9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment...
Feb  9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment.
Feb  9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080     , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664     , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894   , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152    , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661     , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947     , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773     , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820   , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296     , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927   , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818   , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024     , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841     , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856   , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629     , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627     , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment
Feb  9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments...
Feb  9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296     , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947     , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152    , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080     , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024     , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820   , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927   , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894   , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856   , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818   , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841     , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627     , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773     , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661     , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664     , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629     , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil>
Feb  9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments...
Feb  9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10)
Duration: 2.311325276s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................]
duration:
2.897896037s
trace:
https://jaeger.dev.storj.io/trace/2bd884fc977f2556
FAIL (2026-02-09 02:27:47 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.897922953s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [...............XX...........................................]
duration:
1.99562644s
trace:
https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b
FAIL (2026-02-09 02:27:34 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.995651539s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [................XX..........................................]
duration:
2.377106635s
trace:
https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b
FAIL (2026-02-09 02:27:15 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.377132137s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................]
duration:
2.318222267s
trace:
https://jaeger.dev.storj.io/trace/5174e2e9d0983e17
FAIL (2026-02-09 02:27:09 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 10)
======LOGS======
Feb  9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload
Feb  9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload
Feb  9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments...
Feb  9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false
Feb  9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb  9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb  9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment...
Feb  9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment.
Feb  9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080     , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664     , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894   , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152    , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661     , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947     , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773     , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820   , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296     , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927   , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818   , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024     , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841     , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856   , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629     , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627     , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment
Feb  9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments...
Feb  9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296     , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947     , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152    , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080     , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024     , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820   , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927   , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894   , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856   , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818   , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841     , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627     , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773     , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661     , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664     , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629     , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil>
Feb  9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments...
Feb  9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10)
Duration: 2.318252417s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................]
duration:
2.845855752s
trace:
https://jaeger.dev.storj.io/trace/2bd884fc977f2556
FAIL (2026-02-09 02:26:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.84593439s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [.................XX.........................................]
duration:
1.616092709s
trace:
https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b
FAIL (2026-02-09 02:26:18 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.616135818s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................]
duration:
2.396646647s
trace:
https://jaeger.dev.storj.io/trace/5174e2e9d0983e17
FAIL (2026-02-09 02:25:56 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 10)
======LOGS======
Feb  9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload
Feb  9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload
Feb  9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments...
Feb  9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false
Feb  9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb  9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb  9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment...
Feb  9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment.
Feb  9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080     , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664     , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894   , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152    , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661     , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947     , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773     , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820   , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296     , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927   , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818   , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024     , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841     , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856   , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629     , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627     , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment
Feb  9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments...
Feb  9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296     , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947     , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152    , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080     , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024     , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820   , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927   , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894   , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856   , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818   , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841     , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627     , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773     , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661     , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664     , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629     , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil>
Feb  9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments...
Feb  9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10)
Duration: 2.396664588s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................]
duration:
2.586254788s
trace:
https://jaeger.dev.storj.io/trace/2bd884fc977f2556
FAIL (2026-02-09 02:25:30 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.586337804s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [..................XX........................................]
duration:
1.683498055s
trace:
https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b
FAIL (2026-02-09 02:25:13 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.683544762s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................]
duration:
2.285351696s
trace:
https://jaeger.dev.storj.io/trace/5174e2e9d0983e17
FAIL (2026-02-09 02:24:54 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 10)
======LOGS======
Feb  9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload
Feb  9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload
Feb  9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments...
Feb  9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false
Feb  9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb  9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb  9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment...
Feb  9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment.
Feb  9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080     , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664     , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894   , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152    , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661     , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947     , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773     , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820   , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296     , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927   , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818   , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024     , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841     , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856   , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629     , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627     , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment
Feb  9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments...
Feb  9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296     , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947     , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152    , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080     , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024     , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820   , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927   , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894   , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856   , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818   , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841     , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627     , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773     , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661     , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664     , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629     , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil>
Feb  9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments...
Feb  9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10)
Duration: 2.285381948s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [...................XX.......................................]
duration:
1.576102307s
trace:
https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b
FAIL (2026-02-09 02:24:34 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.576161338s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................]
duration:
2.703235005s
trace:
https://jaeger.dev.storj.io/trace/2bd884fc977f2556
FAIL (2026-02-09 02:24:28 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.703267462s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................]
duration:
2.558838709s
trace:
https://jaeger.dev.storj.io/trace/2bd884fc977f2556
FAIL (2026-02-09 02:23:57 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.5588707s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................]
duration:
2.321224666s
trace:
https://jaeger.dev.storj.io/trace/5174e2e9d0983e17
FAIL (2026-02-09 02:23:52 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 10)
======LOGS======
Feb  9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload
Feb  9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload
Feb  9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments...
Feb  9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false
Feb  9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb  9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb  9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment...
Feb  9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment.
Feb  9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080     , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664     , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894   , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152    , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661     , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947     , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773     , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820   , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296     , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927   , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818   , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024     , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841     , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856   , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629     , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627     , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment
Feb  9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments...
Feb  9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296     , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947     , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152    , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080     , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024     , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820   , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927   , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894   , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856   , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818   , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841     , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627     , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773     , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661     , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664     , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629     , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil>
Feb  9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments...
Feb  9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10)
Duration: 2.321290142s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................]
duration:
2.720453469s
trace:
https://jaeger.dev.storj.io/trace/2bd884fc977f2556
FAIL (2026-02-09 02:23:34 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.720557924s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [....................XX......................................]
duration:
2.374541599s
trace:
https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b
FAIL (2026-02-09 02:23:33 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.374589683s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................]
duration:
2.340657527s
trace:
https://jaeger.dev.storj.io/trace/5174e2e9d0983e17
FAIL (2026-02-09 02:23:28 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 10)
======LOGS======
Feb  9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload
Feb  9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload
Feb  9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments...
Feb  9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false
Feb  9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb  9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb  9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment...
Feb  9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment.
Feb  9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080     , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664     , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894   , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152    , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661     , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947     , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773     , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820   , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296     , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927   , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818   , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024     , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841     , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856   , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629     , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627     , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment
Feb  9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments...
Feb  9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296     , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947     , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152    , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080     , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024     , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820   , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927   , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894   , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856   , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818   , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841     , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627     , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773     , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661     , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664     , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629     , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil>
Feb  9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments...
Feb  9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10)
Duration: 2.340681903s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [.....................XX.....................................]
duration:
1.674867485s
trace:
https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b
FAIL (2026-02-09 02:23:05 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.67497166s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................]
duration:
2.286857949s
trace:
https://jaeger.dev.storj.io/trace/5174e2e9d0983e17
FAIL (2026-02-09 02:22:46 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 10)
======LOGS======
Feb  9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload
Feb  9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload
Feb  9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments...
Feb  9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false
Feb  9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb  9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb  9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment...
Feb  9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment.
Feb  9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080     , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664     , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894   , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152    , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661     , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947     , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773     , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820   , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296     , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927   , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818   , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024     , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841     , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856   , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629     , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627     , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece...
Feb  9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment
Feb  9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments...
Feb  9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296     , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947     , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152    , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080     , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024     , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820   , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927   , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894   , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856   , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818   , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil>
Feb  9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841     , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627     , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773     , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661     , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664     , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629     , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb  9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil>
Feb  9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments...
Feb  9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10)
Duration: 2.286881177s core uplink us-select-1