Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.779891851s trace: https://jaeger.dev.storj.io/trace/2bd884fc977f2556 FAIL (2026-02-09 02:10:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.779937848s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.248628723s trace: https://jaeger.dev.storj.io/trace/5174e2e9d0983e17 FAIL (2026-02-09 02:10:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Feb 9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload Feb 9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload Feb 9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments... Feb 9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false Feb 9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment... Feb 9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment. Feb 9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment Feb 9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments... Feb 9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments... Feb 9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.24865926s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.696473187s trace: https://jaeger.dev.storj.io/trace/2bd884fc977f2556 FAIL (2026-02-09 02:09:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.696557042s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.........................................XX.................] duration: 2.137170294s trace: https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b FAIL (2026-02-09 02:09:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.137200563s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.51533704s trace: https://jaeger.dev.storj.io/trace/5174e2e9d0983e17 FAIL (2026-02-09 02:09:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Feb 9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload Feb 9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload Feb 9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments... Feb 9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false Feb 9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment... Feb 9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment. Feb 9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment Feb 9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments... Feb 9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments... Feb 9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.515366981s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.804263424s trace: https://jaeger.dev.storj.io/trace/2bd884fc977f2556 FAIL (2026-02-09 02:09:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.804295s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.314781667s trace: https://jaeger.dev.storj.io/trace/5174e2e9d0983e17 FAIL (2026-02-09 02:08:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Feb 9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload Feb 9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload Feb 9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments... Feb 9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false Feb 9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment... Feb 9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment. Feb 9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment Feb 9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments... Feb 9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments... Feb 9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.314797496s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.68997281s trace: https://jaeger.dev.storj.io/trace/2bd884fc977f2556 FAIL (2026-02-09 02:08:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.689999883s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..........................................XX................] duration: 1.684473853s trace: https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b FAIL (2026-02-09 02:08:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.684500801s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.730051596s trace: https://jaeger.dev.storj.io/trace/2bd884fc977f2556 FAIL (2026-02-09 02:08:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.730071523s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.36622455s trace: https://jaeger.dev.storj.io/trace/5174e2e9d0983e17 FAIL (2026-02-09 02:08:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Feb 9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload Feb 9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload Feb 9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments... Feb 9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false Feb 9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment... Feb 9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment. Feb 9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment Feb 9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments... Feb 9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments... Feb 9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.366252526s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...........................................XX...............] duration: 1.675938585s trace: https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b FAIL (2026-02-09 02:07:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.675962672s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.692477436s trace: https://jaeger.dev.storj.io/trace/2bd884fc977f2556 FAIL (2026-02-09 02:07:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.692517262s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.39946989s trace: https://jaeger.dev.storj.io/trace/5174e2e9d0983e17 FAIL (2026-02-09 02:07:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Feb 9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload Feb 9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload Feb 9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments... Feb 9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false Feb 9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment... Feb 9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment. Feb 9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment Feb 9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments... Feb 9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments... Feb 9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.399499865s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.768934055s trace: https://jaeger.dev.storj.io/trace/2bd884fc977f2556 FAIL (2026-02-09 02:07:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.768963496s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [............................................XX..............] duration: 1.689268656s trace: https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b FAIL (2026-02-09 02:06:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.68930331s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.449674017s trace: https://jaeger.dev.storj.io/trace/5174e2e9d0983e17 FAIL (2026-02-09 02:06:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Feb 9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload Feb 9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload Feb 9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments... Feb 9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false Feb 9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment... Feb 9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment. Feb 9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment Feb 9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments... Feb 9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments... Feb 9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.449699406s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.59600868s trace: https://jaeger.dev.storj.io/trace/2bd884fc977f2556 FAIL (2026-02-09 02:06:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.596023165s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.............................................XX.............] duration: 1.671668312s trace: https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b FAIL (2026-02-09 02:06:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.671691062s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.836452229s trace: https://jaeger.dev.storj.io/trace/2bd884fc977f2556 FAIL (2026-02-09 02:06:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.836480244s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.319010046s trace: https://jaeger.dev.storj.io/trace/5174e2e9d0983e17 FAIL (2026-02-09 02:06:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Feb 9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload Feb 9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload Feb 9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments... Feb 9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false Feb 9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment... Feb 9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment. Feb 9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment Feb 9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments... Feb 9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments... Feb 9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.319041597s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.811442205s trace: https://jaeger.dev.storj.io/trace/2bd884fc977f2556 FAIL (2026-02-09 02:05:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.811467449s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..............................................XX............] duration: 1.59447355s trace: https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b FAIL (2026-02-09 02:05:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.594502114s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.392043858s trace: https://jaeger.dev.storj.io/trace/5174e2e9d0983e17 FAIL (2026-02-09 02:05:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Feb 9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload Feb 9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload Feb 9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments... Feb 9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false Feb 9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment... Feb 9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment. Feb 9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment Feb 9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments... Feb 9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments... Feb 9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.392071624s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.309017349s trace: https://jaeger.dev.storj.io/trace/5174e2e9d0983e17 FAIL (2026-02-09 02:04:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Feb 9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload Feb 9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload Feb 9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments... Feb 9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false Feb 9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment... Feb 9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment. Feb 9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment Feb 9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments... Feb 9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments... Feb 9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.309041309s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.555773591s trace: https://jaeger.dev.storj.io/trace/2bd884fc977f2556 FAIL (2026-02-09 02:04:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.55580115s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...............................................XX...........] duration: 1.69258265s trace: https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b FAIL (2026-02-09 02:04:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.692608482s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [................................................XX..........] duration: 2.217234344s trace: https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b FAIL (2026-02-09 02:03:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.21726033s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.696093606s trace: https://jaeger.dev.storj.io/trace/2bd884fc977f2556 FAIL (2026-02-09 02:03:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.696113986s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.366844421s trace: https://jaeger.dev.storj.io/trace/5174e2e9d0983e17 FAIL (2026-02-09 02:03:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Feb 9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload Feb 9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload Feb 9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments... Feb 9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false Feb 9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment... Feb 9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment. Feb 9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment Feb 9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments... Feb 9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments... Feb 9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.366871893s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.335634152s trace: https://jaeger.dev.storj.io/trace/5174e2e9d0983e17 FAIL (2026-02-09 02:02:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Feb 9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload Feb 9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload Feb 9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments... Feb 9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false Feb 9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment... Feb 9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment. Feb 9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment Feb 9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments... Feb 9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments... Feb 9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.335664129s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.585170589s trace: https://jaeger.dev.storj.io/trace/2bd884fc977f2556 FAIL (2026-02-09 02:02:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.585196601s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.289778104s trace: https://jaeger.dev.storj.io/trace/5174e2e9d0983e17 FAIL (2026-02-09 02:02:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Feb 9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload Feb 9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload Feb 9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments... Feb 9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false Feb 9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment... Feb 9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment. Feb 9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment Feb 9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments... Feb 9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments... Feb 9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.289806731s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.564400358s trace: https://jaeger.dev.storj.io/trace/2bd884fc977f2556 FAIL (2026-02-09 02:02:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.5644222s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.................................................XX.........] duration: 1.599399158s trace: https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b FAIL (2026-02-09 02:02:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.599432736s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.281627015s trace: https://jaeger.dev.storj.io/trace/5174e2e9d0983e17 FAIL (2026-02-09 02:02:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Feb 9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload Feb 9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload Feb 9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments... Feb 9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false Feb 9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment... Feb 9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment. Feb 9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment Feb 9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments... Feb 9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments... Feb 9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.281657024s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..................................................XX........] duration: 1.701151551s trace: https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b FAIL (2026-02-09 02:01:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.701232581s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.267703187s trace: https://jaeger.dev.storj.io/trace/5174e2e9d0983e17 FAIL (2026-02-09 02:01:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Feb 9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload Feb 9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload Feb 9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments... Feb 9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false Feb 9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment... Feb 9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment. Feb 9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment Feb 9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments... Feb 9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments... Feb 9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.267739074s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.854002309s trace: https://jaeger.dev.storj.io/trace/2bd884fc977f2556 FAIL (2026-02-09 02:01:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.854019916s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.281179359s trace: https://jaeger.dev.storj.io/trace/5174e2e9d0983e17 FAIL (2026-02-09 02:01:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Feb 9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload Feb 9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload Feb 9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments... Feb 9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false Feb 9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment... Feb 9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment. Feb 9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment Feb 9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments... Feb 9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments... Feb 9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.281207555s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...................................................XX.......] duration: 2.103658267s trace: https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b FAIL (2026-02-09 02:01:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.103686101s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.687628579s trace: https://jaeger.dev.storj.io/trace/2bd884fc977f2556 FAIL (2026-02-09 02:00:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.687654492s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [....................................................XX......] duration: 2.239064402s trace: https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b FAIL (2026-02-09 02:00:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.23910422s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 3.472003358s trace: https://jaeger.dev.storj.io/trace/5174e2e9d0983e17 FAIL (2026-02-09 02:00:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Feb 9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload Feb 9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload Feb 9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments... Feb 9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false Feb 9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment... Feb 9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment. Feb 9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment Feb 9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments... Feb 9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments... Feb 9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 3.472031297s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.....................................................XX.....] duration: 1.754276259s trace: https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b FAIL (2026-02-09 02:00:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.754307443s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [......................................................XX....] duration: 1.694703282s trace: https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b FAIL (2026-02-09 01:59:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.694728808s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.80987389s trace: https://jaeger.dev.storj.io/trace/2bd884fc977f2556 FAIL (2026-02-09 01:59:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.809896279s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.240586529s trace: https://jaeger.dev.storj.io/trace/5174e2e9d0983e17 FAIL (2026-02-09 01:59:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Feb 9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload Feb 9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload Feb 9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments... Feb 9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false Feb 9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment... Feb 9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment. Feb 9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment Feb 9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments... Feb 9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments... Feb 9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.240619114s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.......................................................XX...] duration: 1.745740803s trace: https://jaeger.dev.storj.io/trace/337ea6b9f2a3d11b FAIL (2026-02-09 01:58:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.745763453s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.291048135s trace: https://jaeger.dev.storj.io/trace/5174e2e9d0983e17 FAIL (2026-02-09 01:58:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Feb 9 01:55:13.975108561 (585h59m51.859062761s) [upload=515859]: Starting upload Feb 9 01:55:13.975167828 (585h59m51.859122018s) [upload=515859]: Done starting upload Feb 9 01:55:13.975255005 (585h59m51.859209198s) [upload=515859]: Uploading segments... Feb 9 01:55:13.975456860 (585h59m51.85941106s) [upload=515859]: Got next segment. Inline: false Feb 9 01:55:13.975493721 (585h59m51.859447921s) [upload=515859]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 9 01:55:13.975498495 (585h59m51.859452693s) [upload=515859]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 9 01:55:14.099456994 (585h59m51.983411193s) [seg_pos={0 0}, upload=515859]: Begin upload segment... Feb 9 01:55:14.099538395 (585h59m51.983492584s) [seg_pos={0 0}, upload=515859]: Done begin upload segment. Feb 9 01:55:14.099606226 (585h59m51.983560435s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.100678411 (585h59m51.984632618s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101158950 (585h59m51.985113157s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.101545765 (585h59m51.985499974s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102048326 (585h59m51.986002536s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102345010 (585h59m51.98629936s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102383053 (585h59m51.986337255s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102767577 (585h59m51.986721785s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.102777165 (585h59m51.986731374s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103116740 (585h59m51.987070944s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103145510 (585h59m51.987099708s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.103598574 (585h59m51.987552776s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104178273 (585h59m51.988132708s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.104933173 (585h59m51.988887384s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.105488383 (585h59m51.989442587s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.106041570 (585h59m51.98999577s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Uploading piece... Feb 9 01:55:14.711491268 (585h59m52.595445454s) [upload=515859]: Next returned nil segment Feb 9 01:55:14.711507467 (585h59m52.595461667s) [upload=515859]: Waiting for error group managing segments... Feb 9 01:55:14.843086256 (585h59m52.727040466s) [noise=true , address=45.91.116.9:4296 , piece_id=IKR3XBD3A4Z5V73AGTNQFEHPTOZICDZQ3XYC6YFBNTUZKCPRP6NQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.843628548 (585h59m52.727582748s) [noise=true , address=45.91.116.4:4947 , piece_id=57JKT7OIX5ZRCMTBGUYDD2QJRTNT6LHHK7DHH2DUTZKBCG5GNQIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.855339458 (585h59m52.739293658s) [noise=true , address=45.91.116.11:4152 , piece_id=IXH64FOMQH362ZIMHKWIZWBKJLT6PNQFBNE7ALO2MIEMBU6YAL4A, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.859836947 (585h59m52.743791152s) [noise=true , address=45.91.116.8:4080 , piece_id=XWQH2K3EJBG25VEUPEVQ5HKKKN4RLQQKB6IX5XZ4LNMWET4YFPSQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:14.873177386 (585h59m52.757131608s) [noise=true , address=45.91.116.7:4024 , piece_id=E2VWMM6YK4T5LKQ6DAMGAP3SXWZXMABAO46KWW7P5CTVH4Y32AQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.466093661 (585h59m53.350047864s) [noise=true , address=79.127.219.38:4820 , piece_id=LB73TPDLNKCNZYU3IBU2FTPKD53N6VNYKYBOWDML3PPC37YXPSLA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:15.862423614 (585h59m53.746377804s) [noise=true , address=79.127.219.41:4927 , piece_id=GYYR2LVKZTXBRMMUOFQS22K2P7XEZV7TRC3UZ6LFEQNQ3IBCPCIQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.002351321 (585h59m53.886305544s) [noise=true , address=79.127.219.46:4894 , piece_id=YQBCS3ULEUGWHGA45L4FJOBVS4Y6EEGGMRF2L7L55FNAUH2BZGWA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.192742299 (585h59m54.076696502s) [noise=true , address=79.127.219.45:4856 , piece_id=NBGDSB6TESLC5HO7H23KZMWFYT2PZ2PXLSFSQ7YBDTGMMB4GN6IA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:16.637273201 (585h59m54.5212274s) [noise=true , address=79.127.219.38:4818 , piece_id=DFGERCRH7FDLGN7DSCRNZOWWTDRJJ72GAUG7AKGHEVLRU5AKM4XA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: <nil> Feb 9 01:55:43.666964107 (586h0m21.550918312s) [noise=true , address=77.90.31.19:4841 , piece_id=RXZ7JO75NR7V7BSK6GGZHV35UREQHDBDLP7DYJ75LVCLI74BHYYA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:46278->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667140689 (586h0m21.55109489s) [noise=true , address=77.90.31.13:4627 , piece_id=WIDIPWS7BLOJYP4TA3KXMDQEQ7OAIAMNGOXK3FFR4IUO2MYOSBNA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:49054->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667278242 (586h0m21.551232445s) [noise=true , address=77.90.31.17:4773 , piece_id=B3VDFXCZIXZ4DYHDRVXHMFLE3HGGULNTZJ2USYKRFTGRBOSX4DQQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: read tcp 139.59.144.22:40242->77.90.31.17:4773: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667343147 (586h0m21.551297349s) [noise=true , address=77.90.31.14:4661 , piece_id=YH2CS2OFR5GUZMEUEGYEXYJ4NXVCN6DSOTGWYMQIGNHC5EVDORMQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:60578->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667395555 (586h0m21.55134976s) [noise=true , address=77.90.31.14:4664 , piece_id=YP662EGW5K7CTKEAGAYZEAFC76N4N55NTV7XZUNMXU3DKBSA5RDQ, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:54134->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667442490 (586h0m21.551396695s) [noise=true , address=77.90.31.13:4629 , piece_id=PSZAYBNCLGGGLRH26K5QQAOVWBTT7L5VJMXNKTNMRDYXXM5ENDPA, seg_pos={0 0}, upload=515859]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:39040->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 9 01:55:43.667464087 (586h0m21.551418273s) [seg_pos={0 0}, upload=515859]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 9 01:55:43.785159595 (586h0m21.669113803s) [upload=515859]: Done uploading segments... Feb 9 01:55:43.785215714 (586h0m21.669169924s) [upload=515859]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.291078134s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)