Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..............................................X.............] duration: 1.694957781s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 18:00:48 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.695002385s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........X........X.........................................] duration: 2.606054085s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 18:00:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.606085439s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...............................................X............] duration: 1.751571865s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 18:00:13 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.751599435s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........X........X........................................] duration: 2.720844042s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 18:00:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.720874265s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [................................................X...........] duration: 1.642134708s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 17:59:52 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.642164933s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.................................................X..........] duration: 1.765743242s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 17:59:19 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.76577319s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........X........X.......................................] duration: 2.783904154s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:59:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.783951419s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..................................................X.........] duration: 1.717371366s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 17:58:30 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.717397126s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............X........X......................................] duration: 2.536707219s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:58:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.536738666s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...................................................X........] duration: 1.591448892s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 17:58:13 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.591479575s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....................................................X.......] duration: 1.648911006s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 17:57:57 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.648945091s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.....................................................X......] duration: 1.665952317s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 17:57:20 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.666102623s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............X........X.....................................] duration: 2.437177157s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:57:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.437204078s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............X........X....................................] duration: 2.412921637s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:56:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.41295444s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......................................................X.....] duration: 1.735201882s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 17:56:36 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.735227184s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............X........X...................................] duration: 2.600490567s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:55:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.600538984s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......................................................X....] duration: 1.643897638s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 17:55:23 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.643929295s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................X........X..................................] duration: 2.671839156s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:55:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.671867858s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........................................................X...] duration: 1.709508929s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 17:54:59 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.709534474s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........................................................X..] duration: 1.59409061s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 17:54:42 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.594140043s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................X........X.................................] duration: 2.526200951s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:54:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.526225726s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................X........X................................] duration: 8.829077286s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:53:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 8.829110379s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........................................................X.] duration: 2.681680428s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 17:53:38 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.681726515s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................X........X...............................] duration: 3.629988574s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:53:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 3.630011756s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........................................................X] duration: 5.00181885s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 17:53:18 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001841841s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................X........X..............................] duration: 2.388144418s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:52:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.388189269s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................X........X.............................] duration: 2.528058331s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:52:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.52808892s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................X........X............................] duration: 2.573097569s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:52:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.573121803s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................X........X...........................] duration: 2.538475842s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:51:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.538516928s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................X........X..........................] duration: 2.477473549s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:51:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.477501926s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................X........X.........................] duration: 2.688789651s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:50:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.688818618s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................X........X........................] duration: 2.393956317s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:49:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.393987186s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................X........X.......................] duration: 2.533494771s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:48:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.533513211s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................X........X......................] duration: 2.383780881s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:48:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.383809557s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................X........X.....................] duration: 2.539831302s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:47:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.539862307s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................X........X....................] duration: 2.513385435s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:46:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.513413728s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................X........X...................] duration: 2.557586541s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:45:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.557620869s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................X........X..................] duration: 2.562782884s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:44:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.562817828s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................X........X.................] duration: 2.511748393s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:43:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.511834576s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................X........X................] duration: 2.433942731s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:43:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.433973921s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................X........X...............] duration: 2.425343056s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:43:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.42538949s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................X........X..............] duration: 2.488256325s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:42:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.488284356s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X........X.............] duration: 2.501005s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:41:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.501033137s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [X...........................................................] duration: 1.606561693s trace: https://jaeger.dev.storj.io/trace/5d799d8b0174cff8 FAIL (2026-02-07 17:41:08 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.606587731s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................X........X............] duration: 2.535853466s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:40:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.535918465s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.X..........................................................] duration: 1.651780126s trace: https://jaeger.dev.storj.io/trace/5d799d8b0174cff8 FAIL (2026-02-07 17:40:13 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.651799128s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X........X...........] duration: 2.536556995s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:39:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.536599484s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................................X........X..........] duration: 2.341033138s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:39:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.341056839s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..X.........................................................] duration: 1.755286812s trace: https://jaeger.dev.storj.io/trace/5d799d8b0174cff8 FAIL (2026-02-07 17:39:16 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.755366018s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...X........................................................] duration: 2.649633394s trace: https://jaeger.dev.storj.io/trace/5d799d8b0174cff8 FAIL (2026-02-07 17:38:39 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 2.649668759s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)