Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.662835273s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 18:10:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.662866126s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.458651084s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 18:09:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.458706575s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....................................X.......................] duration: 1.680338683s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 18:09:18 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.680382379s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.....................................X......................] duration: 1.629646053s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 18:08:34 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.629672927s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.489560357s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 18:08:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.489680021s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [X........X..................................................] duration: 2.418838695s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 18:08:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.418866741s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.X........X.................................................] duration: 2.494913621s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 18:07:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.495000512s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......................................X.....................] duration: 1.709041251s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 18:07:33 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.709100586s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..X........X................................................] duration: 2.518451814s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 18:07:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.518510457s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......................................X....................] duration: 1.628193593s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 18:07:00 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.628223384s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........................................X...................] duration: 1.647387604s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 18:06:00 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.64742147s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...X........X...............................................] duration: 2.72725213s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 18:05:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.72728465s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....X........X..............................................] duration: 2.659715248s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 18:05:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.659743527s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........................................X..................] duration: 1.678940721s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 18:04:51 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.6789638s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....X........X.............................................] duration: 2.421301936s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 18:04:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.421359963s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........................................X.................] duration: 1.590964155s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 18:04:15 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.590990442s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......X........X............................................] duration: 2.497483727s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 18:03:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.497518857s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........................................X................] duration: 1.84742025s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 18:03:08 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.847493388s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......X........X...........................................] duration: 2.463865343s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 18:03:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.463898709s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [............................................X...............] duration: 1.701239016s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 18:02:43 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.701266351s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........X........X..........................................] duration: 2.531633273s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 18:01:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.531654203s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.............................................X..............] duration: 1.752385632s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 18:01:30 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.752473356s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..............................................X.............] duration: 1.694957781s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 18:00:48 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.695002385s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........X........X.........................................] duration: 2.606054085s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 18:00:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.606085439s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...............................................X............] duration: 1.751571865s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 18:00:13 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.751599435s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........X........X........................................] duration: 2.720844042s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 18:00:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.720874265s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [................................................X...........] duration: 1.642134708s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 17:59:52 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.642164933s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.................................................X..........] duration: 1.765743242s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 17:59:19 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.76577319s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........X........X.......................................] duration: 2.783904154s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:59:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.783951419s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..................................................X.........] duration: 1.717371366s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 17:58:30 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.717397126s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............X........X......................................] duration: 2.536707219s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:58:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.536738666s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...................................................X........] duration: 1.591448892s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 17:58:13 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.591479575s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....................................................X.......] duration: 1.648911006s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 17:57:57 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.648945091s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.....................................................X......] duration: 1.665952317s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 17:57:20 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.666102623s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............X........X.....................................] duration: 2.437177157s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:57:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.437204078s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............X........X....................................] duration: 2.412921637s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:56:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.41295444s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......................................................X.....] duration: 1.735201882s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 17:56:36 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.735227184s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............X........X...................................] duration: 2.600490567s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:55:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.600538984s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......................................................X....] duration: 1.643897638s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 17:55:23 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.643929295s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................X........X..................................] duration: 2.671839156s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:55:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.671867858s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........................................................X...] duration: 1.709508929s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 17:54:59 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.709534474s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........................................................X..] duration: 1.59409061s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 17:54:42 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.594140043s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................X........X.................................] duration: 2.526200951s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:54:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.526225726s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................X........X................................] duration: 8.829077286s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:53:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 8.829110379s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........................................................X.] duration: 2.681680428s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 17:53:38 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.681726515s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................X........X...............................] duration: 3.629988574s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:53:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 3.630011756s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........................................................X] duration: 5.00181885s trace: https://jaeger.dev.storj.io/trace/e2418d4c207d3ba FAIL (2026-02-07 17:53:18 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001841841s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................X........X..............................] duration: 2.388144418s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:52:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.388189269s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................X........X.............................] duration: 2.528058331s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:52:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.52808892s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................X........X............................] duration: 2.573097569s trace: https://jaeger.dev.storj.io/trace/709f440ba29f5bd FAIL (2026-02-07 17:52:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece... Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments... Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil> Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments... Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.573121803s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)