Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X........X.........] duration:
2.495964905s trace:
https://jaeger.dev.storj.io/trace/709f440ba29f5bd
FAIL (2026-02-07 17:38:38 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment
Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments...
Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection
Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection
Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection
Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection
Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection
Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection
Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments...
Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.49599491s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....X.......................................................] duration:
1.653660547s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:37:58 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.653685746s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X........X........] duration:
2.436911798s trace:
https://jaeger.dev.storj.io/trace/709f440ba29f5bd
FAIL (2026-02-07 17:37:38 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment
Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments...
Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection
Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection
Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection
Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection
Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection
Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection
Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments...
Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.436942102s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....X......................................................] duration:
1.686456729s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:37:37 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.686483546s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X........X.......] duration:
2.568411499s trace:
https://jaeger.dev.storj.io/trace/709f440ba29f5bd
FAIL (2026-02-07 17:37:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment
Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments...
Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection
Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection
Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection
Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection
Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection
Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection
Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments...
Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.568441321s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......X.....................................................] duration:
1.684242783s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:36:35 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.684269985s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................................X........X......] duration:
2.535345755s trace:
https://jaeger.dev.storj.io/trace/709f440ba29f5bd
FAIL (2026-02-07 17:35:57 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment
Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments...
Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection
Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection
Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection
Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection
Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection
Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection
Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments...
Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.535442106s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......X....................................................] duration:
3.03634251s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:35:33 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.036451731s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................................X........X.....] duration:
2.390483153s trace:
https://jaeger.dev.storj.io/trace/709f440ba29f5bd
FAIL (2026-02-07 17:35:29 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment
Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments...
Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection
Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection
Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection
Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection
Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection
Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection
Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments...
Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.390529828s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................................X........X....] duration:
2.405440024s trace:
https://jaeger.dev.storj.io/trace/709f440ba29f5bd
FAIL (2026-02-07 17:35:07 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment
Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments...
Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection
Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection
Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection
Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection
Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection
Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection
Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments...
Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.405539269s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........X...................................................] duration:
1.826776144s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:34:46 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.826811199s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................................X........X...] duration:
2.561639359s trace:
https://jaeger.dev.storj.io/trace/709f440ba29f5bd
FAIL (2026-02-07 17:34:04 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment
Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments...
Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection
Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection
Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection
Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection
Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection
Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection
Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments...
Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.561694557s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........X..................................................] duration:
1.64932376s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:33:49 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.649354216s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........X.................................................] duration:
1.794843673s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:33:34 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.795094999s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........X................................................] duration:
2.002866705s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:33:03 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 2.002908973s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................................X........X..] duration:
2.495098473s trace:
https://jaeger.dev.storj.io/trace/709f440ba29f5bd
FAIL (2026-02-07 17:32:53 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment
Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments...
Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection
Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection
Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection
Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection
Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection
Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection
Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments...
Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.495124878s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [............X...............................................] duration:
1.641667879s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:32:10 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.641696499s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................................X........X.] duration:
2.468384691s trace:
https://jaeger.dev.storj.io/trace/709f440ba29f5bd
FAIL (2026-02-07 17:31:56 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment
Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments...
Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection
Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection
Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection
Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection
Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection
Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection
Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments...
Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.468412116s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................................X........X] duration:
30.106893172s trace:
https://jaeger.dev.storj.io/trace/709f440ba29f5bd
FAIL (2026-02-07 17:31:43 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment
Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments...
Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection
Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection
Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection
Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection
Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection
Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection
Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments...
Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 30.106919912s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.............X..............................................] duration:
1.654325419s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:31:20 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.654351281s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..............X.............................................] duration:
1.661991464s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:30:21 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.662022392s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.623697765s trace:
https://jaeger.dev.storj.io/trace/23bb39a0871b9533
FAIL (2026-02-07 17:30:08 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Feb 7 17:23:54.075521957 (553h28m31.959476181s) [upload=487130]: Starting upload
Feb 7 17:23:54.075637766 (553h28m31.959591969s) [upload=487130]: Done starting upload
Feb 7 17:23:54.075838847 (553h28m31.959793041s) [upload=487130]: Uploading segments...
Feb 7 17:23:54.076065883 (553h28m31.960020086s) [upload=487130]: Got next segment. Inline: false
Feb 7 17:23:54.076155268 (553h28m31.960109474s) [upload=487130]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 7 17:23:54.076161563 (553h28m31.960115775s) [upload=487130]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 7 17:23:54.193513368 (553h28m32.077467573s) [seg_pos={0 0}, upload=487130]: Begin upload segment...
Feb 7 17:23:54.193580795 (553h28m32.077534998s) [seg_pos={0 0}, upload=487130]: Done begin upload segment.
Feb 7 17:23:54.193616356 (553h28m32.077570565s) [noise=true , address=77.90.31.10:4517 , piece_id=RBXOMN5WEL53ERYCCSVJN5ITROMIFPJ5J2N72UL7543Z4PD5HBFQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194064747 (553h28m32.078018949s) [noise=true , address=77.90.31.16:4736 , piece_id=X66CFLAEA3NKFTFT7WZEKYDKKQAVV4GIIZMMTRSN4FFGGJUJYP7Q, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194686101 (553h28m32.078640305s) [noise=true , address=45.91.116.14:4224 , piece_id=MHWHXHK6C66HCBUOPJWAODP4EUBXOWLVXHQOQ2W6RM3X2HRZ2QJQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194734477 (553h28m32.078688681s) [noise=true , address=77.90.31.13:4626 , piece_id=XUQAHZOLIZ3NKMFVKIACTTU53NUKJ4OUMHXDQVZYVLESCTKSANMA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.195457366 (553h28m32.079411569s) [noise=true , address=77.90.31.12:4589 , piece_id=HTF7EECNAJ6XHFXNGCQTRPB5Q2NIO2UKQTNOLXDCOTF33CTTDN7Q, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.196608962 (553h28m32.080563186s) [noise=true , address=79.127.219.38:4820 , piece_id=HBPNGAORZZPNGWBI5RRRBX6OIM5YHVBNJOU52YBU6UKRGMIKXVAQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.196966241 (553h28m32.080920499s) [noise=true , address=45.91.116.14:4216 , piece_id=EFO3XZUWQTNZANXQP7QCKJBHMK62V3ZWVHJJMGG36WU3CKPL5XEQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.198682509 (553h28m32.082636721s) [noise=true , address=45.91.116.9:4296 , piece_id=USUJX7YPMRHV6RYUPVGBESCNYUVAR6NVQ6O2C2QYUM57FRFP66XQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.198788570 (553h28m32.082742801s) [noise=true , address=79.127.219.46:4894 , piece_id=ZILXN3GXRPV3HJUCJZO73RKSJ243FS4XOBC7ON6NNHT3I3TA74SQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.200360324 (553h28m32.084314586s) [noise=true , address=79.127.219.41:4927 , piece_id=HU5EZU2MAAWRJOTUAS2CEDQZVUMYLYND722RHCAK7IPS3VBFOJOQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.200409466 (553h28m32.084363677s) [noise=true , address=45.91.116.11:4120 , piece_id=2UBMZX24SH3WZ5P5O26DC7ZPBKKD55NJMO4QVYHEB5W7JI4DI7IQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201001222 (553h28m32.084955435s) [noise=true , address=45.91.116.8:4079 , piece_id=4H6KYDOFCEBSCHCTAZEBCN6GGNOI3C4Q4JBKF7Y3R63AWWYVTQJA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201324789 (553h28m32.085279001s) [noise=true , address=79.127.219.41:4928 , piece_id=3PY7HCHCK2JWLBKXOMAF7CJ4XOZDBOS2I3MP4EWUCTZKI35L553A, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201852134 (553h28m32.085806346s) [noise=true , address=77.90.31.10:4519 , piece_id=EDEYJ6IPFVQID7JWW2FLGBGET4QLAQ6QSFO67OVU7S5E4ZABAOHQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.202494013 (553h28m32.086448228s) [noise=true , address=79.127.219.38:4822 , piece_id=UEHWAF2UNYTS5B4UDBYAIFP3LMDPGCPZYLUWG7A66JF6O55AUEFQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.203080395 (553h28m32.087034598s) [noise=true , address=45.91.116.13:4156 , piece_id=SMCBYGHV2SMK3R6ZHXMGTK2QHMZZG72C5PNBS6WFEAHEGO52SMTA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.806163471 (553h28m32.690117678s) [upload=487130]: Next returned nil segment
Feb 7 17:23:54.806185160 (553h28m32.690139369s) [upload=487130]: Waiting for error group managing segments...
Feb 7 17:23:54.945265982 (553h28m32.829220181s) [noise=true , address=45.91.116.13:4156 , piece_id=SMCBYGHV2SMK3R6ZHXMGTK2QHMZZG72C5PNBS6WFEAHEGO52SMTA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:54.953973810 (553h28m32.837928009s) [noise=true , address=45.91.116.11:4120 , piece_id=2UBMZX24SH3WZ5P5O26DC7ZPBKKD55NJMO4QVYHEB5W7JI4DI7IQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:54.999174204 (553h28m32.883128413s) [noise=true , address=45.91.116.8:4079 , piece_id=4H6KYDOFCEBSCHCTAZEBCN6GGNOI3C4Q4JBKF7Y3R63AWWYVTQJA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.057146471 (553h28m32.941100671s) [noise=true , address=45.91.116.14:4224 , piece_id=MHWHXHK6C66HCBUOPJWAODP4EUBXOWLVXHQOQ2W6RM3X2HRZ2QJQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.102584864 (553h28m32.986539065s) [noise=true , address=45.91.116.9:4296 , piece_id=USUJX7YPMRHV6RYUPVGBESCNYUVAR6NVQ6O2C2QYUM57FRFP66XQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.149591827 (553h28m33.033546017s) [noise=true , address=45.91.116.14:4216 , piece_id=EFO3XZUWQTNZANXQP7QCKJBHMK62V3ZWVHJJMGG36WU3CKPL5XEQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:17.067122212 (553h28m54.951076414s) [noise=true , address=79.127.219.38:4822 , piece_id=UEHWAF2UNYTS5B4UDBYAIFP3LMDPGCPZYLUWG7A66JF6O55AUEFQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:18.164317896 (553h28m56.048272094s) [noise=true , address=77.90.31.10:4519 , piece_id=EDEYJ6IPFVQID7JWW2FLGBGET4QLAQ6QSFO67OVU7S5E4ZABAOHQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.110775048 (553h28m56.994729247s) [noise=true , address=79.127.219.41:4927 , piece_id=HU5EZU2MAAWRJOTUAS2CEDQZVUMYLYND722RHCAK7IPS3VBFOJOQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.679154003 (553h28m57.563108201s) [noise=true , address=79.127.219.46:4894 , piece_id=ZILXN3GXRPV3HJUCJZO73RKSJ243FS4XOBC7ON6NNHT3I3TA74SQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.959643534 (553h28m57.843597739s) [noise=true , address=77.90.31.13:4626 , piece_id=XUQAHZOLIZ3NKMFVKIACTTU53NUKJ4OUMHXDQVZYVLESCTKSANMA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:23.585623166 (553h29m1.469577365s) [noise=true , address=77.90.31.10:4517 , piece_id=RBXOMN5WEL53ERYCCSVJN5ITROMIFPJ5J2N72UL7543Z4PD5HBFQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:23.768567723 (553h29m1.652521934s) [noise=true , address=77.90.31.16:4736 , piece_id=X66CFLAEA3NKFTFT7WZEKYDKKQAVV4GIIZMMTRSN4FFGGJUJYP7Q, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: write tcp 139.59.144.22:60130->77.90.31.16:4736: use of closed network connection; context deadline exceeded
Feb 7 17:24:23.768602947 (553h29m1.652557178s) [noise=true , address=77.90.31.12:4589 , piece_id=HTF7EECNAJ6XHFXNGCQTRPB5Q2NIO2UKQTNOLXDCOTF33CTTDN7Q, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection
Feb 7 17:24:23.769021606 (553h29m1.652975831s) [noise=true , address=79.127.219.41:4928 , piece_id=3PY7HCHCK2JWLBKXOMAF7CJ4XOZDBOS2I3MP4EWUCTZKI35L553A, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:12pvLo4F5ieDtepopg8Wi8jw6PKNeDCDvtH5iVNQXBUQwSXYxuD, address:79.127.219.41:4928): protocol: write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection; write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection
Feb 7 17:24:23.769123386 (553h29m1.653077596s) [noise=true , address=79.127.219.38:4820 , piece_id=HBPNGAORZZPNGWBI5RRRBX6OIM5YHVBNJOU52YBU6UKRGMIKXVAQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: read tcp 139.59.144.22:33950->79.127.219.38:4820: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 7 17:24:23.769163044 (553h29m1.653117254s) [seg_pos={0 0}, upload=487130]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Feb 7 17:24:23.880146456 (553h29m1.764100676s) [upload=487130]: Done uploading segments...
Feb 7 17:24:23.880195302 (553h29m1.764149504s) [upload=487130]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 2.623736295s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...............X............................................] duration:
1.702164808s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:29:51 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.702645532s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.514956245s trace:
https://jaeger.dev.storj.io/trace/23bb39a0871b9533
FAIL (2026-02-07 17:29:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Feb 7 17:23:54.075521957 (553h28m31.959476181s) [upload=487130]: Starting upload
Feb 7 17:23:54.075637766 (553h28m31.959591969s) [upload=487130]: Done starting upload
Feb 7 17:23:54.075838847 (553h28m31.959793041s) [upload=487130]: Uploading segments...
Feb 7 17:23:54.076065883 (553h28m31.960020086s) [upload=487130]: Got next segment. Inline: false
Feb 7 17:23:54.076155268 (553h28m31.960109474s) [upload=487130]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 7 17:23:54.076161563 (553h28m31.960115775s) [upload=487130]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 7 17:23:54.193513368 (553h28m32.077467573s) [seg_pos={0 0}, upload=487130]: Begin upload segment...
Feb 7 17:23:54.193580795 (553h28m32.077534998s) [seg_pos={0 0}, upload=487130]: Done begin upload segment.
Feb 7 17:23:54.193616356 (553h28m32.077570565s) [noise=true , address=77.90.31.10:4517 , piece_id=RBXOMN5WEL53ERYCCSVJN5ITROMIFPJ5J2N72UL7543Z4PD5HBFQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194064747 (553h28m32.078018949s) [noise=true , address=77.90.31.16:4736 , piece_id=X66CFLAEA3NKFTFT7WZEKYDKKQAVV4GIIZMMTRSN4FFGGJUJYP7Q, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194686101 (553h28m32.078640305s) [noise=true , address=45.91.116.14:4224 , piece_id=MHWHXHK6C66HCBUOPJWAODP4EUBXOWLVXHQOQ2W6RM3X2HRZ2QJQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194734477 (553h28m32.078688681s) [noise=true , address=77.90.31.13:4626 , piece_id=XUQAHZOLIZ3NKMFVKIACTTU53NUKJ4OUMHXDQVZYVLESCTKSANMA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.195457366 (553h28m32.079411569s) [noise=true , address=77.90.31.12:4589 , piece_id=HTF7EECNAJ6XHFXNGCQTRPB5Q2NIO2UKQTNOLXDCOTF33CTTDN7Q, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.196608962 (553h28m32.080563186s) [noise=true , address=79.127.219.38:4820 , piece_id=HBPNGAORZZPNGWBI5RRRBX6OIM5YHVBNJOU52YBU6UKRGMIKXVAQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.196966241 (553h28m32.080920499s) [noise=true , address=45.91.116.14:4216 , piece_id=EFO3XZUWQTNZANXQP7QCKJBHMK62V3ZWVHJJMGG36WU3CKPL5XEQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.198682509 (553h28m32.082636721s) [noise=true , address=45.91.116.9:4296 , piece_id=USUJX7YPMRHV6RYUPVGBESCNYUVAR6NVQ6O2C2QYUM57FRFP66XQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.198788570 (553h28m32.082742801s) [noise=true , address=79.127.219.46:4894 , piece_id=ZILXN3GXRPV3HJUCJZO73RKSJ243FS4XOBC7ON6NNHT3I3TA74SQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.200360324 (553h28m32.084314586s) [noise=true , address=79.127.219.41:4927 , piece_id=HU5EZU2MAAWRJOTUAS2CEDQZVUMYLYND722RHCAK7IPS3VBFOJOQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.200409466 (553h28m32.084363677s) [noise=true , address=45.91.116.11:4120 , piece_id=2UBMZX24SH3WZ5P5O26DC7ZPBKKD55NJMO4QVYHEB5W7JI4DI7IQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201001222 (553h28m32.084955435s) [noise=true , address=45.91.116.8:4079 , piece_id=4H6KYDOFCEBSCHCTAZEBCN6GGNOI3C4Q4JBKF7Y3R63AWWYVTQJA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201324789 (553h28m32.085279001s) [noise=true , address=79.127.219.41:4928 , piece_id=3PY7HCHCK2JWLBKXOMAF7CJ4XOZDBOS2I3MP4EWUCTZKI35L553A, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201852134 (553h28m32.085806346s) [noise=true , address=77.90.31.10:4519 , piece_id=EDEYJ6IPFVQID7JWW2FLGBGET4QLAQ6QSFO67OVU7S5E4ZABAOHQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.202494013 (553h28m32.086448228s) [noise=true , address=79.127.219.38:4822 , piece_id=UEHWAF2UNYTS5B4UDBYAIFP3LMDPGCPZYLUWG7A66JF6O55AUEFQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.203080395 (553h28m32.087034598s) [noise=true , address=45.91.116.13:4156 , piece_id=SMCBYGHV2SMK3R6ZHXMGTK2QHMZZG72C5PNBS6WFEAHEGO52SMTA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.806163471 (553h28m32.690117678s) [upload=487130]: Next returned nil segment
Feb 7 17:23:54.806185160 (553h28m32.690139369s) [upload=487130]: Waiting for error group managing segments...
Feb 7 17:23:54.945265982 (553h28m32.829220181s) [noise=true , address=45.91.116.13:4156 , piece_id=SMCBYGHV2SMK3R6ZHXMGTK2QHMZZG72C5PNBS6WFEAHEGO52SMTA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:54.953973810 (553h28m32.837928009s) [noise=true , address=45.91.116.11:4120 , piece_id=2UBMZX24SH3WZ5P5O26DC7ZPBKKD55NJMO4QVYHEB5W7JI4DI7IQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:54.999174204 (553h28m32.883128413s) [noise=true , address=45.91.116.8:4079 , piece_id=4H6KYDOFCEBSCHCTAZEBCN6GGNOI3C4Q4JBKF7Y3R63AWWYVTQJA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.057146471 (553h28m32.941100671s) [noise=true , address=45.91.116.14:4224 , piece_id=MHWHXHK6C66HCBUOPJWAODP4EUBXOWLVXHQOQ2W6RM3X2HRZ2QJQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.102584864 (553h28m32.986539065s) [noise=true , address=45.91.116.9:4296 , piece_id=USUJX7YPMRHV6RYUPVGBESCNYUVAR6NVQ6O2C2QYUM57FRFP66XQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.149591827 (553h28m33.033546017s) [noise=true , address=45.91.116.14:4216 , piece_id=EFO3XZUWQTNZANXQP7QCKJBHMK62V3ZWVHJJMGG36WU3CKPL5XEQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:17.067122212 (553h28m54.951076414s) [noise=true , address=79.127.219.38:4822 , piece_id=UEHWAF2UNYTS5B4UDBYAIFP3LMDPGCPZYLUWG7A66JF6O55AUEFQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:18.164317896 (553h28m56.048272094s) [noise=true , address=77.90.31.10:4519 , piece_id=EDEYJ6IPFVQID7JWW2FLGBGET4QLAQ6QSFO67OVU7S5E4ZABAOHQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.110775048 (553h28m56.994729247s) [noise=true , address=79.127.219.41:4927 , piece_id=HU5EZU2MAAWRJOTUAS2CEDQZVUMYLYND722RHCAK7IPS3VBFOJOQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.679154003 (553h28m57.563108201s) [noise=true , address=79.127.219.46:4894 , piece_id=ZILXN3GXRPV3HJUCJZO73RKSJ243FS4XOBC7ON6NNHT3I3TA74SQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.959643534 (553h28m57.843597739s) [noise=true , address=77.90.31.13:4626 , piece_id=XUQAHZOLIZ3NKMFVKIACTTU53NUKJ4OUMHXDQVZYVLESCTKSANMA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:23.585623166 (553h29m1.469577365s) [noise=true , address=77.90.31.10:4517 , piece_id=RBXOMN5WEL53ERYCCSVJN5ITROMIFPJ5J2N72UL7543Z4PD5HBFQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:23.768567723 (553h29m1.652521934s) [noise=true , address=77.90.31.16:4736 , piece_id=X66CFLAEA3NKFTFT7WZEKYDKKQAVV4GIIZMMTRSN4FFGGJUJYP7Q, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: write tcp 139.59.144.22:60130->77.90.31.16:4736: use of closed network connection; context deadline exceeded
Feb 7 17:24:23.768602947 (553h29m1.652557178s) [noise=true , address=77.90.31.12:4589 , piece_id=HTF7EECNAJ6XHFXNGCQTRPB5Q2NIO2UKQTNOLXDCOTF33CTTDN7Q, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection
Feb 7 17:24:23.769021606 (553h29m1.652975831s) [noise=true , address=79.127.219.41:4928 , piece_id=3PY7HCHCK2JWLBKXOMAF7CJ4XOZDBOS2I3MP4EWUCTZKI35L553A, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:12pvLo4F5ieDtepopg8Wi8jw6PKNeDCDvtH5iVNQXBUQwSXYxuD, address:79.127.219.41:4928): protocol: write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection; write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection
Feb 7 17:24:23.769123386 (553h29m1.653077596s) [noise=true , address=79.127.219.38:4820 , piece_id=HBPNGAORZZPNGWBI5RRRBX6OIM5YHVBNJOU52YBU6UKRGMIKXVAQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: read tcp 139.59.144.22:33950->79.127.219.38:4820: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 7 17:24:23.769163044 (553h29m1.653117254s) [seg_pos={0 0}, upload=487130]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Feb 7 17:24:23.880146456 (553h29m1.764100676s) [upload=487130]: Done uploading segments...
Feb 7 17:24:23.880195302 (553h29m1.764149504s) [upload=487130]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 2.514980306s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [................X...........................................] duration:
1.67993085s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:29:08 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.679954235s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.470611753s trace:
https://jaeger.dev.storj.io/trace/23bb39a0871b9533
FAIL (2026-02-07 17:28:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Feb 7 17:23:54.075521957 (553h28m31.959476181s) [upload=487130]: Starting upload
Feb 7 17:23:54.075637766 (553h28m31.959591969s) [upload=487130]: Done starting upload
Feb 7 17:23:54.075838847 (553h28m31.959793041s) [upload=487130]: Uploading segments...
Feb 7 17:23:54.076065883 (553h28m31.960020086s) [upload=487130]: Got next segment. Inline: false
Feb 7 17:23:54.076155268 (553h28m31.960109474s) [upload=487130]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 7 17:23:54.076161563 (553h28m31.960115775s) [upload=487130]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 7 17:23:54.193513368 (553h28m32.077467573s) [seg_pos={0 0}, upload=487130]: Begin upload segment...
Feb 7 17:23:54.193580795 (553h28m32.077534998s) [seg_pos={0 0}, upload=487130]: Done begin upload segment.
Feb 7 17:23:54.193616356 (553h28m32.077570565s) [noise=true , address=77.90.31.10:4517 , piece_id=RBXOMN5WEL53ERYCCSVJN5ITROMIFPJ5J2N72UL7543Z4PD5HBFQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194064747 (553h28m32.078018949s) [noise=true , address=77.90.31.16:4736 , piece_id=X66CFLAEA3NKFTFT7WZEKYDKKQAVV4GIIZMMTRSN4FFGGJUJYP7Q, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194686101 (553h28m32.078640305s) [noise=true , address=45.91.116.14:4224 , piece_id=MHWHXHK6C66HCBUOPJWAODP4EUBXOWLVXHQOQ2W6RM3X2HRZ2QJQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194734477 (553h28m32.078688681s) [noise=true , address=77.90.31.13:4626 , piece_id=XUQAHZOLIZ3NKMFVKIACTTU53NUKJ4OUMHXDQVZYVLESCTKSANMA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.195457366 (553h28m32.079411569s) [noise=true , address=77.90.31.12:4589 , piece_id=HTF7EECNAJ6XHFXNGCQTRPB5Q2NIO2UKQTNOLXDCOTF33CTTDN7Q, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.196608962 (553h28m32.080563186s) [noise=true , address=79.127.219.38:4820 , piece_id=HBPNGAORZZPNGWBI5RRRBX6OIM5YHVBNJOU52YBU6UKRGMIKXVAQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.196966241 (553h28m32.080920499s) [noise=true , address=45.91.116.14:4216 , piece_id=EFO3XZUWQTNZANXQP7QCKJBHMK62V3ZWVHJJMGG36WU3CKPL5XEQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.198682509 (553h28m32.082636721s) [noise=true , address=45.91.116.9:4296 , piece_id=USUJX7YPMRHV6RYUPVGBESCNYUVAR6NVQ6O2C2QYUM57FRFP66XQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.198788570 (553h28m32.082742801s) [noise=true , address=79.127.219.46:4894 , piece_id=ZILXN3GXRPV3HJUCJZO73RKSJ243FS4XOBC7ON6NNHT3I3TA74SQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.200360324 (553h28m32.084314586s) [noise=true , address=79.127.219.41:4927 , piece_id=HU5EZU2MAAWRJOTUAS2CEDQZVUMYLYND722RHCAK7IPS3VBFOJOQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.200409466 (553h28m32.084363677s) [noise=true , address=45.91.116.11:4120 , piece_id=2UBMZX24SH3WZ5P5O26DC7ZPBKKD55NJMO4QVYHEB5W7JI4DI7IQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201001222 (553h28m32.084955435s) [noise=true , address=45.91.116.8:4079 , piece_id=4H6KYDOFCEBSCHCTAZEBCN6GGNOI3C4Q4JBKF7Y3R63AWWYVTQJA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201324789 (553h28m32.085279001s) [noise=true , address=79.127.219.41:4928 , piece_id=3PY7HCHCK2JWLBKXOMAF7CJ4XOZDBOS2I3MP4EWUCTZKI35L553A, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201852134 (553h28m32.085806346s) [noise=true , address=77.90.31.10:4519 , piece_id=EDEYJ6IPFVQID7JWW2FLGBGET4QLAQ6QSFO67OVU7S5E4ZABAOHQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.202494013 (553h28m32.086448228s) [noise=true , address=79.127.219.38:4822 , piece_id=UEHWAF2UNYTS5B4UDBYAIFP3LMDPGCPZYLUWG7A66JF6O55AUEFQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.203080395 (553h28m32.087034598s) [noise=true , address=45.91.116.13:4156 , piece_id=SMCBYGHV2SMK3R6ZHXMGTK2QHMZZG72C5PNBS6WFEAHEGO52SMTA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.806163471 (553h28m32.690117678s) [upload=487130]: Next returned nil segment
Feb 7 17:23:54.806185160 (553h28m32.690139369s) [upload=487130]: Waiting for error group managing segments...
Feb 7 17:23:54.945265982 (553h28m32.829220181s) [noise=true , address=45.91.116.13:4156 , piece_id=SMCBYGHV2SMK3R6ZHXMGTK2QHMZZG72C5PNBS6WFEAHEGO52SMTA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:54.953973810 (553h28m32.837928009s) [noise=true , address=45.91.116.11:4120 , piece_id=2UBMZX24SH3WZ5P5O26DC7ZPBKKD55NJMO4QVYHEB5W7JI4DI7IQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:54.999174204 (553h28m32.883128413s) [noise=true , address=45.91.116.8:4079 , piece_id=4H6KYDOFCEBSCHCTAZEBCN6GGNOI3C4Q4JBKF7Y3R63AWWYVTQJA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.057146471 (553h28m32.941100671s) [noise=true , address=45.91.116.14:4224 , piece_id=MHWHXHK6C66HCBUOPJWAODP4EUBXOWLVXHQOQ2W6RM3X2HRZ2QJQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.102584864 (553h28m32.986539065s) [noise=true , address=45.91.116.9:4296 , piece_id=USUJX7YPMRHV6RYUPVGBESCNYUVAR6NVQ6O2C2QYUM57FRFP66XQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.149591827 (553h28m33.033546017s) [noise=true , address=45.91.116.14:4216 , piece_id=EFO3XZUWQTNZANXQP7QCKJBHMK62V3ZWVHJJMGG36WU3CKPL5XEQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:17.067122212 (553h28m54.951076414s) [noise=true , address=79.127.219.38:4822 , piece_id=UEHWAF2UNYTS5B4UDBYAIFP3LMDPGCPZYLUWG7A66JF6O55AUEFQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:18.164317896 (553h28m56.048272094s) [noise=true , address=77.90.31.10:4519 , piece_id=EDEYJ6IPFVQID7JWW2FLGBGET4QLAQ6QSFO67OVU7S5E4ZABAOHQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.110775048 (553h28m56.994729247s) [noise=true , address=79.127.219.41:4927 , piece_id=HU5EZU2MAAWRJOTUAS2CEDQZVUMYLYND722RHCAK7IPS3VBFOJOQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.679154003 (553h28m57.563108201s) [noise=true , address=79.127.219.46:4894 , piece_id=ZILXN3GXRPV3HJUCJZO73RKSJ243FS4XOBC7ON6NNHT3I3TA74SQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.959643534 (553h28m57.843597739s) [noise=true , address=77.90.31.13:4626 , piece_id=XUQAHZOLIZ3NKMFVKIACTTU53NUKJ4OUMHXDQVZYVLESCTKSANMA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:23.585623166 (553h29m1.469577365s) [noise=true , address=77.90.31.10:4517 , piece_id=RBXOMN5WEL53ERYCCSVJN5ITROMIFPJ5J2N72UL7543Z4PD5HBFQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:23.768567723 (553h29m1.652521934s) [noise=true , address=77.90.31.16:4736 , piece_id=X66CFLAEA3NKFTFT7WZEKYDKKQAVV4GIIZMMTRSN4FFGGJUJYP7Q, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: write tcp 139.59.144.22:60130->77.90.31.16:4736: use of closed network connection; context deadline exceeded
Feb 7 17:24:23.768602947 (553h29m1.652557178s) [noise=true , address=77.90.31.12:4589 , piece_id=HTF7EECNAJ6XHFXNGCQTRPB5Q2NIO2UKQTNOLXDCOTF33CTTDN7Q, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection
Feb 7 17:24:23.769021606 (553h29m1.652975831s) [noise=true , address=79.127.219.41:4928 , piece_id=3PY7HCHCK2JWLBKXOMAF7CJ4XOZDBOS2I3MP4EWUCTZKI35L553A, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:12pvLo4F5ieDtepopg8Wi8jw6PKNeDCDvtH5iVNQXBUQwSXYxuD, address:79.127.219.41:4928): protocol: write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection; write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection
Feb 7 17:24:23.769123386 (553h29m1.653077596s) [noise=true , address=79.127.219.38:4820 , piece_id=HBPNGAORZZPNGWBI5RRRBX6OIM5YHVBNJOU52YBU6UKRGMIKXVAQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: read tcp 139.59.144.22:33950->79.127.219.38:4820: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 7 17:24:23.769163044 (553h29m1.653117254s) [seg_pos={0 0}, upload=487130]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Feb 7 17:24:23.880146456 (553h29m1.764100676s) [upload=487130]: Done uploading segments...
Feb 7 17:24:23.880195302 (553h29m1.764149504s) [upload=487130]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 2.470638781s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.551774843s trace:
https://jaeger.dev.storj.io/trace/23bb39a0871b9533
FAIL (2026-02-07 17:28:36 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Feb 7 17:23:54.075521957 (553h28m31.959476181s) [upload=487130]: Starting upload
Feb 7 17:23:54.075637766 (553h28m31.959591969s) [upload=487130]: Done starting upload
Feb 7 17:23:54.075838847 (553h28m31.959793041s) [upload=487130]: Uploading segments...
Feb 7 17:23:54.076065883 (553h28m31.960020086s) [upload=487130]: Got next segment. Inline: false
Feb 7 17:23:54.076155268 (553h28m31.960109474s) [upload=487130]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 7 17:23:54.076161563 (553h28m31.960115775s) [upload=487130]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 7 17:23:54.193513368 (553h28m32.077467573s) [seg_pos={0 0}, upload=487130]: Begin upload segment...
Feb 7 17:23:54.193580795 (553h28m32.077534998s) [seg_pos={0 0}, upload=487130]: Done begin upload segment.
Feb 7 17:23:54.193616356 (553h28m32.077570565s) [noise=true , address=77.90.31.10:4517 , piece_id=RBXOMN5WEL53ERYCCSVJN5ITROMIFPJ5J2N72UL7543Z4PD5HBFQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194064747 (553h28m32.078018949s) [noise=true , address=77.90.31.16:4736 , piece_id=X66CFLAEA3NKFTFT7WZEKYDKKQAVV4GIIZMMTRSN4FFGGJUJYP7Q, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194686101 (553h28m32.078640305s) [noise=true , address=45.91.116.14:4224 , piece_id=MHWHXHK6C66HCBUOPJWAODP4EUBXOWLVXHQOQ2W6RM3X2HRZ2QJQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194734477 (553h28m32.078688681s) [noise=true , address=77.90.31.13:4626 , piece_id=XUQAHZOLIZ3NKMFVKIACTTU53NUKJ4OUMHXDQVZYVLESCTKSANMA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.195457366 (553h28m32.079411569s) [noise=true , address=77.90.31.12:4589 , piece_id=HTF7EECNAJ6XHFXNGCQTRPB5Q2NIO2UKQTNOLXDCOTF33CTTDN7Q, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.196608962 (553h28m32.080563186s) [noise=true , address=79.127.219.38:4820 , piece_id=HBPNGAORZZPNGWBI5RRRBX6OIM5YHVBNJOU52YBU6UKRGMIKXVAQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.196966241 (553h28m32.080920499s) [noise=true , address=45.91.116.14:4216 , piece_id=EFO3XZUWQTNZANXQP7QCKJBHMK62V3ZWVHJJMGG36WU3CKPL5XEQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.198682509 (553h28m32.082636721s) [noise=true , address=45.91.116.9:4296 , piece_id=USUJX7YPMRHV6RYUPVGBESCNYUVAR6NVQ6O2C2QYUM57FRFP66XQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.198788570 (553h28m32.082742801s) [noise=true , address=79.127.219.46:4894 , piece_id=ZILXN3GXRPV3HJUCJZO73RKSJ243FS4XOBC7ON6NNHT3I3TA74SQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.200360324 (553h28m32.084314586s) [noise=true , address=79.127.219.41:4927 , piece_id=HU5EZU2MAAWRJOTUAS2CEDQZVUMYLYND722RHCAK7IPS3VBFOJOQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.200409466 (553h28m32.084363677s) [noise=true , address=45.91.116.11:4120 , piece_id=2UBMZX24SH3WZ5P5O26DC7ZPBKKD55NJMO4QVYHEB5W7JI4DI7IQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201001222 (553h28m32.084955435s) [noise=true , address=45.91.116.8:4079 , piece_id=4H6KYDOFCEBSCHCTAZEBCN6GGNOI3C4Q4JBKF7Y3R63AWWYVTQJA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201324789 (553h28m32.085279001s) [noise=true , address=79.127.219.41:4928 , piece_id=3PY7HCHCK2JWLBKXOMAF7CJ4XOZDBOS2I3MP4EWUCTZKI35L553A, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201852134 (553h28m32.085806346s) [noise=true , address=77.90.31.10:4519 , piece_id=EDEYJ6IPFVQID7JWW2FLGBGET4QLAQ6QSFO67OVU7S5E4ZABAOHQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.202494013 (553h28m32.086448228s) [noise=true , address=79.127.219.38:4822 , piece_id=UEHWAF2UNYTS5B4UDBYAIFP3LMDPGCPZYLUWG7A66JF6O55AUEFQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.203080395 (553h28m32.087034598s) [noise=true , address=45.91.116.13:4156 , piece_id=SMCBYGHV2SMK3R6ZHXMGTK2QHMZZG72C5PNBS6WFEAHEGO52SMTA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.806163471 (553h28m32.690117678s) [upload=487130]: Next returned nil segment
Feb 7 17:23:54.806185160 (553h28m32.690139369s) [upload=487130]: Waiting for error group managing segments...
Feb 7 17:23:54.945265982 (553h28m32.829220181s) [noise=true , address=45.91.116.13:4156 , piece_id=SMCBYGHV2SMK3R6ZHXMGTK2QHMZZG72C5PNBS6WFEAHEGO52SMTA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:54.953973810 (553h28m32.837928009s) [noise=true , address=45.91.116.11:4120 , piece_id=2UBMZX24SH3WZ5P5O26DC7ZPBKKD55NJMO4QVYHEB5W7JI4DI7IQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:54.999174204 (553h28m32.883128413s) [noise=true , address=45.91.116.8:4079 , piece_id=4H6KYDOFCEBSCHCTAZEBCN6GGNOI3C4Q4JBKF7Y3R63AWWYVTQJA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.057146471 (553h28m32.941100671s) [noise=true , address=45.91.116.14:4224 , piece_id=MHWHXHK6C66HCBUOPJWAODP4EUBXOWLVXHQOQ2W6RM3X2HRZ2QJQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.102584864 (553h28m32.986539065s) [noise=true , address=45.91.116.9:4296 , piece_id=USUJX7YPMRHV6RYUPVGBESCNYUVAR6NVQ6O2C2QYUM57FRFP66XQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.149591827 (553h28m33.033546017s) [noise=true , address=45.91.116.14:4216 , piece_id=EFO3XZUWQTNZANXQP7QCKJBHMK62V3ZWVHJJMGG36WU3CKPL5XEQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:17.067122212 (553h28m54.951076414s) [noise=true , address=79.127.219.38:4822 , piece_id=UEHWAF2UNYTS5B4UDBYAIFP3LMDPGCPZYLUWG7A66JF6O55AUEFQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:18.164317896 (553h28m56.048272094s) [noise=true , address=77.90.31.10:4519 , piece_id=EDEYJ6IPFVQID7JWW2FLGBGET4QLAQ6QSFO67OVU7S5E4ZABAOHQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.110775048 (553h28m56.994729247s) [noise=true , address=79.127.219.41:4927 , piece_id=HU5EZU2MAAWRJOTUAS2CEDQZVUMYLYND722RHCAK7IPS3VBFOJOQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.679154003 (553h28m57.563108201s) [noise=true , address=79.127.219.46:4894 , piece_id=ZILXN3GXRPV3HJUCJZO73RKSJ243FS4XOBC7ON6NNHT3I3TA74SQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.959643534 (553h28m57.843597739s) [noise=true , address=77.90.31.13:4626 , piece_id=XUQAHZOLIZ3NKMFVKIACTTU53NUKJ4OUMHXDQVZYVLESCTKSANMA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:23.585623166 (553h29m1.469577365s) [noise=true , address=77.90.31.10:4517 , piece_id=RBXOMN5WEL53ERYCCSVJN5ITROMIFPJ5J2N72UL7543Z4PD5HBFQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:23.768567723 (553h29m1.652521934s) [noise=true , address=77.90.31.16:4736 , piece_id=X66CFLAEA3NKFTFT7WZEKYDKKQAVV4GIIZMMTRSN4FFGGJUJYP7Q, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: write tcp 139.59.144.22:60130->77.90.31.16:4736: use of closed network connection; context deadline exceeded
Feb 7 17:24:23.768602947 (553h29m1.652557178s) [noise=true , address=77.90.31.12:4589 , piece_id=HTF7EECNAJ6XHFXNGCQTRPB5Q2NIO2UKQTNOLXDCOTF33CTTDN7Q, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection
Feb 7 17:24:23.769021606 (553h29m1.652975831s) [noise=true , address=79.127.219.41:4928 , piece_id=3PY7HCHCK2JWLBKXOMAF7CJ4XOZDBOS2I3MP4EWUCTZKI35L553A, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:12pvLo4F5ieDtepopg8Wi8jw6PKNeDCDvtH5iVNQXBUQwSXYxuD, address:79.127.219.41:4928): protocol: write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection; write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection
Feb 7 17:24:23.769123386 (553h29m1.653077596s) [noise=true , address=79.127.219.38:4820 , piece_id=HBPNGAORZZPNGWBI5RRRBX6OIM5YHVBNJOU52YBU6UKRGMIKXVAQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: read tcp 139.59.144.22:33950->79.127.219.38:4820: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 7 17:24:23.769163044 (553h29m1.653117254s) [seg_pos={0 0}, upload=487130]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Feb 7 17:24:23.880146456 (553h29m1.764100676s) [upload=487130]: Done uploading segments...
Feb 7 17:24:23.880195302 (553h29m1.764149504s) [upload=487130]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 2.551815321s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.................X..........................................] duration:
1.628912494s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:27:57 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.628941158s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.590934926s trace:
https://jaeger.dev.storj.io/trace/23bb39a0871b9533
FAIL (2026-02-07 17:27:26 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Feb 7 17:23:54.075521957 (553h28m31.959476181s) [upload=487130]: Starting upload
Feb 7 17:23:54.075637766 (553h28m31.959591969s) [upload=487130]: Done starting upload
Feb 7 17:23:54.075838847 (553h28m31.959793041s) [upload=487130]: Uploading segments...
Feb 7 17:23:54.076065883 (553h28m31.960020086s) [upload=487130]: Got next segment. Inline: false
Feb 7 17:23:54.076155268 (553h28m31.960109474s) [upload=487130]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 7 17:23:54.076161563 (553h28m31.960115775s) [upload=487130]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 7 17:23:54.193513368 (553h28m32.077467573s) [seg_pos={0 0}, upload=487130]: Begin upload segment...
Feb 7 17:23:54.193580795 (553h28m32.077534998s) [seg_pos={0 0}, upload=487130]: Done begin upload segment.
Feb 7 17:23:54.193616356 (553h28m32.077570565s) [noise=true , address=77.90.31.10:4517 , piece_id=RBXOMN5WEL53ERYCCSVJN5ITROMIFPJ5J2N72UL7543Z4PD5HBFQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194064747 (553h28m32.078018949s) [noise=true , address=77.90.31.16:4736 , piece_id=X66CFLAEA3NKFTFT7WZEKYDKKQAVV4GIIZMMTRSN4FFGGJUJYP7Q, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194686101 (553h28m32.078640305s) [noise=true , address=45.91.116.14:4224 , piece_id=MHWHXHK6C66HCBUOPJWAODP4EUBXOWLVXHQOQ2W6RM3X2HRZ2QJQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194734477 (553h28m32.078688681s) [noise=true , address=77.90.31.13:4626 , piece_id=XUQAHZOLIZ3NKMFVKIACTTU53NUKJ4OUMHXDQVZYVLESCTKSANMA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.195457366 (553h28m32.079411569s) [noise=true , address=77.90.31.12:4589 , piece_id=HTF7EECNAJ6XHFXNGCQTRPB5Q2NIO2UKQTNOLXDCOTF33CTTDN7Q, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.196608962 (553h28m32.080563186s) [noise=true , address=79.127.219.38:4820 , piece_id=HBPNGAORZZPNGWBI5RRRBX6OIM5YHVBNJOU52YBU6UKRGMIKXVAQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.196966241 (553h28m32.080920499s) [noise=true , address=45.91.116.14:4216 , piece_id=EFO3XZUWQTNZANXQP7QCKJBHMK62V3ZWVHJJMGG36WU3CKPL5XEQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.198682509 (553h28m32.082636721s) [noise=true , address=45.91.116.9:4296 , piece_id=USUJX7YPMRHV6RYUPVGBESCNYUVAR6NVQ6O2C2QYUM57FRFP66XQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.198788570 (553h28m32.082742801s) [noise=true , address=79.127.219.46:4894 , piece_id=ZILXN3GXRPV3HJUCJZO73RKSJ243FS4XOBC7ON6NNHT3I3TA74SQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.200360324 (553h28m32.084314586s) [noise=true , address=79.127.219.41:4927 , piece_id=HU5EZU2MAAWRJOTUAS2CEDQZVUMYLYND722RHCAK7IPS3VBFOJOQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.200409466 (553h28m32.084363677s) [noise=true , address=45.91.116.11:4120 , piece_id=2UBMZX24SH3WZ5P5O26DC7ZPBKKD55NJMO4QVYHEB5W7JI4DI7IQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201001222 (553h28m32.084955435s) [noise=true , address=45.91.116.8:4079 , piece_id=4H6KYDOFCEBSCHCTAZEBCN6GGNOI3C4Q4JBKF7Y3R63AWWYVTQJA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201324789 (553h28m32.085279001s) [noise=true , address=79.127.219.41:4928 , piece_id=3PY7HCHCK2JWLBKXOMAF7CJ4XOZDBOS2I3MP4EWUCTZKI35L553A, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201852134 (553h28m32.085806346s) [noise=true , address=77.90.31.10:4519 , piece_id=EDEYJ6IPFVQID7JWW2FLGBGET4QLAQ6QSFO67OVU7S5E4ZABAOHQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.202494013 (553h28m32.086448228s) [noise=true , address=79.127.219.38:4822 , piece_id=UEHWAF2UNYTS5B4UDBYAIFP3LMDPGCPZYLUWG7A66JF6O55AUEFQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.203080395 (553h28m32.087034598s) [noise=true , address=45.91.116.13:4156 , piece_id=SMCBYGHV2SMK3R6ZHXMGTK2QHMZZG72C5PNBS6WFEAHEGO52SMTA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.806163471 (553h28m32.690117678s) [upload=487130]: Next returned nil segment
Feb 7 17:23:54.806185160 (553h28m32.690139369s) [upload=487130]: Waiting for error group managing segments...
Feb 7 17:23:54.945265982 (553h28m32.829220181s) [noise=true , address=45.91.116.13:4156 , piece_id=SMCBYGHV2SMK3R6ZHXMGTK2QHMZZG72C5PNBS6WFEAHEGO52SMTA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:54.953973810 (553h28m32.837928009s) [noise=true , address=45.91.116.11:4120 , piece_id=2UBMZX24SH3WZ5P5O26DC7ZPBKKD55NJMO4QVYHEB5W7JI4DI7IQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:54.999174204 (553h28m32.883128413s) [noise=true , address=45.91.116.8:4079 , piece_id=4H6KYDOFCEBSCHCTAZEBCN6GGNOI3C4Q4JBKF7Y3R63AWWYVTQJA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.057146471 (553h28m32.941100671s) [noise=true , address=45.91.116.14:4224 , piece_id=MHWHXHK6C66HCBUOPJWAODP4EUBXOWLVXHQOQ2W6RM3X2HRZ2QJQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.102584864 (553h28m32.986539065s) [noise=true , address=45.91.116.9:4296 , piece_id=USUJX7YPMRHV6RYUPVGBESCNYUVAR6NVQ6O2C2QYUM57FRFP66XQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.149591827 (553h28m33.033546017s) [noise=true , address=45.91.116.14:4216 , piece_id=EFO3XZUWQTNZANXQP7QCKJBHMK62V3ZWVHJJMGG36WU3CKPL5XEQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:17.067122212 (553h28m54.951076414s) [noise=true , address=79.127.219.38:4822 , piece_id=UEHWAF2UNYTS5B4UDBYAIFP3LMDPGCPZYLUWG7A66JF6O55AUEFQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:18.164317896 (553h28m56.048272094s) [noise=true , address=77.90.31.10:4519 , piece_id=EDEYJ6IPFVQID7JWW2FLGBGET4QLAQ6QSFO67OVU7S5E4ZABAOHQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.110775048 (553h28m56.994729247s) [noise=true , address=79.127.219.41:4927 , piece_id=HU5EZU2MAAWRJOTUAS2CEDQZVUMYLYND722RHCAK7IPS3VBFOJOQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.679154003 (553h28m57.563108201s) [noise=true , address=79.127.219.46:4894 , piece_id=ZILXN3GXRPV3HJUCJZO73RKSJ243FS4XOBC7ON6NNHT3I3TA74SQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.959643534 (553h28m57.843597739s) [noise=true , address=77.90.31.13:4626 , piece_id=XUQAHZOLIZ3NKMFVKIACTTU53NUKJ4OUMHXDQVZYVLESCTKSANMA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:23.585623166 (553h29m1.469577365s) [noise=true , address=77.90.31.10:4517 , piece_id=RBXOMN5WEL53ERYCCSVJN5ITROMIFPJ5J2N72UL7543Z4PD5HBFQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:23.768567723 (553h29m1.652521934s) [noise=true , address=77.90.31.16:4736 , piece_id=X66CFLAEA3NKFTFT7WZEKYDKKQAVV4GIIZMMTRSN4FFGGJUJYP7Q, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: write tcp 139.59.144.22:60130->77.90.31.16:4736: use of closed network connection; context deadline exceeded
Feb 7 17:24:23.768602947 (553h29m1.652557178s) [noise=true , address=77.90.31.12:4589 , piece_id=HTF7EECNAJ6XHFXNGCQTRPB5Q2NIO2UKQTNOLXDCOTF33CTTDN7Q, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection
Feb 7 17:24:23.769021606 (553h29m1.652975831s) [noise=true , address=79.127.219.41:4928 , piece_id=3PY7HCHCK2JWLBKXOMAF7CJ4XOZDBOS2I3MP4EWUCTZKI35L553A, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:12pvLo4F5ieDtepopg8Wi8jw6PKNeDCDvtH5iVNQXBUQwSXYxuD, address:79.127.219.41:4928): protocol: write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection; write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection
Feb 7 17:24:23.769123386 (553h29m1.653077596s) [noise=true , address=79.127.219.38:4820 , piece_id=HBPNGAORZZPNGWBI5RRRBX6OIM5YHVBNJOU52YBU6UKRGMIKXVAQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: read tcp 139.59.144.22:33950->79.127.219.38:4820: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 7 17:24:23.769163044 (553h29m1.653117254s) [seg_pos={0 0}, upload=487130]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Feb 7 17:24:23.880146456 (553h29m1.764100676s) [upload=487130]: Done uploading segments...
Feb 7 17:24:23.880195302 (553h29m1.764149504s) [upload=487130]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 2.590963041s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.520537225s trace:
https://jaeger.dev.storj.io/trace/23bb39a0871b9533
FAIL (2026-02-07 17:26:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Feb 7 17:23:54.075521957 (553h28m31.959476181s) [upload=487130]: Starting upload
Feb 7 17:23:54.075637766 (553h28m31.959591969s) [upload=487130]: Done starting upload
Feb 7 17:23:54.075838847 (553h28m31.959793041s) [upload=487130]: Uploading segments...
Feb 7 17:23:54.076065883 (553h28m31.960020086s) [upload=487130]: Got next segment. Inline: false
Feb 7 17:23:54.076155268 (553h28m31.960109474s) [upload=487130]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 7 17:23:54.076161563 (553h28m31.960115775s) [upload=487130]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 7 17:23:54.193513368 (553h28m32.077467573s) [seg_pos={0 0}, upload=487130]: Begin upload segment...
Feb 7 17:23:54.193580795 (553h28m32.077534998s) [seg_pos={0 0}, upload=487130]: Done begin upload segment.
Feb 7 17:23:54.193616356 (553h28m32.077570565s) [noise=true , address=77.90.31.10:4517 , piece_id=RBXOMN5WEL53ERYCCSVJN5ITROMIFPJ5J2N72UL7543Z4PD5HBFQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194064747 (553h28m32.078018949s) [noise=true , address=77.90.31.16:4736 , piece_id=X66CFLAEA3NKFTFT7WZEKYDKKQAVV4GIIZMMTRSN4FFGGJUJYP7Q, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194686101 (553h28m32.078640305s) [noise=true , address=45.91.116.14:4224 , piece_id=MHWHXHK6C66HCBUOPJWAODP4EUBXOWLVXHQOQ2W6RM3X2HRZ2QJQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194734477 (553h28m32.078688681s) [noise=true , address=77.90.31.13:4626 , piece_id=XUQAHZOLIZ3NKMFVKIACTTU53NUKJ4OUMHXDQVZYVLESCTKSANMA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.195457366 (553h28m32.079411569s) [noise=true , address=77.90.31.12:4589 , piece_id=HTF7EECNAJ6XHFXNGCQTRPB5Q2NIO2UKQTNOLXDCOTF33CTTDN7Q, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.196608962 (553h28m32.080563186s) [noise=true , address=79.127.219.38:4820 , piece_id=HBPNGAORZZPNGWBI5RRRBX6OIM5YHVBNJOU52YBU6UKRGMIKXVAQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.196966241 (553h28m32.080920499s) [noise=true , address=45.91.116.14:4216 , piece_id=EFO3XZUWQTNZANXQP7QCKJBHMK62V3ZWVHJJMGG36WU3CKPL5XEQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.198682509 (553h28m32.082636721s) [noise=true , address=45.91.116.9:4296 , piece_id=USUJX7YPMRHV6RYUPVGBESCNYUVAR6NVQ6O2C2QYUM57FRFP66XQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.198788570 (553h28m32.082742801s) [noise=true , address=79.127.219.46:4894 , piece_id=ZILXN3GXRPV3HJUCJZO73RKSJ243FS4XOBC7ON6NNHT3I3TA74SQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.200360324 (553h28m32.084314586s) [noise=true , address=79.127.219.41:4927 , piece_id=HU5EZU2MAAWRJOTUAS2CEDQZVUMYLYND722RHCAK7IPS3VBFOJOQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.200409466 (553h28m32.084363677s) [noise=true , address=45.91.116.11:4120 , piece_id=2UBMZX24SH3WZ5P5O26DC7ZPBKKD55NJMO4QVYHEB5W7JI4DI7IQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201001222 (553h28m32.084955435s) [noise=true , address=45.91.116.8:4079 , piece_id=4H6KYDOFCEBSCHCTAZEBCN6GGNOI3C4Q4JBKF7Y3R63AWWYVTQJA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201324789 (553h28m32.085279001s) [noise=true , address=79.127.219.41:4928 , piece_id=3PY7HCHCK2JWLBKXOMAF7CJ4XOZDBOS2I3MP4EWUCTZKI35L553A, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201852134 (553h28m32.085806346s) [noise=true , address=77.90.31.10:4519 , piece_id=EDEYJ6IPFVQID7JWW2FLGBGET4QLAQ6QSFO67OVU7S5E4ZABAOHQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.202494013 (553h28m32.086448228s) [noise=true , address=79.127.219.38:4822 , piece_id=UEHWAF2UNYTS5B4UDBYAIFP3LMDPGCPZYLUWG7A66JF6O55AUEFQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.203080395 (553h28m32.087034598s) [noise=true , address=45.91.116.13:4156 , piece_id=SMCBYGHV2SMK3R6ZHXMGTK2QHMZZG72C5PNBS6WFEAHEGO52SMTA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.806163471 (553h28m32.690117678s) [upload=487130]: Next returned nil segment
Feb 7 17:23:54.806185160 (553h28m32.690139369s) [upload=487130]: Waiting for error group managing segments...
Feb 7 17:23:54.945265982 (553h28m32.829220181s) [noise=true , address=45.91.116.13:4156 , piece_id=SMCBYGHV2SMK3R6ZHXMGTK2QHMZZG72C5PNBS6WFEAHEGO52SMTA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:54.953973810 (553h28m32.837928009s) [noise=true , address=45.91.116.11:4120 , piece_id=2UBMZX24SH3WZ5P5O26DC7ZPBKKD55NJMO4QVYHEB5W7JI4DI7IQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:54.999174204 (553h28m32.883128413s) [noise=true , address=45.91.116.8:4079 , piece_id=4H6KYDOFCEBSCHCTAZEBCN6GGNOI3C4Q4JBKF7Y3R63AWWYVTQJA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.057146471 (553h28m32.941100671s) [noise=true , address=45.91.116.14:4224 , piece_id=MHWHXHK6C66HCBUOPJWAODP4EUBXOWLVXHQOQ2W6RM3X2HRZ2QJQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.102584864 (553h28m32.986539065s) [noise=true , address=45.91.116.9:4296 , piece_id=USUJX7YPMRHV6RYUPVGBESCNYUVAR6NVQ6O2C2QYUM57FRFP66XQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.149591827 (553h28m33.033546017s) [noise=true , address=45.91.116.14:4216 , piece_id=EFO3XZUWQTNZANXQP7QCKJBHMK62V3ZWVHJJMGG36WU3CKPL5XEQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:17.067122212 (553h28m54.951076414s) [noise=true , address=79.127.219.38:4822 , piece_id=UEHWAF2UNYTS5B4UDBYAIFP3LMDPGCPZYLUWG7A66JF6O55AUEFQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:18.164317896 (553h28m56.048272094s) [noise=true , address=77.90.31.10:4519 , piece_id=EDEYJ6IPFVQID7JWW2FLGBGET4QLAQ6QSFO67OVU7S5E4ZABAOHQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.110775048 (553h28m56.994729247s) [noise=true , address=79.127.219.41:4927 , piece_id=HU5EZU2MAAWRJOTUAS2CEDQZVUMYLYND722RHCAK7IPS3VBFOJOQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.679154003 (553h28m57.563108201s) [noise=true , address=79.127.219.46:4894 , piece_id=ZILXN3GXRPV3HJUCJZO73RKSJ243FS4XOBC7ON6NNHT3I3TA74SQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.959643534 (553h28m57.843597739s) [noise=true , address=77.90.31.13:4626 , piece_id=XUQAHZOLIZ3NKMFVKIACTTU53NUKJ4OUMHXDQVZYVLESCTKSANMA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:23.585623166 (553h29m1.469577365s) [noise=true , address=77.90.31.10:4517 , piece_id=RBXOMN5WEL53ERYCCSVJN5ITROMIFPJ5J2N72UL7543Z4PD5HBFQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:23.768567723 (553h29m1.652521934s) [noise=true , address=77.90.31.16:4736 , piece_id=X66CFLAEA3NKFTFT7WZEKYDKKQAVV4GIIZMMTRSN4FFGGJUJYP7Q, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: write tcp 139.59.144.22:60130->77.90.31.16:4736: use of closed network connection; context deadline exceeded
Feb 7 17:24:23.768602947 (553h29m1.652557178s) [noise=true , address=77.90.31.12:4589 , piece_id=HTF7EECNAJ6XHFXNGCQTRPB5Q2NIO2UKQTNOLXDCOTF33CTTDN7Q, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection
Feb 7 17:24:23.769021606 (553h29m1.652975831s) [noise=true , address=79.127.219.41:4928 , piece_id=3PY7HCHCK2JWLBKXOMAF7CJ4XOZDBOS2I3MP4EWUCTZKI35L553A, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:12pvLo4F5ieDtepopg8Wi8jw6PKNeDCDvtH5iVNQXBUQwSXYxuD, address:79.127.219.41:4928): protocol: write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection; write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection
Feb 7 17:24:23.769123386 (553h29m1.653077596s) [noise=true , address=79.127.219.38:4820 , piece_id=HBPNGAORZZPNGWBI5RRRBX6OIM5YHVBNJOU52YBU6UKRGMIKXVAQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: read tcp 139.59.144.22:33950->79.127.219.38:4820: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 7 17:24:23.769163044 (553h29m1.653117254s) [seg_pos={0 0}, upload=487130]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Feb 7 17:24:23.880146456 (553h29m1.764100676s) [upload=487130]: Done uploading segments...
Feb 7 17:24:23.880195302 (553h29m1.764149504s) [upload=487130]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 2.520578642s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..................X.........................................] duration:
1.934796876s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:26:46 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.934822012s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...................X........................................] duration:
1.732604773s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:26:20 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.732630521s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
12.247904552s trace:
https://jaeger.dev.storj.io/trace/23bb39a0871b9533
FAIL (2026-02-07 17:25:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Feb 7 17:23:54.075521957 (553h28m31.959476181s) [upload=487130]: Starting upload
Feb 7 17:23:54.075637766 (553h28m31.959591969s) [upload=487130]: Done starting upload
Feb 7 17:23:54.075838847 (553h28m31.959793041s) [upload=487130]: Uploading segments...
Feb 7 17:23:54.076065883 (553h28m31.960020086s) [upload=487130]: Got next segment. Inline: false
Feb 7 17:23:54.076155268 (553h28m31.960109474s) [upload=487130]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 7 17:23:54.076161563 (553h28m31.960115775s) [upload=487130]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 7 17:23:54.193513368 (553h28m32.077467573s) [seg_pos={0 0}, upload=487130]: Begin upload segment...
Feb 7 17:23:54.193580795 (553h28m32.077534998s) [seg_pos={0 0}, upload=487130]: Done begin upload segment.
Feb 7 17:23:54.193616356 (553h28m32.077570565s) [noise=true , address=77.90.31.10:4517 , piece_id=RBXOMN5WEL53ERYCCSVJN5ITROMIFPJ5J2N72UL7543Z4PD5HBFQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194064747 (553h28m32.078018949s) [noise=true , address=77.90.31.16:4736 , piece_id=X66CFLAEA3NKFTFT7WZEKYDKKQAVV4GIIZMMTRSN4FFGGJUJYP7Q, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194686101 (553h28m32.078640305s) [noise=true , address=45.91.116.14:4224 , piece_id=MHWHXHK6C66HCBUOPJWAODP4EUBXOWLVXHQOQ2W6RM3X2HRZ2QJQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194734477 (553h28m32.078688681s) [noise=true , address=77.90.31.13:4626 , piece_id=XUQAHZOLIZ3NKMFVKIACTTU53NUKJ4OUMHXDQVZYVLESCTKSANMA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.195457366 (553h28m32.079411569s) [noise=true , address=77.90.31.12:4589 , piece_id=HTF7EECNAJ6XHFXNGCQTRPB5Q2NIO2UKQTNOLXDCOTF33CTTDN7Q, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.196608962 (553h28m32.080563186s) [noise=true , address=79.127.219.38:4820 , piece_id=HBPNGAORZZPNGWBI5RRRBX6OIM5YHVBNJOU52YBU6UKRGMIKXVAQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.196966241 (553h28m32.080920499s) [noise=true , address=45.91.116.14:4216 , piece_id=EFO3XZUWQTNZANXQP7QCKJBHMK62V3ZWVHJJMGG36WU3CKPL5XEQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.198682509 (553h28m32.082636721s) [noise=true , address=45.91.116.9:4296 , piece_id=USUJX7YPMRHV6RYUPVGBESCNYUVAR6NVQ6O2C2QYUM57FRFP66XQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.198788570 (553h28m32.082742801s) [noise=true , address=79.127.219.46:4894 , piece_id=ZILXN3GXRPV3HJUCJZO73RKSJ243FS4XOBC7ON6NNHT3I3TA74SQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.200360324 (553h28m32.084314586s) [noise=true , address=79.127.219.41:4927 , piece_id=HU5EZU2MAAWRJOTUAS2CEDQZVUMYLYND722RHCAK7IPS3VBFOJOQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.200409466 (553h28m32.084363677s) [noise=true , address=45.91.116.11:4120 , piece_id=2UBMZX24SH3WZ5P5O26DC7ZPBKKD55NJMO4QVYHEB5W7JI4DI7IQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201001222 (553h28m32.084955435s) [noise=true , address=45.91.116.8:4079 , piece_id=4H6KYDOFCEBSCHCTAZEBCN6GGNOI3C4Q4JBKF7Y3R63AWWYVTQJA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201324789 (553h28m32.085279001s) [noise=true , address=79.127.219.41:4928 , piece_id=3PY7HCHCK2JWLBKXOMAF7CJ4XOZDBOS2I3MP4EWUCTZKI35L553A, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201852134 (553h28m32.085806346s) [noise=true , address=77.90.31.10:4519 , piece_id=EDEYJ6IPFVQID7JWW2FLGBGET4QLAQ6QSFO67OVU7S5E4ZABAOHQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.202494013 (553h28m32.086448228s) [noise=true , address=79.127.219.38:4822 , piece_id=UEHWAF2UNYTS5B4UDBYAIFP3LMDPGCPZYLUWG7A66JF6O55AUEFQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.203080395 (553h28m32.087034598s) [noise=true , address=45.91.116.13:4156 , piece_id=SMCBYGHV2SMK3R6ZHXMGTK2QHMZZG72C5PNBS6WFEAHEGO52SMTA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.806163471 (553h28m32.690117678s) [upload=487130]: Next returned nil segment
Feb 7 17:23:54.806185160 (553h28m32.690139369s) [upload=487130]: Waiting for error group managing segments...
Feb 7 17:23:54.945265982 (553h28m32.829220181s) [noise=true , address=45.91.116.13:4156 , piece_id=SMCBYGHV2SMK3R6ZHXMGTK2QHMZZG72C5PNBS6WFEAHEGO52SMTA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:54.953973810 (553h28m32.837928009s) [noise=true , address=45.91.116.11:4120 , piece_id=2UBMZX24SH3WZ5P5O26DC7ZPBKKD55NJMO4QVYHEB5W7JI4DI7IQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:54.999174204 (553h28m32.883128413s) [noise=true , address=45.91.116.8:4079 , piece_id=4H6KYDOFCEBSCHCTAZEBCN6GGNOI3C4Q4JBKF7Y3R63AWWYVTQJA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.057146471 (553h28m32.941100671s) [noise=true , address=45.91.116.14:4224 , piece_id=MHWHXHK6C66HCBUOPJWAODP4EUBXOWLVXHQOQ2W6RM3X2HRZ2QJQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.102584864 (553h28m32.986539065s) [noise=true , address=45.91.116.9:4296 , piece_id=USUJX7YPMRHV6RYUPVGBESCNYUVAR6NVQ6O2C2QYUM57FRFP66XQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.149591827 (553h28m33.033546017s) [noise=true , address=45.91.116.14:4216 , piece_id=EFO3XZUWQTNZANXQP7QCKJBHMK62V3ZWVHJJMGG36WU3CKPL5XEQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:17.067122212 (553h28m54.951076414s) [noise=true , address=79.127.219.38:4822 , piece_id=UEHWAF2UNYTS5B4UDBYAIFP3LMDPGCPZYLUWG7A66JF6O55AUEFQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:18.164317896 (553h28m56.048272094s) [noise=true , address=77.90.31.10:4519 , piece_id=EDEYJ6IPFVQID7JWW2FLGBGET4QLAQ6QSFO67OVU7S5E4ZABAOHQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.110775048 (553h28m56.994729247s) [noise=true , address=79.127.219.41:4927 , piece_id=HU5EZU2MAAWRJOTUAS2CEDQZVUMYLYND722RHCAK7IPS3VBFOJOQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.679154003 (553h28m57.563108201s) [noise=true , address=79.127.219.46:4894 , piece_id=ZILXN3GXRPV3HJUCJZO73RKSJ243FS4XOBC7ON6NNHT3I3TA74SQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.959643534 (553h28m57.843597739s) [noise=true , address=77.90.31.13:4626 , piece_id=XUQAHZOLIZ3NKMFVKIACTTU53NUKJ4OUMHXDQVZYVLESCTKSANMA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:23.585623166 (553h29m1.469577365s) [noise=true , address=77.90.31.10:4517 , piece_id=RBXOMN5WEL53ERYCCSVJN5ITROMIFPJ5J2N72UL7543Z4PD5HBFQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:23.768567723 (553h29m1.652521934s) [noise=true , address=77.90.31.16:4736 , piece_id=X66CFLAEA3NKFTFT7WZEKYDKKQAVV4GIIZMMTRSN4FFGGJUJYP7Q, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: write tcp 139.59.144.22:60130->77.90.31.16:4736: use of closed network connection; context deadline exceeded
Feb 7 17:24:23.768602947 (553h29m1.652557178s) [noise=true , address=77.90.31.12:4589 , piece_id=HTF7EECNAJ6XHFXNGCQTRPB5Q2NIO2UKQTNOLXDCOTF33CTTDN7Q, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection
Feb 7 17:24:23.769021606 (553h29m1.652975831s) [noise=true , address=79.127.219.41:4928 , piece_id=3PY7HCHCK2JWLBKXOMAF7CJ4XOZDBOS2I3MP4EWUCTZKI35L553A, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:12pvLo4F5ieDtepopg8Wi8jw6PKNeDCDvtH5iVNQXBUQwSXYxuD, address:79.127.219.41:4928): protocol: write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection; write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection
Feb 7 17:24:23.769123386 (553h29m1.653077596s) [noise=true , address=79.127.219.38:4820 , piece_id=HBPNGAORZZPNGWBI5RRRBX6OIM5YHVBNJOU52YBU6UKRGMIKXVAQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: read tcp 139.59.144.22:33950->79.127.219.38:4820: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 7 17:24:23.769163044 (553h29m1.653117254s) [seg_pos={0 0}, upload=487130]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Feb 7 17:24:23.880146456 (553h29m1.764100676s) [upload=487130]: Done uploading segments...
Feb 7 17:24:23.880195302 (553h29m1.764149504s) [upload=487130]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 12.247936779s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....................X.......................................] duration:
1.74172383s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:25:38 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.741751072s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....................X......................................] duration:
1.623791123s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:25:10 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.62382175s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.639435766s trace:
https://jaeger.dev.storj.io/trace/23bb39a0871b9533
FAIL (2026-02-07 17:24:45 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Feb 7 17:23:54.075521957 (553h28m31.959476181s) [upload=487130]: Starting upload
Feb 7 17:23:54.075637766 (553h28m31.959591969s) [upload=487130]: Done starting upload
Feb 7 17:23:54.075838847 (553h28m31.959793041s) [upload=487130]: Uploading segments...
Feb 7 17:23:54.076065883 (553h28m31.960020086s) [upload=487130]: Got next segment. Inline: false
Feb 7 17:23:54.076155268 (553h28m31.960109474s) [upload=487130]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 7 17:23:54.076161563 (553h28m31.960115775s) [upload=487130]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 7 17:23:54.193513368 (553h28m32.077467573s) [seg_pos={0 0}, upload=487130]: Begin upload segment...
Feb 7 17:23:54.193580795 (553h28m32.077534998s) [seg_pos={0 0}, upload=487130]: Done begin upload segment.
Feb 7 17:23:54.193616356 (553h28m32.077570565s) [noise=true , address=77.90.31.10:4517 , piece_id=RBXOMN5WEL53ERYCCSVJN5ITROMIFPJ5J2N72UL7543Z4PD5HBFQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194064747 (553h28m32.078018949s) [noise=true , address=77.90.31.16:4736 , piece_id=X66CFLAEA3NKFTFT7WZEKYDKKQAVV4GIIZMMTRSN4FFGGJUJYP7Q, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194686101 (553h28m32.078640305s) [noise=true , address=45.91.116.14:4224 , piece_id=MHWHXHK6C66HCBUOPJWAODP4EUBXOWLVXHQOQ2W6RM3X2HRZ2QJQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194734477 (553h28m32.078688681s) [noise=true , address=77.90.31.13:4626 , piece_id=XUQAHZOLIZ3NKMFVKIACTTU53NUKJ4OUMHXDQVZYVLESCTKSANMA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.195457366 (553h28m32.079411569s) [noise=true , address=77.90.31.12:4589 , piece_id=HTF7EECNAJ6XHFXNGCQTRPB5Q2NIO2UKQTNOLXDCOTF33CTTDN7Q, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.196608962 (553h28m32.080563186s) [noise=true , address=79.127.219.38:4820 , piece_id=HBPNGAORZZPNGWBI5RRRBX6OIM5YHVBNJOU52YBU6UKRGMIKXVAQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.196966241 (553h28m32.080920499s) [noise=true , address=45.91.116.14:4216 , piece_id=EFO3XZUWQTNZANXQP7QCKJBHMK62V3ZWVHJJMGG36WU3CKPL5XEQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.198682509 (553h28m32.082636721s) [noise=true , address=45.91.116.9:4296 , piece_id=USUJX7YPMRHV6RYUPVGBESCNYUVAR6NVQ6O2C2QYUM57FRFP66XQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.198788570 (553h28m32.082742801s) [noise=true , address=79.127.219.46:4894 , piece_id=ZILXN3GXRPV3HJUCJZO73RKSJ243FS4XOBC7ON6NNHT3I3TA74SQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.200360324 (553h28m32.084314586s) [noise=true , address=79.127.219.41:4927 , piece_id=HU5EZU2MAAWRJOTUAS2CEDQZVUMYLYND722RHCAK7IPS3VBFOJOQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.200409466 (553h28m32.084363677s) [noise=true , address=45.91.116.11:4120 , piece_id=2UBMZX24SH3WZ5P5O26DC7ZPBKKD55NJMO4QVYHEB5W7JI4DI7IQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201001222 (553h28m32.084955435s) [noise=true , address=45.91.116.8:4079 , piece_id=4H6KYDOFCEBSCHCTAZEBCN6GGNOI3C4Q4JBKF7Y3R63AWWYVTQJA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201324789 (553h28m32.085279001s) [noise=true , address=79.127.219.41:4928 , piece_id=3PY7HCHCK2JWLBKXOMAF7CJ4XOZDBOS2I3MP4EWUCTZKI35L553A, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201852134 (553h28m32.085806346s) [noise=true , address=77.90.31.10:4519 , piece_id=EDEYJ6IPFVQID7JWW2FLGBGET4QLAQ6QSFO67OVU7S5E4ZABAOHQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.202494013 (553h28m32.086448228s) [noise=true , address=79.127.219.38:4822 , piece_id=UEHWAF2UNYTS5B4UDBYAIFP3LMDPGCPZYLUWG7A66JF6O55AUEFQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.203080395 (553h28m32.087034598s) [noise=true , address=45.91.116.13:4156 , piece_id=SMCBYGHV2SMK3R6ZHXMGTK2QHMZZG72C5PNBS6WFEAHEGO52SMTA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.806163471 (553h28m32.690117678s) [upload=487130]: Next returned nil segment
Feb 7 17:23:54.806185160 (553h28m32.690139369s) [upload=487130]: Waiting for error group managing segments...
Feb 7 17:23:54.945265982 (553h28m32.829220181s) [noise=true , address=45.91.116.13:4156 , piece_id=SMCBYGHV2SMK3R6ZHXMGTK2QHMZZG72C5PNBS6WFEAHEGO52SMTA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:54.953973810 (553h28m32.837928009s) [noise=true , address=45.91.116.11:4120 , piece_id=2UBMZX24SH3WZ5P5O26DC7ZPBKKD55NJMO4QVYHEB5W7JI4DI7IQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:54.999174204 (553h28m32.883128413s) [noise=true , address=45.91.116.8:4079 , piece_id=4H6KYDOFCEBSCHCTAZEBCN6GGNOI3C4Q4JBKF7Y3R63AWWYVTQJA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.057146471 (553h28m32.941100671s) [noise=true , address=45.91.116.14:4224 , piece_id=MHWHXHK6C66HCBUOPJWAODP4EUBXOWLVXHQOQ2W6RM3X2HRZ2QJQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.102584864 (553h28m32.986539065s) [noise=true , address=45.91.116.9:4296 , piece_id=USUJX7YPMRHV6RYUPVGBESCNYUVAR6NVQ6O2C2QYUM57FRFP66XQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.149591827 (553h28m33.033546017s) [noise=true , address=45.91.116.14:4216 , piece_id=EFO3XZUWQTNZANXQP7QCKJBHMK62V3ZWVHJJMGG36WU3CKPL5XEQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:17.067122212 (553h28m54.951076414s) [noise=true , address=79.127.219.38:4822 , piece_id=UEHWAF2UNYTS5B4UDBYAIFP3LMDPGCPZYLUWG7A66JF6O55AUEFQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:18.164317896 (553h28m56.048272094s) [noise=true , address=77.90.31.10:4519 , piece_id=EDEYJ6IPFVQID7JWW2FLGBGET4QLAQ6QSFO67OVU7S5E4ZABAOHQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.110775048 (553h28m56.994729247s) [noise=true , address=79.127.219.41:4927 , piece_id=HU5EZU2MAAWRJOTUAS2CEDQZVUMYLYND722RHCAK7IPS3VBFOJOQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.679154003 (553h28m57.563108201s) [noise=true , address=79.127.219.46:4894 , piece_id=ZILXN3GXRPV3HJUCJZO73RKSJ243FS4XOBC7ON6NNHT3I3TA74SQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.959643534 (553h28m57.843597739s) [noise=true , address=77.90.31.13:4626 , piece_id=XUQAHZOLIZ3NKMFVKIACTTU53NUKJ4OUMHXDQVZYVLESCTKSANMA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:23.585623166 (553h29m1.469577365s) [noise=true , address=77.90.31.10:4517 , piece_id=RBXOMN5WEL53ERYCCSVJN5ITROMIFPJ5J2N72UL7543Z4PD5HBFQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:23.768567723 (553h29m1.652521934s) [noise=true , address=77.90.31.16:4736 , piece_id=X66CFLAEA3NKFTFT7WZEKYDKKQAVV4GIIZMMTRSN4FFGGJUJYP7Q, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: write tcp 139.59.144.22:60130->77.90.31.16:4736: use of closed network connection; context deadline exceeded
Feb 7 17:24:23.768602947 (553h29m1.652557178s) [noise=true , address=77.90.31.12:4589 , piece_id=HTF7EECNAJ6XHFXNGCQTRPB5Q2NIO2UKQTNOLXDCOTF33CTTDN7Q, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection
Feb 7 17:24:23.769021606 (553h29m1.652975831s) [noise=true , address=79.127.219.41:4928 , piece_id=3PY7HCHCK2JWLBKXOMAF7CJ4XOZDBOS2I3MP4EWUCTZKI35L553A, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:12pvLo4F5ieDtepopg8Wi8jw6PKNeDCDvtH5iVNQXBUQwSXYxuD, address:79.127.219.41:4928): protocol: write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection; write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection
Feb 7 17:24:23.769123386 (553h29m1.653077596s) [noise=true , address=79.127.219.38:4820 , piece_id=HBPNGAORZZPNGWBI5RRRBX6OIM5YHVBNJOU52YBU6UKRGMIKXVAQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: read tcp 139.59.144.22:33950->79.127.219.38:4820: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 7 17:24:23.769163044 (553h29m1.653117254s) [seg_pos={0 0}, upload=487130]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Feb 7 17:24:23.880146456 (553h29m1.764100676s) [upload=487130]: Done uploading segments...
Feb 7 17:24:23.880195302 (553h29m1.764149504s) [upload=487130]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 2.639472007s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......................X.....................................] duration:
1.675230389s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:24:33 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.67527132s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.113572322s trace:
https://jaeger.dev.storj.io/trace/23bb39a0871b9533
FAIL (2026-02-07 17:24:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Feb 7 17:23:54.075521957 (553h28m31.959476181s) [upload=487130]: Starting upload
Feb 7 17:23:54.075637766 (553h28m31.959591969s) [upload=487130]: Done starting upload
Feb 7 17:23:54.075838847 (553h28m31.959793041s) [upload=487130]: Uploading segments...
Feb 7 17:23:54.076065883 (553h28m31.960020086s) [upload=487130]: Got next segment. Inline: false
Feb 7 17:23:54.076155268 (553h28m31.960109474s) [upload=487130]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 7 17:23:54.076161563 (553h28m31.960115775s) [upload=487130]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 7 17:23:54.193513368 (553h28m32.077467573s) [seg_pos={0 0}, upload=487130]: Begin upload segment...
Feb 7 17:23:54.193580795 (553h28m32.077534998s) [seg_pos={0 0}, upload=487130]: Done begin upload segment.
Feb 7 17:23:54.193616356 (553h28m32.077570565s) [noise=true , address=77.90.31.10:4517 , piece_id=RBXOMN5WEL53ERYCCSVJN5ITROMIFPJ5J2N72UL7543Z4PD5HBFQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194064747 (553h28m32.078018949s) [noise=true , address=77.90.31.16:4736 , piece_id=X66CFLAEA3NKFTFT7WZEKYDKKQAVV4GIIZMMTRSN4FFGGJUJYP7Q, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194686101 (553h28m32.078640305s) [noise=true , address=45.91.116.14:4224 , piece_id=MHWHXHK6C66HCBUOPJWAODP4EUBXOWLVXHQOQ2W6RM3X2HRZ2QJQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.194734477 (553h28m32.078688681s) [noise=true , address=77.90.31.13:4626 , piece_id=XUQAHZOLIZ3NKMFVKIACTTU53NUKJ4OUMHXDQVZYVLESCTKSANMA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.195457366 (553h28m32.079411569s) [noise=true , address=77.90.31.12:4589 , piece_id=HTF7EECNAJ6XHFXNGCQTRPB5Q2NIO2UKQTNOLXDCOTF33CTTDN7Q, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.196608962 (553h28m32.080563186s) [noise=true , address=79.127.219.38:4820 , piece_id=HBPNGAORZZPNGWBI5RRRBX6OIM5YHVBNJOU52YBU6UKRGMIKXVAQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.196966241 (553h28m32.080920499s) [noise=true , address=45.91.116.14:4216 , piece_id=EFO3XZUWQTNZANXQP7QCKJBHMK62V3ZWVHJJMGG36WU3CKPL5XEQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.198682509 (553h28m32.082636721s) [noise=true , address=45.91.116.9:4296 , piece_id=USUJX7YPMRHV6RYUPVGBESCNYUVAR6NVQ6O2C2QYUM57FRFP66XQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.198788570 (553h28m32.082742801s) [noise=true , address=79.127.219.46:4894 , piece_id=ZILXN3GXRPV3HJUCJZO73RKSJ243FS4XOBC7ON6NNHT3I3TA74SQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.200360324 (553h28m32.084314586s) [noise=true , address=79.127.219.41:4927 , piece_id=HU5EZU2MAAWRJOTUAS2CEDQZVUMYLYND722RHCAK7IPS3VBFOJOQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.200409466 (553h28m32.084363677s) [noise=true , address=45.91.116.11:4120 , piece_id=2UBMZX24SH3WZ5P5O26DC7ZPBKKD55NJMO4QVYHEB5W7JI4DI7IQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201001222 (553h28m32.084955435s) [noise=true , address=45.91.116.8:4079 , piece_id=4H6KYDOFCEBSCHCTAZEBCN6GGNOI3C4Q4JBKF7Y3R63AWWYVTQJA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201324789 (553h28m32.085279001s) [noise=true , address=79.127.219.41:4928 , piece_id=3PY7HCHCK2JWLBKXOMAF7CJ4XOZDBOS2I3MP4EWUCTZKI35L553A, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.201852134 (553h28m32.085806346s) [noise=true , address=77.90.31.10:4519 , piece_id=EDEYJ6IPFVQID7JWW2FLGBGET4QLAQ6QSFO67OVU7S5E4ZABAOHQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.202494013 (553h28m32.086448228s) [noise=true , address=79.127.219.38:4822 , piece_id=UEHWAF2UNYTS5B4UDBYAIFP3LMDPGCPZYLUWG7A66JF6O55AUEFQ, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.203080395 (553h28m32.087034598s) [noise=true , address=45.91.116.13:4156 , piece_id=SMCBYGHV2SMK3R6ZHXMGTK2QHMZZG72C5PNBS6WFEAHEGO52SMTA, seg_pos={0 0}, upload=487130]: Uploading piece...
Feb 7 17:23:54.806163471 (553h28m32.690117678s) [upload=487130]: Next returned nil segment
Feb 7 17:23:54.806185160 (553h28m32.690139369s) [upload=487130]: Waiting for error group managing segments...
Feb 7 17:23:54.945265982 (553h28m32.829220181s) [noise=true , address=45.91.116.13:4156 , piece_id=SMCBYGHV2SMK3R6ZHXMGTK2QHMZZG72C5PNBS6WFEAHEGO52SMTA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:54.953973810 (553h28m32.837928009s) [noise=true , address=45.91.116.11:4120 , piece_id=2UBMZX24SH3WZ5P5O26DC7ZPBKKD55NJMO4QVYHEB5W7JI4DI7IQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:54.999174204 (553h28m32.883128413s) [noise=true , address=45.91.116.8:4079 , piece_id=4H6KYDOFCEBSCHCTAZEBCN6GGNOI3C4Q4JBKF7Y3R63AWWYVTQJA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.057146471 (553h28m32.941100671s) [noise=true , address=45.91.116.14:4224 , piece_id=MHWHXHK6C66HCBUOPJWAODP4EUBXOWLVXHQOQ2W6RM3X2HRZ2QJQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.102584864 (553h28m32.986539065s) [noise=true , address=45.91.116.9:4296 , piece_id=USUJX7YPMRHV6RYUPVGBESCNYUVAR6NVQ6O2C2QYUM57FRFP66XQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:23:55.149591827 (553h28m33.033546017s) [noise=true , address=45.91.116.14:4216 , piece_id=EFO3XZUWQTNZANXQP7QCKJBHMK62V3ZWVHJJMGG36WU3CKPL5XEQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:17.067122212 (553h28m54.951076414s) [noise=true , address=79.127.219.38:4822 , piece_id=UEHWAF2UNYTS5B4UDBYAIFP3LMDPGCPZYLUWG7A66JF6O55AUEFQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:18.164317896 (553h28m56.048272094s) [noise=true , address=77.90.31.10:4519 , piece_id=EDEYJ6IPFVQID7JWW2FLGBGET4QLAQ6QSFO67OVU7S5E4ZABAOHQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.110775048 (553h28m56.994729247s) [noise=true , address=79.127.219.41:4927 , piece_id=HU5EZU2MAAWRJOTUAS2CEDQZVUMYLYND722RHCAK7IPS3VBFOJOQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.679154003 (553h28m57.563108201s) [noise=true , address=79.127.219.46:4894 , piece_id=ZILXN3GXRPV3HJUCJZO73RKSJ243FS4XOBC7ON6NNHT3I3TA74SQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:19.959643534 (553h28m57.843597739s) [noise=true , address=77.90.31.13:4626 , piece_id=XUQAHZOLIZ3NKMFVKIACTTU53NUKJ4OUMHXDQVZYVLESCTKSANMA, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:23.585623166 (553h29m1.469577365s) [noise=true , address=77.90.31.10:4517 , piece_id=RBXOMN5WEL53ERYCCSVJN5ITROMIFPJ5J2N72UL7543Z4PD5HBFQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: <nil>
Feb 7 17:24:23.768567723 (553h29m1.652521934s) [noise=true , address=77.90.31.16:4736 , piece_id=X66CFLAEA3NKFTFT7WZEKYDKKQAVV4GIIZMMTRSN4FFGGJUJYP7Q, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: write tcp 139.59.144.22:60130->77.90.31.16:4736: use of closed network connection; context deadline exceeded
Feb 7 17:24:23.768602947 (553h29m1.652557178s) [noise=true , address=77.90.31.12:4589 , piece_id=HTF7EECNAJ6XHFXNGCQTRPB5Q2NIO2UKQTNOLXDCOTF33CTTDN7Q, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45484->77.90.31.12:4589: use of closed network connection
Feb 7 17:24:23.769021606 (553h29m1.652975831s) [noise=true , address=79.127.219.41:4928 , piece_id=3PY7HCHCK2JWLBKXOMAF7CJ4XOZDBOS2I3MP4EWUCTZKI35L553A, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:12pvLo4F5ieDtepopg8Wi8jw6PKNeDCDvtH5iVNQXBUQwSXYxuD, address:79.127.219.41:4928): protocol: write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection; write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40426->79.127.219.41:4928: use of closed network connection
Feb 7 17:24:23.769123386 (553h29m1.653077596s) [noise=true , address=79.127.219.38:4820 , piece_id=HBPNGAORZZPNGWBI5RRRBX6OIM5YHVBNJOU52YBU6UKRGMIKXVAQ, seg_pos={0 0}, upload=487130]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: read tcp 139.59.144.22:33950->79.127.219.38:4820: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 7 17:24:23.769163044 (553h29m1.653117254s) [seg_pos={0 0}, upload=487130]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Feb 7 17:24:23.880146456 (553h29m1.764100676s) [upload=487130]: Done uploading segments...
Feb 7 17:24:23.880195302 (553h29m1.764149504s) [upload=487130]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 30.113600606s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......................X....................................] duration:
1.655571338s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:23:59 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.655590245s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........................X...................................] duration:
1.711502339s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:23:20 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.711555515s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........................X..................................] duration:
2.092884249s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:22:32 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 2.092910231s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........................X.................................] duration:
1.706025525s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:21:48 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.706066801s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........................X................................] duration:
1.586747115s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:21:17 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.586775249s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [............................X...............................] duration:
1.661945977s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:21:00 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.661980547s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.............................X..............................] duration:
1.740153775s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:20:43 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.740185462s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..............................X.............................] duration:
1.600062312s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:19:59 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.600089276s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...............................X............................] duration:
1.73415136s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:19:13 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.734188287s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [................................X...........................] duration:
1.835988213s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:18:11 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.836012052s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.................................X..........................] duration:
1.591647757s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:17:15 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.591676031s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..................................X.........................] duration:
1.818882068s trace:
https://jaeger.dev.storj.io/trace/5d799d8b0174cff8
FAIL (2026-02-07 17:16:39 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.818904173s
core
uplink
us-select-1
us1-placement-20
|