Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..............X.............................................] duration:
2.169026331s trace:
https://jaeger.dev.storj.io/trace/e2418d4c207d3ba
FAIL (2026-02-07 18:22:51 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.169056402s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...............X............................................] duration:
1.751455229s trace:
https://jaeger.dev.storj.io/trace/e2418d4c207d3ba
FAIL (2026-02-07 18:22:34 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.751493901s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [................X...........................................] duration:
1.671196316s trace:
https://jaeger.dev.storj.io/trace/e2418d4c207d3ba
FAIL (2026-02-07 18:21:43 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.671222888s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.................X..........................................] duration:
1.683907386s trace:
https://jaeger.dev.storj.io/trace/e2418d4c207d3ba
FAIL (2026-02-07 18:21:14 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.683949628s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..................X.........................................] duration:
1.735525796s trace:
https://jaeger.dev.storj.io/trace/e2418d4c207d3ba
FAIL (2026-02-07 18:20:56 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.73555182s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...................X........................................] duration:
1.800635271s trace:
https://jaeger.dev.storj.io/trace/e2418d4c207d3ba
FAIL (2026-02-07 18:20:16 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.800737535s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....................X.......................................] duration:
1.661724976s trace:
https://jaeger.dev.storj.io/trace/e2418d4c207d3ba
FAIL (2026-02-07 18:19:36 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.66175597s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....................X......................................] duration:
1.697996855s trace:
https://jaeger.dev.storj.io/trace/e2418d4c207d3ba
FAIL (2026-02-07 18:19:14 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.69802165s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......................X.....................................] duration:
1.747835502s trace:
https://jaeger.dev.storj.io/trace/e2418d4c207d3ba
FAIL (2026-02-07 18:18:30 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.747863531s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......................X....................................] duration:
1.653854118s trace:
https://jaeger.dev.storj.io/trace/e2418d4c207d3ba
FAIL (2026-02-07 18:17:22 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.65387931s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........................X...................................] duration:
1.690239527s trace:
https://jaeger.dev.storj.io/trace/e2418d4c207d3ba
FAIL (2026-02-07 18:17:05 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.690272131s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........................X..................................] duration:
1.959491933s trace:
https://jaeger.dev.storj.io/trace/e2418d4c207d3ba
FAIL (2026-02-07 18:16:01 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.959519335s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........................X.................................] duration:
1.60002399s trace:
https://jaeger.dev.storj.io/trace/e2418d4c207d3ba
FAIL (2026-02-07 18:15:20 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.600065496s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.561599201s trace:
https://jaeger.dev.storj.io/trace/709f440ba29f5bd
FAIL (2026-02-07 18:14:43 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment
Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments...
Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection
Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection
Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection
Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection
Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection
Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection
Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments...
Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.561634072s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........................X................................] duration:
1.6082097s trace:
https://jaeger.dev.storj.io/trace/e2418d4c207d3ba
FAIL (2026-02-07 18:14:34 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.608229148s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [............................X...............................] duration:
1.659621952s trace:
https://jaeger.dev.storj.io/trace/e2418d4c207d3ba
FAIL (2026-02-07 18:14:16 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.659643872s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.............................X..............................] duration:
1.789131569s trace:
https://jaeger.dev.storj.io/trace/e2418d4c207d3ba
FAIL (2026-02-07 18:13:57 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.789157091s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.379776441s trace:
https://jaeger.dev.storj.io/trace/709f440ba29f5bd
FAIL (2026-02-07 18:13:56 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment
Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments...
Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection
Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection
Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection
Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection
Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection
Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection
Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments...
Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.379801323s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.669807763s trace:
https://jaeger.dev.storj.io/trace/709f440ba29f5bd
FAIL (2026-02-07 18:13:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment
Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments...
Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection
Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection
Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection
Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection
Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection
Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection
Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments...
Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.669836859s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..............................X.............................] duration:
1.76726114s trace:
https://jaeger.dev.storj.io/trace/e2418d4c207d3ba
FAIL (2026-02-07 18:13:15 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.767361615s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.459848657s trace:
https://jaeger.dev.storj.io/trace/709f440ba29f5bd
FAIL (2026-02-07 18:12:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment
Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments...
Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection
Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection
Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection
Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection
Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection
Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection
Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments...
Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.459882952s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...............................X............................] duration:
1.775010315s trace:
https://jaeger.dev.storj.io/trace/e2418d4c207d3ba
FAIL (2026-02-07 18:12:40 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.775035579s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.707519095s trace:
https://jaeger.dev.storj.io/trace/709f440ba29f5bd
FAIL (2026-02-07 18:12:16 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment
Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments...
Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection
Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection
Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection
Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection
Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection
Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection
Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments...
Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.707552333s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [................................X...........................] duration:
1.644503627s trace:
https://jaeger.dev.storj.io/trace/e2418d4c207d3ba
FAIL (2026-02-07 18:12:02 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.644549734s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.................................X..........................] duration:
1.740499883s trace:
https://jaeger.dev.storj.io/trace/e2418d4c207d3ba
FAIL (2026-02-07 18:11:31 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.74052994s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.555640936s trace:
https://jaeger.dev.storj.io/trace/709f440ba29f5bd
FAIL (2026-02-07 18:11:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment
Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments...
Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection
Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection
Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection
Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection
Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection
Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection
Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments...
Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.555727406s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..................................X.........................] duration:
2.021781284s trace:
https://jaeger.dev.storj.io/trace/e2418d4c207d3ba
FAIL (2026-02-07 18:10:54 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.021806887s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...................................X........................] duration:
1.647180304s trace:
https://jaeger.dev.storj.io/trace/e2418d4c207d3ba
FAIL (2026-02-07 18:10:25 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.647204907s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.662835273s trace:
https://jaeger.dev.storj.io/trace/709f440ba29f5bd
FAIL (2026-02-07 18:10:10 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment
Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments...
Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection
Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection
Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection
Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection
Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection
Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection
Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments...
Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.662866126s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.458651084s trace:
https://jaeger.dev.storj.io/trace/709f440ba29f5bd
FAIL (2026-02-07 18:09:41 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment
Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments...
Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection
Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection
Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection
Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection
Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection
Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection
Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments...
Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.458706575s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....................................X.......................] duration:
1.680338683s trace:
https://jaeger.dev.storj.io/trace/e2418d4c207d3ba
FAIL (2026-02-07 18:09:18 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.680382379s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....................................X......................] duration:
1.629646053s trace:
https://jaeger.dev.storj.io/trace/e2418d4c207d3ba
FAIL (2026-02-07 18:08:34 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.629672927s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.489560357s trace:
https://jaeger.dev.storj.io/trace/709f440ba29f5bd
FAIL (2026-02-07 18:08:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment
Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments...
Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection
Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection
Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection
Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection
Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection
Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection
Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments...
Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.489680021s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [X........X..................................................] duration:
2.418838695s trace:
https://jaeger.dev.storj.io/trace/709f440ba29f5bd
FAIL (2026-02-07 18:08:08 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment
Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments...
Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection
Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection
Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection
Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection
Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection
Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection
Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments...
Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.418866741s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X........X.................................................] duration:
2.494913621s trace:
https://jaeger.dev.storj.io/trace/709f440ba29f5bd
FAIL (2026-02-07 18:07:42 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment
Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments...
Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection
Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection
Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection
Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection
Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection
Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection
Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments...
Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.495000512s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......................................X.....................] duration:
1.709041251s trace:
https://jaeger.dev.storj.io/trace/e2418d4c207d3ba
FAIL (2026-02-07 18:07:33 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.709100586s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X........X................................................] duration:
2.518451814s trace:
https://jaeger.dev.storj.io/trace/709f440ba29f5bd
FAIL (2026-02-07 18:07:00 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment
Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments...
Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection
Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection
Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection
Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection
Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection
Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection
Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments...
Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.518510457s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......................................X....................] duration:
1.628193593s trace:
https://jaeger.dev.storj.io/trace/e2418d4c207d3ba
FAIL (2026-02-07 18:07:00 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.628223384s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........................................X...................] duration:
1.647387604s trace:
https://jaeger.dev.storj.io/trace/e2418d4c207d3ba
FAIL (2026-02-07 18:06:00 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.64742147s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X........X...............................................] duration:
2.72725213s trace:
https://jaeger.dev.storj.io/trace/709f440ba29f5bd
FAIL (2026-02-07 18:05:46 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment
Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments...
Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection
Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection
Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection
Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection
Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection
Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection
Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments...
Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.72728465s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X........X..............................................] duration:
2.659715248s trace:
https://jaeger.dev.storj.io/trace/709f440ba29f5bd
FAIL (2026-02-07 18:05:25 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment
Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments...
Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection
Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection
Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection
Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection
Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection
Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection
Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments...
Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.659743527s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........................................X..................] duration:
1.678940721s trace:
https://jaeger.dev.storj.io/trace/e2418d4c207d3ba
FAIL (2026-02-07 18:04:51 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.6789638s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X........X.............................................] duration:
2.421301936s trace:
https://jaeger.dev.storj.io/trace/709f440ba29f5bd
FAIL (2026-02-07 18:04:37 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment
Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments...
Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection
Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection
Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection
Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection
Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection
Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection
Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments...
Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.421359963s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........................................X.................] duration:
1.590964155s trace:
https://jaeger.dev.storj.io/trace/e2418d4c207d3ba
FAIL (2026-02-07 18:04:15 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.590990442s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X........X............................................] duration:
2.497483727s trace:
https://jaeger.dev.storj.io/trace/709f440ba29f5bd
FAIL (2026-02-07 18:03:29 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment
Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments...
Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection
Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection
Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection
Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection
Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection
Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection
Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments...
Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.497518857s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........................................X................] duration:
1.84742025s trace:
https://jaeger.dev.storj.io/trace/e2418d4c207d3ba
FAIL (2026-02-07 18:03:08 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.847493388s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X........X...........................................] duration:
2.463865343s trace:
https://jaeger.dev.storj.io/trace/709f440ba29f5bd
FAIL (2026-02-07 18:03:00 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment
Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments...
Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection
Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection
Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection
Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection
Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection
Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection
Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments...
Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.463898709s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [............................................X...............] duration:
1.701239016s trace:
https://jaeger.dev.storj.io/trace/e2418d4c207d3ba
FAIL (2026-02-07 18:02:43 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.701266351s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X........X..........................................] duration:
2.531633273s trace:
https://jaeger.dev.storj.io/trace/709f440ba29f5bd
FAIL (2026-02-07 18:01:48 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
DO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833286056 (553h35m51.717240266s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.833768615 (553h35m51.717722824s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834273855 (553h35m51.718228066s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.834749783 (553h35m51.718703992s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835193707 (553h35m51.719147954s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.835657845 (553h35m51.719612056s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.836123548 (553h35m51.720077759s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838415299 (553h35m51.722369509s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838639410 (553h35m51.722593614s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.838965519 (553h35m51.722919729s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839208281 (553h35m51.723162483s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839457034 (553h35m51.723411244s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839574453 (553h35m51.723528659s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839938489 (553h35m51.723892698s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:13.839969811 (553h35m51.72392401s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Uploading piece...
Feb 7 17:31:14.438819097 (553h35m52.322773297s) [upload=487237]: Next returned nil segment
Feb 7 17:31:14.438836276 (553h35m52.322790482s) [upload=487237]: Waiting for error group managing segments...
Feb 7 17:31:14.578561645 (553h35m52.462515848s) [noise=true , address=45.91.116.5:4332 , piece_id=DNIQESXL4FSUCOO2UHUUAINYZ3Q5LLFRII6DKLEWHFGVD3EWE3XA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.578638456 (553h35m52.462592642s) [noise=true , address=45.91.116.13:4188 , piece_id=OWSAAEYH7JUDXLODECHGHW5VS6ZJY4K7LBT7GW743NJPYKCVPYDA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.589022806 (553h35m52.472976994s) [noise=true , address=145.79.227.29:4943 , piece_id=NYQKPWV46AHIBEZDQF7YM437XVTD3LD2AKLBFLLF5XWNGLXHB6TA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:14.599845848 (553h35m52.483800038s) [noise=true , address=45.91.116.14:4224 , piece_id=TCZJQQ4M65KDNZRDWJOFWZNWGRMNHLWJQ2AQECVVTZSXQC7BAAZQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.082922863 (553h35m57.96687707s) [noise=true , address=77.90.31.11:4553 , piece_id=6SNN5JZXRUYZ3LPROT6JWFLJBQELXTHGLXS4AREOKRWNCU4JE3JA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:20.635241543 (553h35m58.519195754s) [noise=true , address=77.90.31.10:4519 , piece_id=MVOTPA53JZEGFTIAMOV4YP4HAK5AXWSZAQBORB4V3YQHWYTIHD2A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:36.676350330 (553h36m14.56030453s) [noise=true , address=79.127.219.46:4894 , piece_id=BYUVGT453GTYG7UU43W5GGVAMMNYDY46SP3JAWSYC7XRWEJDJ4IA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.320169806 (553h36m21.204124007s) [noise=true , address=77.90.31.16:4736 , piece_id=VXU2VEVLSL2723K5HPXA2NCC4XVC2JKDQPLZR7F53S3QX5HFPOMA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: <nil>
Feb 7 17:31:43.433894774 (553h36m21.317849005s) [noise=true , address=77.90.31.13:4629 , piece_id=LHIIN3K7GD5UR4RGC7U6S5QXTHKCMBPBHT5NVMXJXZ5NQBRDVGMQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44382->77.90.31.13:4629: use of closed network connection
Feb 7 17:31:43.434357778 (553h36m21.318311991s) [noise=true , address=77.90.31.14:4662 , piece_id=AD74YZHCPOCGWVEIM6ZDJUZZBAFVDVDO546WKU2FGMA4KOKJXGFQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48292->77.90.31.14:4662: use of closed network connection
Feb 7 17:31:43.434410467 (553h36m21.318364654s) [noise=true , address=77.90.31.16:4735 , piece_id=PKM526GF7VJ3MQVPIHRAIEXMEZIL33SI2ZL7A6V6MLMVJ3WXR2OA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45076->77.90.31.16:4735: use of closed network connection
Feb 7 17:31:43.434559369 (553h36m21.318513561s) [noise=true , address=79.127.219.38:4822 , piece_id=2JAMVSS5ERLJUJLVR7P5UNUUPYN5MRIUNQJMEJTVNXTFXQPIOLNA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59706->79.127.219.38:4822: use of closed network connection
Feb 7 17:31:43.434658602 (553h36m21.318612808s) [noise=true , address=79.127.219.46:4893 , piece_id=M2AINU523LLSRJLSNCCARX7XMICL3J5WAIDL3SZ47PTC2DYQBF7A, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434761770 (553h36m21.318715978s) [noise=true , address=77.90.31.10:4520 , piece_id=E3IRPPEX2AVS3OIWSBJSJO3Z4OHL5HDTEBDWEJZINT76AKCFWMJA, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34374->77.90.31.10:4520: use of closed network connection
Feb 7 17:31:43.434875538 (553h36m21.318829746s) [noise=true , address=79.127.219.41:4927 , piece_id=S3N6NTKLO7EKMCNTVDUWWXZMFXNZLDK665RMNRXUINORDIO5DCSQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF
Feb 7 17:31:43.434994061 (553h36m21.31894826s) [noise=true , address=79.127.219.38:4819 , piece_id=6GTZY67RFQJZKBGOD3LNZVGBOOPWPAOHS2V6MDK7HK4TOIWJZ2OQ, seg_pos={0 0}, upload=487237]: Done uploading piece. err: ecclient: upload failed (node:1CnjbM6XhvGmaatGPdW8DAMKfoHzsHRYm1PPpSpPENzf9Zk2jq, address:79.127.219.38:4819): protocol: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37116->79.127.219.38:4819: use of closed network connection
Feb 7 17:31:43.435020249 (553h36m21.318974435s) [seg_pos={0 0}, upload=487237]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 7 17:31:43.538638833 (553h36m21.422593031s) [upload=487237]: Done uploading segments...
Feb 7 17:31:43.538674063 (553h36m21.422628266s) [upload=487237]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.531654203s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.............................................X..............] duration:
1.752385632s trace:
https://jaeger.dev.storj.io/trace/e2418d4c207d3ba
FAIL (2026-02-07 18:01:30 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.752473356s
core
uplink
us-select-1
us1-placement-20
|