Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
385.997017ms target:
https://us1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/7c10297159ec23b3
FAIL (2026-02-20 17:31:05 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 386.043198ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.230302ms remote:
"tcp:185.244.226.3:443" response headers:
X-Request-Id=RcLLdyWUYeU Date=Fri, 20 Feb 2026 17:31:03 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml X-Amz-Request-Id=189604B1840CFCB4 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/6d6c75bb35868b06
FAIL (2026-02-20 17:31:03 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189604B1840CFCB4</RequestId><HostId></HostId></Error>"
Duration: 8.258197ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.198347ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Length=274 Server=Storj X-Amz-Request-Id=189604AFB390C143 Date=Fri, 20 Feb 2026 17:30:56 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Request-Id=7hYVQczmXLe X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/4aa076e5ac86da55
FAIL (2026-02-20 17:30:56 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189604AFB390C143</RequestId><HostId></HostId></Error>"
Duration: 8.220428ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
318.939393ms remote:
"tcp:45.38.24.2:443" response headers:
Server=Storj X-Amz-Request-Id=189604AE11CD95FF X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Request-Id=9esUTQnPfkW Date=Fri, 20 Feb 2026 17:30:49 GMT Accept-Ranges=bytes Content-Length=284 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/4ec4799e17879361
FAIL (2026-02-20 17:30:49 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189604AE11CD95FF</RequestId><HostId></HostId></Error>"
Duration: 318.969298ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
276.60769ms target:
https://us1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/7c10297159ec23b3
FAIL (2026-02-20 17:30:35 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 276.63887ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.375030599s trace:
https://jaeger.dev.storj.io/trace/3ac1ab078928520a
FAIL (2026-02-20 17:30:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Feb 20 16:44:50.481178884 (68h27m55.415633017s) [upload=60200]: Starting upload
Feb 20 16:44:50.481274720 (68h27m55.415728842s) [upload=60200]: Done starting upload
Feb 20 16:44:50.481317460 (68h27m55.415771582s) [upload=60200]: Uploading segments...
Feb 20 16:44:50.481734381 (68h27m55.416188518s) [upload=60200]: Got next segment. Inline: false
Feb 20 16:44:50.481813204 (68h27m55.416267339s) [upload=60200]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 20 16:44:50.481818809 (68h27m55.416272941s) [upload=60200]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 20 16:44:50.594982281 (68h27m55.529436424s) [seg_pos={0 0}, upload=60200]: Begin upload segment...
Feb 20 16:44:50.595073429 (68h27m55.52952757s) [seg_pos={0 0}, upload=60200]: Done begin upload segment.
Feb 20 16:44:50.595132039 (68h27m55.52958618s) [noise=true , address=145.79.227.34:4908 , piece_id=RIX4CYF3FMWDIPBKPZXZUCA4VG7426Q7LRBTGYKXR52KZQRXJMYA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.596200668 (68h27m55.530654808s) [noise=true , address=145.79.227.43:4157 , piece_id=DMBQZODHBMJJNLX7N6THUA2OSI264AC4QYNO2V34HHA3OBUN7EOA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.596320462 (68h27m55.530774605s) [noise=true , address=145.79.227.18:4011 , piece_id=DS6KVGQ73DI4K4OFV2LDOOFE3VXT4XENOCQIOPCX74HLIX33ZY3A, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.596718391 (68h27m55.531172534s) [noise=true , address=145.79.227.22:4513 , piece_id=RTX3JV7TVFXGBU36O2HYPSTABLR6DH2EZEZLLQFWM4Y3ML6RC46Q, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.597160367 (68h27m55.531614509s) [noise=true , address=145.79.227.10:4404 , piece_id=SG7QPEIP6BTTGA3WAAHTLJBOQGZ5NDRELBLHCTVXT6QLUY3SZLQQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.597242784 (68h27m55.53169695s) [noise=true , address=77.90.31.10:4517 , piece_id=G6HDYUMG2OLIM2NC2E6BSFA2QZ2LE3J4THUPKUQONBA3PIWNNYIA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.597701910 (68h27m55.53215605s) [noise=true , address=45.91.116.10:4085 , piece_id=3RPQXF5JELU5DJXZTCRRYVV6CVP4VKU62RBGMUO7V27Y2WO3BOXQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.597782761 (68h27m55.532236904s) [noise=true , address=145.79.227.46:4602 , piece_id=DRUFEHS3GPEJAC667THBEZUG4GZRLLZYUYGNNBOTTW27QYDLOGYQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.598186333 (68h27m55.532640476s) [noise=true , address=145.79.227.47:4270 , piece_id=3MVDVKVT6IJRR6OR3BAWE3ZJLUNFJKMN23FC2ZXZR742LP6G5FTQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.598393977 (68h27m55.532848119s) [noise=true , address=145.79.227.19:4080 , piece_id=ILIBB7LUYUSGL7XP57ZJGWVR25RUKGMGF52KK4AY2EHJ63XD5WJA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.598608817 (68h27m55.533062936s) [noise=true , address=79.127.219.46:4889 , piece_id=4CRWZPS2GWYDXJMIMRI6XDNAV5PFGUXS3PYOI6LNDFCIWGEFA47A, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.599004199 (68h27m55.533458338s) [noise=true , address=145.79.227.12:4770 , piece_id=4XYZNU6YXWJ6PBAAW5DG2G6C3PD4Q7BYLJHCGCRRLRAKDY3NVIAQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.599028518 (68h27m55.533482661s) [noise=true , address=145.79.227.40:4050 , piece_id=2AGPHLK5LNPGQ5KIBVZHETWSMPU4LVYFMVLQDCQKXVMTRXKXUFNA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.605268614 (68h27m55.539722756s) [noise=true , address=145.79.227.39:4013 , piece_id=IZ32FZB2YA4CQAKG5CMW5OEQIUIGLNWABWAXPJEQ4JP7JZL5WNBA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.607176128 (68h27m55.541630273s) [noise=true , address=45.91.116.13:4153 , piece_id=RR3WFLSGY5A32XYPWUWKIDT7MLASCYJ6MPCY7DW5YGTXET3OA3FA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.608953153 (68h27m55.543407309s) [noise=true , address=77.90.31.18:4805 , piece_id=K7UFW4PFOTSNMJDOG37Y6VDPMNINLKD3SPWY5Z44FI7ZS6SDWCEA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:51.208118888 (68h27m56.142573011s) [upload=60200]: Next returned nil segment
Feb 20 16:44:51.208162534 (68h27m56.142616667s) [upload=60200]: Waiting for error group managing segments...
Feb 20 16:44:51.346661101 (68h27m56.281115246s) [noise=true , address=45.91.116.10:4085 , piece_id=3RPQXF5JELU5DJXZTCRRYVV6CVP4VKU62RBGMUO7V27Y2WO3BOXQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:51.351051292 (68h27m56.285505426s) [noise=true , address=79.127.219.46:4889 , piece_id=4CRWZPS2GWYDXJMIMRI6XDNAV5PFGUXS3PYOI6LNDFCIWGEFA47A, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:51.352299751 (68h27m56.286753884s) [noise=true , address=45.91.116.13:4153 , piece_id=RR3WFLSGY5A32XYPWUWKIDT7MLASCYJ6MPCY7DW5YGTXET3OA3FA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:51.406778606 (68h27m56.341232742s) [noise=true , address=77.90.31.10:4517 , piece_id=G6HDYUMG2OLIM2NC2E6BSFA2QZ2LE3J4THUPKUQONBA3PIWNNYIA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:51.425760025 (68h27m56.360214147s) [noise=true , address=77.90.31.18:4805 , piece_id=K7UFW4PFOTSNMJDOG37Y6VDPMNINLKD3SPWY5Z44FI7ZS6SDWCEA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:52.243171712 (68h27m57.177625854s) [noise=true , address=145.79.227.18:4011 , piece_id=DS6KVGQ73DI4K4OFV2LDOOFE3VXT4XENOCQIOPCX74HLIX33ZY3A, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:52.295919301 (68h27m57.230373434s) [noise=true , address=145.79.227.22:4513 , piece_id=RTX3JV7TVFXGBU36O2HYPSTABLR6DH2EZEZLLQFWM4Y3ML6RC46Q, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:52.648309998 (68h27m57.582764136s) [noise=true , address=145.79.227.34:4908 , piece_id=RIX4CYF3FMWDIPBKPZXZUCA4VG7426Q7LRBTGYKXR52KZQRXJMYA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:54.486503741 (68h27m59.420957877s) [noise=true , address=145.79.227.12:4770 , piece_id=4XYZNU6YXWJ6PBAAW5DG2G6C3PD4Q7BYLJHCGCRRLRAKDY3NVIAQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:45:18.671793403 (68h28m23.60624754s) [noise=true , address=145.79.227.46:4602 , piece_id=DRUFEHS3GPEJAC667THBEZUG4GZRLLZYUYGNNBOTTW27QYDLOGYQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:45:19.116480417 (68h28m24.050934551s) [noise=true , address=145.79.227.39:4013 , piece_id=IZ32FZB2YA4CQAKG5CMW5OEQIUIGLNWABWAXPJEQ4JP7JZL5WNBA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:45:19.602945623 (68h28m24.537399748s) [noise=true , address=145.79.227.47:4270 , piece_id=3MVDVKVT6IJRR6OR3BAWE3ZJLUNFJKMN23FC2ZXZR742LP6G5FTQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:45:20.190768336 (68h28m25.125222479s) [noise=true , address=145.79.227.10:4404 , piece_id=SG7QPEIP6BTTGA3WAAHTLJBOQGZ5NDRELBLHCTVXT6QLUY3SZLQQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: ecclient: upload failed (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b, address:145.79.227.10:4404): protocol: write tcp 139.59.144.22:51132->145.79.227.10:4404: use of closed network connection; write tcp 139.59.144.22:51132->145.79.227.10:4404: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51132->145.79.227.10:4404: use of closed network connection
Feb 20 16:45:20.190943768 (68h28m25.125397914s) [noise=true , address=145.79.227.43:4157 , piece_id=DMBQZODHBMJJNLX7N6THUA2OSI264AC4QYNO2V34HHA3OBUN7EOA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: write tcp 139.59.144.22:52494->145.79.227.43:4157: use of closed network connection; write tcp 139.59.144.22:52494->145.79.227.43:4157: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52494->145.79.227.43:4157: use of closed network connection
Feb 20 16:45:20.191073046 (68h28m25.125527193s) [noise=true , address=145.79.227.19:4080 , piece_id=ILIBB7LUYUSGL7XP57ZJGWVR25RUKGMGF52KK4AY2EHJ63XD5WJA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: ecclient: upload failed (node:12KK51wudKiZb39Ku7wZhgBYEYmgsZTHfjiNNLmpBU9uuNFapt3, address:145.79.227.19:4080): protocol: write tcp 139.59.144.22:49748->145.79.227.19:4080: use of closed network connection; write tcp 139.59.144.22:49748->145.79.227.19:4080: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49748->145.79.227.19:4080: use of closed network connection
Feb 20 16:45:20.191374693 (68h28m25.125828835s) [noise=true , address=145.79.227.40:4050 , piece_id=2AGPHLK5LNPGQ5KIBVZHETWSMPU4LVYFMVLQDCQKXVMTRXKXUFNA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: ecclient: upload failed (node:12Vw9PtVFLQPpm2uGV55tCoK7VfopaBU4EcWNBUyqhNeJjgjG64, address:145.79.227.40:4050): protocol: write tcp 139.59.144.22:54470->145.79.227.40:4050: use of closed network connection; write tcp 139.59.144.22:54470->145.79.227.40:4050: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54470->145.79.227.40:4050: use of closed network connection
Feb 20 16:45:20.191414731 (68h28m25.125868865s) [seg_pos={0 0}, upload=60200]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Feb 20 16:45:20.300131418 (68h28m25.234585558s) [upload=60200]: Done uploading segments...
Feb 20 16:45:20.300208120 (68h28m25.23466226s) [upload=60200]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 2.375057371s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
270.863857ms target:
https://us1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/7c10297159ec23b3
FAIL (2026-02-20 17:30:19 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 270.889209ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.688811ms remote:
"tcp:185.244.226.3:443" response headers:
X-Xss-Protection=1; mode=block Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=189604A70AF533F2 Date=Fri, 20 Feb 2026 17:30:18 GMT Accept-Ranges=bytes Vary=Origin X-Request-Id=jd8o3xGPTk3 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/7001aff00d81ea66
FAIL (2026-02-20 17:30:18 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189604A70AF533F2</RequestId><HostId></HostId></Error>"
Duration: 13.713406ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
316.280302ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=189604A32F580D18 X-Request-Id=dyBmxoqjuRz Date=Fri, 20 Feb 2026 17:30:02 GMT Content-Security-Policy=block-all-mixed-content Server=Storj X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/70a30472ea6322d4
FAIL (2026-02-20 17:30:02 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189604A32F580D18</RequestId><HostId></HostId></Error>"
Duration: 316.309942ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
18.199193ms remote:
"tcp:185.244.226.3:443" response headers:
Server=Storj Vary=Origin X-Amz-Request-Id=189604A34D38F303 X-Request-Id=Vkm8JSsNZpA X-Xss-Protection=1; mode=block Accept-Ranges=bytes Date=Fri, 20 Feb 2026 17:30:02 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/3ea21e54a93bd2da
FAIL (2026-02-20 17:30:02 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189604A34D38F303</RequestId><HostId></HostId></Error>"
Duration: 18.241775ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.17536ms remote:
"tcp:185.244.226.3:443" response headers:
X-Amz-Request-Id=189604A255389729 X-Xss-Protection=1; mode=block Date=Fri, 20 Feb 2026 17:29:58 GMT Content-Length=274 Content-Type=application/xml Server=Storj X-Request-Id=EDrNZkEArMU Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/14c19477919bc208
FAIL (2026-02-20 17:29:58 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189604A255389729</RequestId><HostId></HostId></Error>"
Duration: 8.199318ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.144797ms remote:
"tcp:185.244.226.3:443" response headers:
Vary=Origin X-Amz-Request-Id=1896049CA346CC3F X-Request-Id=6w9toBvRQEu Content-Length=274 Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block Date=Fri, 20 Feb 2026 17:29:34 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/74ae8c981b4b07d4
FAIL (2026-02-20 17:29:34 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896049CA346CC3F</RequestId><HostId></HostId></Error>"
Duration: 9.173518ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.338649ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=1896049AF9373166 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=7qDNfxeo4zF Date=Fri, 20 Feb 2026 17:29:27 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/7198515084147bb9
FAIL (2026-02-20 17:29:27 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896049AF9373166</RequestId><HostId></HostId></Error>"
Duration: 11.366336ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................] duration:
2.262560314s trace:
https://jaeger.dev.storj.io/trace/3ac1ab078928520a
FAIL (2026-02-20 17:29:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Feb 20 16:44:50.481178884 (68h27m55.415633017s) [upload=60200]: Starting upload
Feb 20 16:44:50.481274720 (68h27m55.415728842s) [upload=60200]: Done starting upload
Feb 20 16:44:50.481317460 (68h27m55.415771582s) [upload=60200]: Uploading segments...
Feb 20 16:44:50.481734381 (68h27m55.416188518s) [upload=60200]: Got next segment. Inline: false
Feb 20 16:44:50.481813204 (68h27m55.416267339s) [upload=60200]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 20 16:44:50.481818809 (68h27m55.416272941s) [upload=60200]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 20 16:44:50.594982281 (68h27m55.529436424s) [seg_pos={0 0}, upload=60200]: Begin upload segment...
Feb 20 16:44:50.595073429 (68h27m55.52952757s) [seg_pos={0 0}, upload=60200]: Done begin upload segment.
Feb 20 16:44:50.595132039 (68h27m55.52958618s) [noise=true , address=145.79.227.34:4908 , piece_id=RIX4CYF3FMWDIPBKPZXZUCA4VG7426Q7LRBTGYKXR52KZQRXJMYA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.596200668 (68h27m55.530654808s) [noise=true , address=145.79.227.43:4157 , piece_id=DMBQZODHBMJJNLX7N6THUA2OSI264AC4QYNO2V34HHA3OBUN7EOA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.596320462 (68h27m55.530774605s) [noise=true , address=145.79.227.18:4011 , piece_id=DS6KVGQ73DI4K4OFV2LDOOFE3VXT4XENOCQIOPCX74HLIX33ZY3A, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.596718391 (68h27m55.531172534s) [noise=true , address=145.79.227.22:4513 , piece_id=RTX3JV7TVFXGBU36O2HYPSTABLR6DH2EZEZLLQFWM4Y3ML6RC46Q, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.597160367 (68h27m55.531614509s) [noise=true , address=145.79.227.10:4404 , piece_id=SG7QPEIP6BTTGA3WAAHTLJBOQGZ5NDRELBLHCTVXT6QLUY3SZLQQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.597242784 (68h27m55.53169695s) [noise=true , address=77.90.31.10:4517 , piece_id=G6HDYUMG2OLIM2NC2E6BSFA2QZ2LE3J4THUPKUQONBA3PIWNNYIA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.597701910 (68h27m55.53215605s) [noise=true , address=45.91.116.10:4085 , piece_id=3RPQXF5JELU5DJXZTCRRYVV6CVP4VKU62RBGMUO7V27Y2WO3BOXQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.597782761 (68h27m55.532236904s) [noise=true , address=145.79.227.46:4602 , piece_id=DRUFEHS3GPEJAC667THBEZUG4GZRLLZYUYGNNBOTTW27QYDLOGYQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.598186333 (68h27m55.532640476s) [noise=true , address=145.79.227.47:4270 , piece_id=3MVDVKVT6IJRR6OR3BAWE3ZJLUNFJKMN23FC2ZXZR742LP6G5FTQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.598393977 (68h27m55.532848119s) [noise=true , address=145.79.227.19:4080 , piece_id=ILIBB7LUYUSGL7XP57ZJGWVR25RUKGMGF52KK4AY2EHJ63XD5WJA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.598608817 (68h27m55.533062936s) [noise=true , address=79.127.219.46:4889 , piece_id=4CRWZPS2GWYDXJMIMRI6XDNAV5PFGUXS3PYOI6LNDFCIWGEFA47A, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.599004199 (68h27m55.533458338s) [noise=true , address=145.79.227.12:4770 , piece_id=4XYZNU6YXWJ6PBAAW5DG2G6C3PD4Q7BYLJHCGCRRLRAKDY3NVIAQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.599028518 (68h27m55.533482661s) [noise=true , address=145.79.227.40:4050 , piece_id=2AGPHLK5LNPGQ5KIBVZHETWSMPU4LVYFMVLQDCQKXVMTRXKXUFNA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.605268614 (68h27m55.539722756s) [noise=true , address=145.79.227.39:4013 , piece_id=IZ32FZB2YA4CQAKG5CMW5OEQIUIGLNWABWAXPJEQ4JP7JZL5WNBA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.607176128 (68h27m55.541630273s) [noise=true , address=45.91.116.13:4153 , piece_id=RR3WFLSGY5A32XYPWUWKIDT7MLASCYJ6MPCY7DW5YGTXET3OA3FA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.608953153 (68h27m55.543407309s) [noise=true , address=77.90.31.18:4805 , piece_id=K7UFW4PFOTSNMJDOG37Y6VDPMNINLKD3SPWY5Z44FI7ZS6SDWCEA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:51.208118888 (68h27m56.142573011s) [upload=60200]: Next returned nil segment
Feb 20 16:44:51.208162534 (68h27m56.142616667s) [upload=60200]: Waiting for error group managing segments...
Feb 20 16:44:51.346661101 (68h27m56.281115246s) [noise=true , address=45.91.116.10:4085 , piece_id=3RPQXF5JELU5DJXZTCRRYVV6CVP4VKU62RBGMUO7V27Y2WO3BOXQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:51.351051292 (68h27m56.285505426s) [noise=true , address=79.127.219.46:4889 , piece_id=4CRWZPS2GWYDXJMIMRI6XDNAV5PFGUXS3PYOI6LNDFCIWGEFA47A, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:51.352299751 (68h27m56.286753884s) [noise=true , address=45.91.116.13:4153 , piece_id=RR3WFLSGY5A32XYPWUWKIDT7MLASCYJ6MPCY7DW5YGTXET3OA3FA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:51.406778606 (68h27m56.341232742s) [noise=true , address=77.90.31.10:4517 , piece_id=G6HDYUMG2OLIM2NC2E6BSFA2QZ2LE3J4THUPKUQONBA3PIWNNYIA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:51.425760025 (68h27m56.360214147s) [noise=true , address=77.90.31.18:4805 , piece_id=K7UFW4PFOTSNMJDOG37Y6VDPMNINLKD3SPWY5Z44FI7ZS6SDWCEA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:52.243171712 (68h27m57.177625854s) [noise=true , address=145.79.227.18:4011 , piece_id=DS6KVGQ73DI4K4OFV2LDOOFE3VXT4XENOCQIOPCX74HLIX33ZY3A, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:52.295919301 (68h27m57.230373434s) [noise=true , address=145.79.227.22:4513 , piece_id=RTX3JV7TVFXGBU36O2HYPSTABLR6DH2EZEZLLQFWM4Y3ML6RC46Q, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:52.648309998 (68h27m57.582764136s) [noise=true , address=145.79.227.34:4908 , piece_id=RIX4CYF3FMWDIPBKPZXZUCA4VG7426Q7LRBTGYKXR52KZQRXJMYA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:54.486503741 (68h27m59.420957877s) [noise=true , address=145.79.227.12:4770 , piece_id=4XYZNU6YXWJ6PBAAW5DG2G6C3PD4Q7BYLJHCGCRRLRAKDY3NVIAQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:45:18.671793403 (68h28m23.60624754s) [noise=true , address=145.79.227.46:4602 , piece_id=DRUFEHS3GPEJAC667THBEZUG4GZRLLZYUYGNNBOTTW27QYDLOGYQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:45:19.116480417 (68h28m24.050934551s) [noise=true , address=145.79.227.39:4013 , piece_id=IZ32FZB2YA4CQAKG5CMW5OEQIUIGLNWABWAXPJEQ4JP7JZL5WNBA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:45:19.602945623 (68h28m24.537399748s) [noise=true , address=145.79.227.47:4270 , piece_id=3MVDVKVT6IJRR6OR3BAWE3ZJLUNFJKMN23FC2ZXZR742LP6G5FTQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:45:20.190768336 (68h28m25.125222479s) [noise=true , address=145.79.227.10:4404 , piece_id=SG7QPEIP6BTTGA3WAAHTLJBOQGZ5NDRELBLHCTVXT6QLUY3SZLQQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: ecclient: upload failed (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b, address:145.79.227.10:4404): protocol: write tcp 139.59.144.22:51132->145.79.227.10:4404: use of closed network connection; write tcp 139.59.144.22:51132->145.79.227.10:4404: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51132->145.79.227.10:4404: use of closed network connection
Feb 20 16:45:20.190943768 (68h28m25.125397914s) [noise=true , address=145.79.227.43:4157 , piece_id=DMBQZODHBMJJNLX7N6THUA2OSI264AC4QYNO2V34HHA3OBUN7EOA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: write tcp 139.59.144.22:52494->145.79.227.43:4157: use of closed network connection; write tcp 139.59.144.22:52494->145.79.227.43:4157: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52494->145.79.227.43:4157: use of closed network connection
Feb 20 16:45:20.191073046 (68h28m25.125527193s) [noise=true , address=145.79.227.19:4080 , piece_id=ILIBB7LUYUSGL7XP57ZJGWVR25RUKGMGF52KK4AY2EHJ63XD5WJA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: ecclient: upload failed (node:12KK51wudKiZb39Ku7wZhgBYEYmgsZTHfjiNNLmpBU9uuNFapt3, address:145.79.227.19:4080): protocol: write tcp 139.59.144.22:49748->145.79.227.19:4080: use of closed network connection; write tcp 139.59.144.22:49748->145.79.227.19:4080: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49748->145.79.227.19:4080: use of closed network connection
Feb 20 16:45:20.191374693 (68h28m25.125828835s) [noise=true , address=145.79.227.40:4050 , piece_id=2AGPHLK5LNPGQ5KIBVZHETWSMPU4LVYFMVLQDCQKXVMTRXKXUFNA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: ecclient: upload failed (node:12Vw9PtVFLQPpm2uGV55tCoK7VfopaBU4EcWNBUyqhNeJjgjG64, address:145.79.227.40:4050): protocol: write tcp 139.59.144.22:54470->145.79.227.40:4050: use of closed network connection; write tcp 139.59.144.22:54470->145.79.227.40:4050: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54470->145.79.227.40:4050: use of closed network connection
Feb 20 16:45:20.191414731 (68h28m25.125868865s) [seg_pos={0 0}, upload=60200]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Feb 20 16:45:20.300131418 (68h28m25.234585558s) [upload=60200]: Done uploading segments...
Feb 20 16:45:20.300208120 (68h28m25.23466226s) [upload=60200]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 2.262591579s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
279.14856ms target:
https://us1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/7c10297159ec23b3
FAIL (2026-02-20 17:29:17 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 279.167289ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
303.983903ms remote:
"tcp:45.38.24.2:443" response headers:
X-Amz-Request-Id=189604964AF95381 X-Xss-Protection=1; mode=block Date=Fri, 20 Feb 2026 17:29:06 GMT Content-Length=284 Content-Type=application/xml Vary=Origin X-Request-Id=93APxv56bYG Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/4bc34f989d5c4fe7
FAIL (2026-02-20 17:29:07 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189604964AF95381</RequestId><HostId></HostId></Error>"
Duration: 304.005362ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.041822ms remote:
"tcp:185.244.226.3:443" response headers:
X-Amz-Request-Id=1896049532B7DCAB X-Request-Id=fnx8XhcJUgF X-Xss-Protection=1; mode=block Date=Fri, 20 Feb 2026 17:29:02 GMT Accept-Ranges=bytes Content-Length=274 Server=Storj Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/605af63108807d46
FAIL (2026-02-20 17:29:02 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896049532B7DCAB</RequestId><HostId></HostId></Error>"
Duration: 9.140933ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.878697ms remote:
"tcp:185.244.226.3:443" response headers:
X-Xss-Protection=1; mode=block Content-Type=application/xml Server=Storj X-Amz-Request-Id=1896049506564B69 Date=Fri, 20 Feb 2026 17:29:01 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=5FkUNogM8L5 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/125bdc4f49a7cd40
FAIL (2026-02-20 17:29:01 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896049506564B69</RequestId><HostId></HostId></Error>"
Duration: 8.902758ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.371552ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Request-Id=32k7B5rSkRM X-Xss-Protection=1; mode=block Server=Storj X-Amz-Request-Id=189604937EAEDCFF Date=Fri, 20 Feb 2026 17:28:54 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/79a22935ac6634be
FAIL (2026-02-20 17:28:54 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189604937EAEDCFF</RequestId><HostId></HostId></Error>"
Duration: 8.392955ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.104908ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18960491A139760B X-Xss-Protection=1; mode=block Content-Length=274 Server=Storj X-Request-Id=Z5tNuM5CGRA Date=Fri, 20 Feb 2026 17:28:46 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/66e3f784c9600c5a
FAIL (2026-02-20 17:28:46 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18960491A139760B</RequestId><HostId></HostId></Error>"
Duration: 7.131588ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.716496ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Server=Storj Vary=Origin X-Amz-Request-Id=1896048EE8EC514B X-Xss-Protection=1; mode=block Date=Fri, 20 Feb 2026 17:28:35 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=Dcbhmy7vFTT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/2d50351065559c2e
FAIL (2026-02-20 17:28:35 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896048EE8EC514B</RequestId><HostId></HostId></Error>"
Duration: 7.740116ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.202488ms remote:
"tcp:185.244.226.3:443" response headers:
X-Request-Id=BN5QQfQiaLs X-Xss-Protection=1; mode=block Date=Fri, 20 Feb 2026 17:28:34 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=1896048EAFDD22F5 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2bd154b636c6c026
FAIL (2026-02-20 17:28:34 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896048EAFDD22F5</RequestId><HostId></HostId></Error>"
Duration: 10.226371ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.XX.........................................................] duration:
2.323218463s trace:
https://jaeger.dev.storj.io/trace/3ac1ab078928520a
FAIL (2026-02-20 17:28:29 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Feb 20 16:44:50.481178884 (68h27m55.415633017s) [upload=60200]: Starting upload
Feb 20 16:44:50.481274720 (68h27m55.415728842s) [upload=60200]: Done starting upload
Feb 20 16:44:50.481317460 (68h27m55.415771582s) [upload=60200]: Uploading segments...
Feb 20 16:44:50.481734381 (68h27m55.416188518s) [upload=60200]: Got next segment. Inline: false
Feb 20 16:44:50.481813204 (68h27m55.416267339s) [upload=60200]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 20 16:44:50.481818809 (68h27m55.416272941s) [upload=60200]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 20 16:44:50.594982281 (68h27m55.529436424s) [seg_pos={0 0}, upload=60200]: Begin upload segment...
Feb 20 16:44:50.595073429 (68h27m55.52952757s) [seg_pos={0 0}, upload=60200]: Done begin upload segment.
Feb 20 16:44:50.595132039 (68h27m55.52958618s) [noise=true , address=145.79.227.34:4908 , piece_id=RIX4CYF3FMWDIPBKPZXZUCA4VG7426Q7LRBTGYKXR52KZQRXJMYA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.596200668 (68h27m55.530654808s) [noise=true , address=145.79.227.43:4157 , piece_id=DMBQZODHBMJJNLX7N6THUA2OSI264AC4QYNO2V34HHA3OBUN7EOA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.596320462 (68h27m55.530774605s) [noise=true , address=145.79.227.18:4011 , piece_id=DS6KVGQ73DI4K4OFV2LDOOFE3VXT4XENOCQIOPCX74HLIX33ZY3A, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.596718391 (68h27m55.531172534s) [noise=true , address=145.79.227.22:4513 , piece_id=RTX3JV7TVFXGBU36O2HYPSTABLR6DH2EZEZLLQFWM4Y3ML6RC46Q, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.597160367 (68h27m55.531614509s) [noise=true , address=145.79.227.10:4404 , piece_id=SG7QPEIP6BTTGA3WAAHTLJBOQGZ5NDRELBLHCTVXT6QLUY3SZLQQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.597242784 (68h27m55.53169695s) [noise=true , address=77.90.31.10:4517 , piece_id=G6HDYUMG2OLIM2NC2E6BSFA2QZ2LE3J4THUPKUQONBA3PIWNNYIA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.597701910 (68h27m55.53215605s) [noise=true , address=45.91.116.10:4085 , piece_id=3RPQXF5JELU5DJXZTCRRYVV6CVP4VKU62RBGMUO7V27Y2WO3BOXQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.597782761 (68h27m55.532236904s) [noise=true , address=145.79.227.46:4602 , piece_id=DRUFEHS3GPEJAC667THBEZUG4GZRLLZYUYGNNBOTTW27QYDLOGYQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.598186333 (68h27m55.532640476s) [noise=true , address=145.79.227.47:4270 , piece_id=3MVDVKVT6IJRR6OR3BAWE3ZJLUNFJKMN23FC2ZXZR742LP6G5FTQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.598393977 (68h27m55.532848119s) [noise=true , address=145.79.227.19:4080 , piece_id=ILIBB7LUYUSGL7XP57ZJGWVR25RUKGMGF52KK4AY2EHJ63XD5WJA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.598608817 (68h27m55.533062936s) [noise=true , address=79.127.219.46:4889 , piece_id=4CRWZPS2GWYDXJMIMRI6XDNAV5PFGUXS3PYOI6LNDFCIWGEFA47A, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.599004199 (68h27m55.533458338s) [noise=true , address=145.79.227.12:4770 , piece_id=4XYZNU6YXWJ6PBAAW5DG2G6C3PD4Q7BYLJHCGCRRLRAKDY3NVIAQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.599028518 (68h27m55.533482661s) [noise=true , address=145.79.227.40:4050 , piece_id=2AGPHLK5LNPGQ5KIBVZHETWSMPU4LVYFMVLQDCQKXVMTRXKXUFNA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.605268614 (68h27m55.539722756s) [noise=true , address=145.79.227.39:4013 , piece_id=IZ32FZB2YA4CQAKG5CMW5OEQIUIGLNWABWAXPJEQ4JP7JZL5WNBA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.607176128 (68h27m55.541630273s) [noise=true , address=45.91.116.13:4153 , piece_id=RR3WFLSGY5A32XYPWUWKIDT7MLASCYJ6MPCY7DW5YGTXET3OA3FA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.608953153 (68h27m55.543407309s) [noise=true , address=77.90.31.18:4805 , piece_id=K7UFW4PFOTSNMJDOG37Y6VDPMNINLKD3SPWY5Z44FI7ZS6SDWCEA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:51.208118888 (68h27m56.142573011s) [upload=60200]: Next returned nil segment
Feb 20 16:44:51.208162534 (68h27m56.142616667s) [upload=60200]: Waiting for error group managing segments...
Feb 20 16:44:51.346661101 (68h27m56.281115246s) [noise=true , address=45.91.116.10:4085 , piece_id=3RPQXF5JELU5DJXZTCRRYVV6CVP4VKU62RBGMUO7V27Y2WO3BOXQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:51.351051292 (68h27m56.285505426s) [noise=true , address=79.127.219.46:4889 , piece_id=4CRWZPS2GWYDXJMIMRI6XDNAV5PFGUXS3PYOI6LNDFCIWGEFA47A, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:51.352299751 (68h27m56.286753884s) [noise=true , address=45.91.116.13:4153 , piece_id=RR3WFLSGY5A32XYPWUWKIDT7MLASCYJ6MPCY7DW5YGTXET3OA3FA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:51.406778606 (68h27m56.341232742s) [noise=true , address=77.90.31.10:4517 , piece_id=G6HDYUMG2OLIM2NC2E6BSFA2QZ2LE3J4THUPKUQONBA3PIWNNYIA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:51.425760025 (68h27m56.360214147s) [noise=true , address=77.90.31.18:4805 , piece_id=K7UFW4PFOTSNMJDOG37Y6VDPMNINLKD3SPWY5Z44FI7ZS6SDWCEA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:52.243171712 (68h27m57.177625854s) [noise=true , address=145.79.227.18:4011 , piece_id=DS6KVGQ73DI4K4OFV2LDOOFE3VXT4XENOCQIOPCX74HLIX33ZY3A, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:52.295919301 (68h27m57.230373434s) [noise=true , address=145.79.227.22:4513 , piece_id=RTX3JV7TVFXGBU36O2HYPSTABLR6DH2EZEZLLQFWM4Y3ML6RC46Q, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:52.648309998 (68h27m57.582764136s) [noise=true , address=145.79.227.34:4908 , piece_id=RIX4CYF3FMWDIPBKPZXZUCA4VG7426Q7LRBTGYKXR52KZQRXJMYA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:54.486503741 (68h27m59.420957877s) [noise=true , address=145.79.227.12:4770 , piece_id=4XYZNU6YXWJ6PBAAW5DG2G6C3PD4Q7BYLJHCGCRRLRAKDY3NVIAQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:45:18.671793403 (68h28m23.60624754s) [noise=true , address=145.79.227.46:4602 , piece_id=DRUFEHS3GPEJAC667THBEZUG4GZRLLZYUYGNNBOTTW27QYDLOGYQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:45:19.116480417 (68h28m24.050934551s) [noise=true , address=145.79.227.39:4013 , piece_id=IZ32FZB2YA4CQAKG5CMW5OEQIUIGLNWABWAXPJEQ4JP7JZL5WNBA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:45:19.602945623 (68h28m24.537399748s) [noise=true , address=145.79.227.47:4270 , piece_id=3MVDVKVT6IJRR6OR3BAWE3ZJLUNFJKMN23FC2ZXZR742LP6G5FTQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:45:20.190768336 (68h28m25.125222479s) [noise=true , address=145.79.227.10:4404 , piece_id=SG7QPEIP6BTTGA3WAAHTLJBOQGZ5NDRELBLHCTVXT6QLUY3SZLQQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: ecclient: upload failed (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b, address:145.79.227.10:4404): protocol: write tcp 139.59.144.22:51132->145.79.227.10:4404: use of closed network connection; write tcp 139.59.144.22:51132->145.79.227.10:4404: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51132->145.79.227.10:4404: use of closed network connection
Feb 20 16:45:20.190943768 (68h28m25.125397914s) [noise=true , address=145.79.227.43:4157 , piece_id=DMBQZODHBMJJNLX7N6THUA2OSI264AC4QYNO2V34HHA3OBUN7EOA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: write tcp 139.59.144.22:52494->145.79.227.43:4157: use of closed network connection; write tcp 139.59.144.22:52494->145.79.227.43:4157: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52494->145.79.227.43:4157: use of closed network connection
Feb 20 16:45:20.191073046 (68h28m25.125527193s) [noise=true , address=145.79.227.19:4080 , piece_id=ILIBB7LUYUSGL7XP57ZJGWVR25RUKGMGF52KK4AY2EHJ63XD5WJA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: ecclient: upload failed (node:12KK51wudKiZb39Ku7wZhgBYEYmgsZTHfjiNNLmpBU9uuNFapt3, address:145.79.227.19:4080): protocol: write tcp 139.59.144.22:49748->145.79.227.19:4080: use of closed network connection; write tcp 139.59.144.22:49748->145.79.227.19:4080: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49748->145.79.227.19:4080: use of closed network connection
Feb 20 16:45:20.191374693 (68h28m25.125828835s) [noise=true , address=145.79.227.40:4050 , piece_id=2AGPHLK5LNPGQ5KIBVZHETWSMPU4LVYFMVLQDCQKXVMTRXKXUFNA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: ecclient: upload failed (node:12Vw9PtVFLQPpm2uGV55tCoK7VfopaBU4EcWNBUyqhNeJjgjG64, address:145.79.227.40:4050): protocol: write tcp 139.59.144.22:54470->145.79.227.40:4050: use of closed network connection; write tcp 139.59.144.22:54470->145.79.227.40:4050: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54470->145.79.227.40:4050: use of closed network connection
Feb 20 16:45:20.191414731 (68h28m25.125868865s) [seg_pos={0 0}, upload=60200]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Feb 20 16:45:20.300131418 (68h28m25.234585558s) [upload=60200]: Done uploading segments...
Feb 20 16:45:20.300208120 (68h28m25.23466226s) [upload=60200]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 2.323243938s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
270.746856ms target:
https://us1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/7c10297159ec23b3
FAIL (2026-02-20 17:28:27 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 270.774751ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
303.353311ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=1896048C4AB5F308 Date=Fri, 20 Feb 2026 17:28:24 GMT Content-Length=284 Server=Storj Vary=Origin X-Request-Id=Q1bUWhUMfqR X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/da303ec492ecdff
FAIL (2026-02-20 17:28:24 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896048C4AB5F308</RequestId><HostId></HostId></Error>"
Duration: 303.374553ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
293.137261ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=189604874600FDB7 X-Request-Id=dvWMCTFQy4Y Date=Fri, 20 Feb 2026 17:28:02 GMT Content-Length=284 Server=Storj X-Xss-Protection=1; mode=block Accept-Ranges=bytes target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/2ff943dd138e1506
FAIL (2026-02-20 17:28:02 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189604874600FDB7</RequestId><HostId></HostId></Error>"
Duration: 293.165172ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.763519ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Request-Id=xDtzebLbhc Date=Fri, 20 Feb 2026 17:27:59 GMT Content-Length=274 Server=Storj X-Amz-Request-Id=18960486997C4587 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/13fb101995dcb4fa
FAIL (2026-02-20 17:27:59 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18960486997C4587</RequestId><HostId></HostId></Error>"
Duration: 8.786778ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.003771ms remote:
"tcp:185.244.226.3:443" response headers:
X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Request-Id=5g37DMn2Dyw Date=Fri, 20 Feb 2026 17:27:52 GMT Accept-Ranges=bytes Content-Length=274 Server=Storj X-Amz-Request-Id=18960484FC79A7E3 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/767dfbfbe99c78e6
FAIL (2026-02-20 17:27:52 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18960484FC79A7E3</RequestId><HostId></HostId></Error>"
Duration: 9.040295ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
287.371744ms target:
https://us1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/7c10297159ec23b3
FAIL (2026-02-20 17:27:45 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 287.399052ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.071676ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Type=application/xml X-Amz-Request-Id=1896048289C435A3 X-Request-Id=4BYGkNY4JuK Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Fri, 20 Feb 2026 17:27:42 GMT Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/4da49d5d09078c88
FAIL (2026-02-20 17:27:42 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896048289C435A3</RequestId><HostId></HostId></Error>"
Duration: 8.095668ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
307.166754ms remote:
"tcp:45.38.24.2:443" response headers:
X-Xss-Protection=1; mode=block Date=Fri, 20 Feb 2026 17:27:41 GMT Content-Length=284 Content-Type=application/xml Vary=Origin Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=1896048262BBAD63 X-Request-Id=5NHDZFvHFxZ target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3d30f97d08e41835
FAIL (2026-02-20 17:27:41 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896048262BBAD63</RequestId><HostId></HostId></Error>"
Duration: 307.19069ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..XX........................................................] duration:
2.29466505s trace:
https://jaeger.dev.storj.io/trace/3ac1ab078928520a
FAIL (2026-02-20 17:27:37 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Feb 20 16:44:50.481178884 (68h27m55.415633017s) [upload=60200]: Starting upload
Feb 20 16:44:50.481274720 (68h27m55.415728842s) [upload=60200]: Done starting upload
Feb 20 16:44:50.481317460 (68h27m55.415771582s) [upload=60200]: Uploading segments...
Feb 20 16:44:50.481734381 (68h27m55.416188518s) [upload=60200]: Got next segment. Inline: false
Feb 20 16:44:50.481813204 (68h27m55.416267339s) [upload=60200]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 20 16:44:50.481818809 (68h27m55.416272941s) [upload=60200]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 20 16:44:50.594982281 (68h27m55.529436424s) [seg_pos={0 0}, upload=60200]: Begin upload segment...
Feb 20 16:44:50.595073429 (68h27m55.52952757s) [seg_pos={0 0}, upload=60200]: Done begin upload segment.
Feb 20 16:44:50.595132039 (68h27m55.52958618s) [noise=true , address=145.79.227.34:4908 , piece_id=RIX4CYF3FMWDIPBKPZXZUCA4VG7426Q7LRBTGYKXR52KZQRXJMYA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.596200668 (68h27m55.530654808s) [noise=true , address=145.79.227.43:4157 , piece_id=DMBQZODHBMJJNLX7N6THUA2OSI264AC4QYNO2V34HHA3OBUN7EOA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.596320462 (68h27m55.530774605s) [noise=true , address=145.79.227.18:4011 , piece_id=DS6KVGQ73DI4K4OFV2LDOOFE3VXT4XENOCQIOPCX74HLIX33ZY3A, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.596718391 (68h27m55.531172534s) [noise=true , address=145.79.227.22:4513 , piece_id=RTX3JV7TVFXGBU36O2HYPSTABLR6DH2EZEZLLQFWM4Y3ML6RC46Q, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.597160367 (68h27m55.531614509s) [noise=true , address=145.79.227.10:4404 , piece_id=SG7QPEIP6BTTGA3WAAHTLJBOQGZ5NDRELBLHCTVXT6QLUY3SZLQQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.597242784 (68h27m55.53169695s) [noise=true , address=77.90.31.10:4517 , piece_id=G6HDYUMG2OLIM2NC2E6BSFA2QZ2LE3J4THUPKUQONBA3PIWNNYIA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.597701910 (68h27m55.53215605s) [noise=true , address=45.91.116.10:4085 , piece_id=3RPQXF5JELU5DJXZTCRRYVV6CVP4VKU62RBGMUO7V27Y2WO3BOXQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.597782761 (68h27m55.532236904s) [noise=true , address=145.79.227.46:4602 , piece_id=DRUFEHS3GPEJAC667THBEZUG4GZRLLZYUYGNNBOTTW27QYDLOGYQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.598186333 (68h27m55.532640476s) [noise=true , address=145.79.227.47:4270 , piece_id=3MVDVKVT6IJRR6OR3BAWE3ZJLUNFJKMN23FC2ZXZR742LP6G5FTQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.598393977 (68h27m55.532848119s) [noise=true , address=145.79.227.19:4080 , piece_id=ILIBB7LUYUSGL7XP57ZJGWVR25RUKGMGF52KK4AY2EHJ63XD5WJA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.598608817 (68h27m55.533062936s) [noise=true , address=79.127.219.46:4889 , piece_id=4CRWZPS2GWYDXJMIMRI6XDNAV5PFGUXS3PYOI6LNDFCIWGEFA47A, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.599004199 (68h27m55.533458338s) [noise=true , address=145.79.227.12:4770 , piece_id=4XYZNU6YXWJ6PBAAW5DG2G6C3PD4Q7BYLJHCGCRRLRAKDY3NVIAQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.599028518 (68h27m55.533482661s) [noise=true , address=145.79.227.40:4050 , piece_id=2AGPHLK5LNPGQ5KIBVZHETWSMPU4LVYFMVLQDCQKXVMTRXKXUFNA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.605268614 (68h27m55.539722756s) [noise=true , address=145.79.227.39:4013 , piece_id=IZ32FZB2YA4CQAKG5CMW5OEQIUIGLNWABWAXPJEQ4JP7JZL5WNBA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.607176128 (68h27m55.541630273s) [noise=true , address=45.91.116.13:4153 , piece_id=RR3WFLSGY5A32XYPWUWKIDT7MLASCYJ6MPCY7DW5YGTXET3OA3FA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.608953153 (68h27m55.543407309s) [noise=true , address=77.90.31.18:4805 , piece_id=K7UFW4PFOTSNMJDOG37Y6VDPMNINLKD3SPWY5Z44FI7ZS6SDWCEA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:51.208118888 (68h27m56.142573011s) [upload=60200]: Next returned nil segment
Feb 20 16:44:51.208162534 (68h27m56.142616667s) [upload=60200]: Waiting for error group managing segments...
Feb 20 16:44:51.346661101 (68h27m56.281115246s) [noise=true , address=45.91.116.10:4085 , piece_id=3RPQXF5JELU5DJXZTCRRYVV6CVP4VKU62RBGMUO7V27Y2WO3BOXQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:51.351051292 (68h27m56.285505426s) [noise=true , address=79.127.219.46:4889 , piece_id=4CRWZPS2GWYDXJMIMRI6XDNAV5PFGUXS3PYOI6LNDFCIWGEFA47A, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:51.352299751 (68h27m56.286753884s) [noise=true , address=45.91.116.13:4153 , piece_id=RR3WFLSGY5A32XYPWUWKIDT7MLASCYJ6MPCY7DW5YGTXET3OA3FA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:51.406778606 (68h27m56.341232742s) [noise=true , address=77.90.31.10:4517 , piece_id=G6HDYUMG2OLIM2NC2E6BSFA2QZ2LE3J4THUPKUQONBA3PIWNNYIA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:51.425760025 (68h27m56.360214147s) [noise=true , address=77.90.31.18:4805 , piece_id=K7UFW4PFOTSNMJDOG37Y6VDPMNINLKD3SPWY5Z44FI7ZS6SDWCEA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:52.243171712 (68h27m57.177625854s) [noise=true , address=145.79.227.18:4011 , piece_id=DS6KVGQ73DI4K4OFV2LDOOFE3VXT4XENOCQIOPCX74HLIX33ZY3A, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:52.295919301 (68h27m57.230373434s) [noise=true , address=145.79.227.22:4513 , piece_id=RTX3JV7TVFXGBU36O2HYPSTABLR6DH2EZEZLLQFWM4Y3ML6RC46Q, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:52.648309998 (68h27m57.582764136s) [noise=true , address=145.79.227.34:4908 , piece_id=RIX4CYF3FMWDIPBKPZXZUCA4VG7426Q7LRBTGYKXR52KZQRXJMYA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:54.486503741 (68h27m59.420957877s) [noise=true , address=145.79.227.12:4770 , piece_id=4XYZNU6YXWJ6PBAAW5DG2G6C3PD4Q7BYLJHCGCRRLRAKDY3NVIAQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:45:18.671793403 (68h28m23.60624754s) [noise=true , address=145.79.227.46:4602 , piece_id=DRUFEHS3GPEJAC667THBEZUG4GZRLLZYUYGNNBOTTW27QYDLOGYQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:45:19.116480417 (68h28m24.050934551s) [noise=true , address=145.79.227.39:4013 , piece_id=IZ32FZB2YA4CQAKG5CMW5OEQIUIGLNWABWAXPJEQ4JP7JZL5WNBA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:45:19.602945623 (68h28m24.537399748s) [noise=true , address=145.79.227.47:4270 , piece_id=3MVDVKVT6IJRR6OR3BAWE3ZJLUNFJKMN23FC2ZXZR742LP6G5FTQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:45:20.190768336 (68h28m25.125222479s) [noise=true , address=145.79.227.10:4404 , piece_id=SG7QPEIP6BTTGA3WAAHTLJBOQGZ5NDRELBLHCTVXT6QLUY3SZLQQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: ecclient: upload failed (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b, address:145.79.227.10:4404): protocol: write tcp 139.59.144.22:51132->145.79.227.10:4404: use of closed network connection; write tcp 139.59.144.22:51132->145.79.227.10:4404: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51132->145.79.227.10:4404: use of closed network connection
Feb 20 16:45:20.190943768 (68h28m25.125397914s) [noise=true , address=145.79.227.43:4157 , piece_id=DMBQZODHBMJJNLX7N6THUA2OSI264AC4QYNO2V34HHA3OBUN7EOA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: write tcp 139.59.144.22:52494->145.79.227.43:4157: use of closed network connection; write tcp 139.59.144.22:52494->145.79.227.43:4157: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52494->145.79.227.43:4157: use of closed network connection
Feb 20 16:45:20.191073046 (68h28m25.125527193s) [noise=true , address=145.79.227.19:4080 , piece_id=ILIBB7LUYUSGL7XP57ZJGWVR25RUKGMGF52KK4AY2EHJ63XD5WJA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: ecclient: upload failed (node:12KK51wudKiZb39Ku7wZhgBYEYmgsZTHfjiNNLmpBU9uuNFapt3, address:145.79.227.19:4080): protocol: write tcp 139.59.144.22:49748->145.79.227.19:4080: use of closed network connection; write tcp 139.59.144.22:49748->145.79.227.19:4080: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49748->145.79.227.19:4080: use of closed network connection
Feb 20 16:45:20.191374693 (68h28m25.125828835s) [noise=true , address=145.79.227.40:4050 , piece_id=2AGPHLK5LNPGQ5KIBVZHETWSMPU4LVYFMVLQDCQKXVMTRXKXUFNA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: ecclient: upload failed (node:12Vw9PtVFLQPpm2uGV55tCoK7VfopaBU4EcWNBUyqhNeJjgjG64, address:145.79.227.40:4050): protocol: write tcp 139.59.144.22:54470->145.79.227.40:4050: use of closed network connection; write tcp 139.59.144.22:54470->145.79.227.40:4050: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54470->145.79.227.40:4050: use of closed network connection
Feb 20 16:45:20.191414731 (68h28m25.125868865s) [seg_pos={0 0}, upload=60200]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Feb 20 16:45:20.300131418 (68h28m25.234585558s) [upload=60200]: Done uploading segments...
Feb 20 16:45:20.300208120 (68h28m25.23466226s) [upload=60200]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 2.29469022s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.25345ms remote:
"tcp:185.244.226.3:443" response headers:
Server=Storj X-Request-Id=H3Mn8KVpRLn X-Xss-Protection=1; mode=block Date=Fri, 20 Feb 2026 17:27:30 GMT Accept-Ranges=bytes Vary=Origin X-Amz-Request-Id=1896047FE3C27CE2 Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/489f17c68e8aa87
FAIL (2026-02-20 17:27:30 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896047FE3C27CE2</RequestId><HostId></HostId></Error>"
Duration: 11.281053ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
15.302189ms remote:
"tcp:185.244.226.3:443" response headers:
X-Amz-Request-Id=1896047F0354FD93 X-Xss-Protection=1; mode=block Date=Fri, 20 Feb 2026 17:27:26 GMT Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Request-Id=E5viJQa1VPb Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/7d5cebe1a02f765a
FAIL (2026-02-20 17:27:26 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896047F0354FD93</RequestId><HostId></HostId></Error>"
Duration: 15.449692ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
267.698174ms target:
https://us1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/7c10297159ec23b3
FAIL (2026-02-20 17:26:59 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 267.719887ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.078331ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=Hbe5s5bTK3B Content-Length=274 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18960478614C7433 X-Xss-Protection=1; mode=block Date=Fri, 20 Feb 2026 17:26:58 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/2661e01e9f05317c
FAIL (2026-02-20 17:26:58 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18960478614C7433</RequestId><HostId></HostId></Error>"
Duration: 8.116823ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
312.71683ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=UrYjH9Z7RMA Accept-Ranges=bytes Server=Storj Vary=Origin X-Amz-Request-Id=18960475B50AE050 X-Xss-Protection=1; mode=block Date=Fri, 20 Feb 2026 17:26:47 GMT Content-Length=284 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/5af4140346614503
FAIL (2026-02-20 17:26:47 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18960475B50AE050</RequestId><HostId></HostId></Error>"
Duration: 312.76057ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
291.114207ms target:
https://us1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/7c10297159ec23b3
FAIL (2026-02-20 17:26:42 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 291.142752ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...XX.......................................................] duration:
2.28459326s trace:
https://jaeger.dev.storj.io/trace/3ac1ab078928520a
FAIL (2026-02-20 17:26:33 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Feb 20 16:44:50.481178884 (68h27m55.415633017s) [upload=60200]: Starting upload
Feb 20 16:44:50.481274720 (68h27m55.415728842s) [upload=60200]: Done starting upload
Feb 20 16:44:50.481317460 (68h27m55.415771582s) [upload=60200]: Uploading segments...
Feb 20 16:44:50.481734381 (68h27m55.416188518s) [upload=60200]: Got next segment. Inline: false
Feb 20 16:44:50.481813204 (68h27m55.416267339s) [upload=60200]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 20 16:44:50.481818809 (68h27m55.416272941s) [upload=60200]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 20 16:44:50.594982281 (68h27m55.529436424s) [seg_pos={0 0}, upload=60200]: Begin upload segment...
Feb 20 16:44:50.595073429 (68h27m55.52952757s) [seg_pos={0 0}, upload=60200]: Done begin upload segment.
Feb 20 16:44:50.595132039 (68h27m55.52958618s) [noise=true , address=145.79.227.34:4908 , piece_id=RIX4CYF3FMWDIPBKPZXZUCA4VG7426Q7LRBTGYKXR52KZQRXJMYA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.596200668 (68h27m55.530654808s) [noise=true , address=145.79.227.43:4157 , piece_id=DMBQZODHBMJJNLX7N6THUA2OSI264AC4QYNO2V34HHA3OBUN7EOA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.596320462 (68h27m55.530774605s) [noise=true , address=145.79.227.18:4011 , piece_id=DS6KVGQ73DI4K4OFV2LDOOFE3VXT4XENOCQIOPCX74HLIX33ZY3A, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.596718391 (68h27m55.531172534s) [noise=true , address=145.79.227.22:4513 , piece_id=RTX3JV7TVFXGBU36O2HYPSTABLR6DH2EZEZLLQFWM4Y3ML6RC46Q, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.597160367 (68h27m55.531614509s) [noise=true , address=145.79.227.10:4404 , piece_id=SG7QPEIP6BTTGA3WAAHTLJBOQGZ5NDRELBLHCTVXT6QLUY3SZLQQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.597242784 (68h27m55.53169695s) [noise=true , address=77.90.31.10:4517 , piece_id=G6HDYUMG2OLIM2NC2E6BSFA2QZ2LE3J4THUPKUQONBA3PIWNNYIA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.597701910 (68h27m55.53215605s) [noise=true , address=45.91.116.10:4085 , piece_id=3RPQXF5JELU5DJXZTCRRYVV6CVP4VKU62RBGMUO7V27Y2WO3BOXQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.597782761 (68h27m55.532236904s) [noise=true , address=145.79.227.46:4602 , piece_id=DRUFEHS3GPEJAC667THBEZUG4GZRLLZYUYGNNBOTTW27QYDLOGYQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.598186333 (68h27m55.532640476s) [noise=true , address=145.79.227.47:4270 , piece_id=3MVDVKVT6IJRR6OR3BAWE3ZJLUNFJKMN23FC2ZXZR742LP6G5FTQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.598393977 (68h27m55.532848119s) [noise=true , address=145.79.227.19:4080 , piece_id=ILIBB7LUYUSGL7XP57ZJGWVR25RUKGMGF52KK4AY2EHJ63XD5WJA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.598608817 (68h27m55.533062936s) [noise=true , address=79.127.219.46:4889 , piece_id=4CRWZPS2GWYDXJMIMRI6XDNAV5PFGUXS3PYOI6LNDFCIWGEFA47A, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.599004199 (68h27m55.533458338s) [noise=true , address=145.79.227.12:4770 , piece_id=4XYZNU6YXWJ6PBAAW5DG2G6C3PD4Q7BYLJHCGCRRLRAKDY3NVIAQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.599028518 (68h27m55.533482661s) [noise=true , address=145.79.227.40:4050 , piece_id=2AGPHLK5LNPGQ5KIBVZHETWSMPU4LVYFMVLQDCQKXVMTRXKXUFNA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.605268614 (68h27m55.539722756s) [noise=true , address=145.79.227.39:4013 , piece_id=IZ32FZB2YA4CQAKG5CMW5OEQIUIGLNWABWAXPJEQ4JP7JZL5WNBA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.607176128 (68h27m55.541630273s) [noise=true , address=45.91.116.13:4153 , piece_id=RR3WFLSGY5A32XYPWUWKIDT7MLASCYJ6MPCY7DW5YGTXET3OA3FA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.608953153 (68h27m55.543407309s) [noise=true , address=77.90.31.18:4805 , piece_id=K7UFW4PFOTSNMJDOG37Y6VDPMNINLKD3SPWY5Z44FI7ZS6SDWCEA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:51.208118888 (68h27m56.142573011s) [upload=60200]: Next returned nil segment
Feb 20 16:44:51.208162534 (68h27m56.142616667s) [upload=60200]: Waiting for error group managing segments...
Feb 20 16:44:51.346661101 (68h27m56.281115246s) [noise=true , address=45.91.116.10:4085 , piece_id=3RPQXF5JELU5DJXZTCRRYVV6CVP4VKU62RBGMUO7V27Y2WO3BOXQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:51.351051292 (68h27m56.285505426s) [noise=true , address=79.127.219.46:4889 , piece_id=4CRWZPS2GWYDXJMIMRI6XDNAV5PFGUXS3PYOI6LNDFCIWGEFA47A, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:51.352299751 (68h27m56.286753884s) [noise=true , address=45.91.116.13:4153 , piece_id=RR3WFLSGY5A32XYPWUWKIDT7MLASCYJ6MPCY7DW5YGTXET3OA3FA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:51.406778606 (68h27m56.341232742s) [noise=true , address=77.90.31.10:4517 , piece_id=G6HDYUMG2OLIM2NC2E6BSFA2QZ2LE3J4THUPKUQONBA3PIWNNYIA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:51.425760025 (68h27m56.360214147s) [noise=true , address=77.90.31.18:4805 , piece_id=K7UFW4PFOTSNMJDOG37Y6VDPMNINLKD3SPWY5Z44FI7ZS6SDWCEA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:52.243171712 (68h27m57.177625854s) [noise=true , address=145.79.227.18:4011 , piece_id=DS6KVGQ73DI4K4OFV2LDOOFE3VXT4XENOCQIOPCX74HLIX33ZY3A, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:52.295919301 (68h27m57.230373434s) [noise=true , address=145.79.227.22:4513 , piece_id=RTX3JV7TVFXGBU36O2HYPSTABLR6DH2EZEZLLQFWM4Y3ML6RC46Q, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:52.648309998 (68h27m57.582764136s) [noise=true , address=145.79.227.34:4908 , piece_id=RIX4CYF3FMWDIPBKPZXZUCA4VG7426Q7LRBTGYKXR52KZQRXJMYA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:54.486503741 (68h27m59.420957877s) [noise=true , address=145.79.227.12:4770 , piece_id=4XYZNU6YXWJ6PBAAW5DG2G6C3PD4Q7BYLJHCGCRRLRAKDY3NVIAQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:45:18.671793403 (68h28m23.60624754s) [noise=true , address=145.79.227.46:4602 , piece_id=DRUFEHS3GPEJAC667THBEZUG4GZRLLZYUYGNNBOTTW27QYDLOGYQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:45:19.116480417 (68h28m24.050934551s) [noise=true , address=145.79.227.39:4013 , piece_id=IZ32FZB2YA4CQAKG5CMW5OEQIUIGLNWABWAXPJEQ4JP7JZL5WNBA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:45:19.602945623 (68h28m24.537399748s) [noise=true , address=145.79.227.47:4270 , piece_id=3MVDVKVT6IJRR6OR3BAWE3ZJLUNFJKMN23FC2ZXZR742LP6G5FTQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:45:20.190768336 (68h28m25.125222479s) [noise=true , address=145.79.227.10:4404 , piece_id=SG7QPEIP6BTTGA3WAAHTLJBOQGZ5NDRELBLHCTVXT6QLUY3SZLQQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: ecclient: upload failed (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b, address:145.79.227.10:4404): protocol: write tcp 139.59.144.22:51132->145.79.227.10:4404: use of closed network connection; write tcp 139.59.144.22:51132->145.79.227.10:4404: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51132->145.79.227.10:4404: use of closed network connection
Feb 20 16:45:20.190943768 (68h28m25.125397914s) [noise=true , address=145.79.227.43:4157 , piece_id=DMBQZODHBMJJNLX7N6THUA2OSI264AC4QYNO2V34HHA3OBUN7EOA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: write tcp 139.59.144.22:52494->145.79.227.43:4157: use of closed network connection; write tcp 139.59.144.22:52494->145.79.227.43:4157: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52494->145.79.227.43:4157: use of closed network connection
Feb 20 16:45:20.191073046 (68h28m25.125527193s) [noise=true , address=145.79.227.19:4080 , piece_id=ILIBB7LUYUSGL7XP57ZJGWVR25RUKGMGF52KK4AY2EHJ63XD5WJA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: ecclient: upload failed (node:12KK51wudKiZb39Ku7wZhgBYEYmgsZTHfjiNNLmpBU9uuNFapt3, address:145.79.227.19:4080): protocol: write tcp 139.59.144.22:49748->145.79.227.19:4080: use of closed network connection; write tcp 139.59.144.22:49748->145.79.227.19:4080: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49748->145.79.227.19:4080: use of closed network connection
Feb 20 16:45:20.191374693 (68h28m25.125828835s) [noise=true , address=145.79.227.40:4050 , piece_id=2AGPHLK5LNPGQ5KIBVZHETWSMPU4LVYFMVLQDCQKXVMTRXKXUFNA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: ecclient: upload failed (node:12Vw9PtVFLQPpm2uGV55tCoK7VfopaBU4EcWNBUyqhNeJjgjG64, address:145.79.227.40:4050): protocol: write tcp 139.59.144.22:54470->145.79.227.40:4050: use of closed network connection; write tcp 139.59.144.22:54470->145.79.227.40:4050: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54470->145.79.227.40:4050: use of closed network connection
Feb 20 16:45:20.191414731 (68h28m25.125868865s) [seg_pos={0 0}, upload=60200]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Feb 20 16:45:20.300131418 (68h28m25.234585558s) [upload=60200]: Done uploading segments...
Feb 20 16:45:20.300208120 (68h28m25.23466226s) [upload=60200]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 2.284623208s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.768253ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Server=Storj Vary=Origin X-Amz-Request-Id=18960470E0DD1A8A X-Xss-Protection=1; mode=block Date=Fri, 20 Feb 2026 17:26:26 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=dgyFw3J5daB target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/43bd2db24975245b
FAIL (2026-02-20 17:26:26 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18960470E0DD1A8A</RequestId><HostId></HostId></Error>"
Duration: 7.792185ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.714859ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18960470977C7878 X-Request-Id=cEr72dFHx8V X-Xss-Protection=1; mode=block Content-Type=application/xml Server=Storj Vary=Origin Date=Fri, 20 Feb 2026 17:26:25 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/75be13d08a9c7455
FAIL (2026-02-20 17:26:25 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18960470977C7878</RequestId><HostId></HostId></Error>"
Duration: 8.749987ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.529539ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block Date=Fri, 20 Feb 2026 17:26:16 GMT Content-Length=274 Vary=Origin X-Amz-Request-Id=1896046E8A5E37C5 X-Request-Id=72JTkrBf4Mw Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/48dfc93f15deab74
FAIL (2026-02-20 17:26:16 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896046E8A5E37C5</RequestId><HostId></HostId></Error>"
Duration: 11.554551ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
286.369175ms target:
https://us1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/7c10297159ec23b3
FAIL (2026-02-20 17:26:15 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 286.395905ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [....XX......................................................] duration:
2.325967114s trace:
https://jaeger.dev.storj.io/trace/3ac1ab078928520a
FAIL (2026-02-20 17:26:05 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Feb 20 16:44:50.481178884 (68h27m55.415633017s) [upload=60200]: Starting upload
Feb 20 16:44:50.481274720 (68h27m55.415728842s) [upload=60200]: Done starting upload
Feb 20 16:44:50.481317460 (68h27m55.415771582s) [upload=60200]: Uploading segments...
Feb 20 16:44:50.481734381 (68h27m55.416188518s) [upload=60200]: Got next segment. Inline: false
Feb 20 16:44:50.481813204 (68h27m55.416267339s) [upload=60200]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 20 16:44:50.481818809 (68h27m55.416272941s) [upload=60200]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 20 16:44:50.594982281 (68h27m55.529436424s) [seg_pos={0 0}, upload=60200]: Begin upload segment...
Feb 20 16:44:50.595073429 (68h27m55.52952757s) [seg_pos={0 0}, upload=60200]: Done begin upload segment.
Feb 20 16:44:50.595132039 (68h27m55.52958618s) [noise=true , address=145.79.227.34:4908 , piece_id=RIX4CYF3FMWDIPBKPZXZUCA4VG7426Q7LRBTGYKXR52KZQRXJMYA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.596200668 (68h27m55.530654808s) [noise=true , address=145.79.227.43:4157 , piece_id=DMBQZODHBMJJNLX7N6THUA2OSI264AC4QYNO2V34HHA3OBUN7EOA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.596320462 (68h27m55.530774605s) [noise=true , address=145.79.227.18:4011 , piece_id=DS6KVGQ73DI4K4OFV2LDOOFE3VXT4XENOCQIOPCX74HLIX33ZY3A, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.596718391 (68h27m55.531172534s) [noise=true , address=145.79.227.22:4513 , piece_id=RTX3JV7TVFXGBU36O2HYPSTABLR6DH2EZEZLLQFWM4Y3ML6RC46Q, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.597160367 (68h27m55.531614509s) [noise=true , address=145.79.227.10:4404 , piece_id=SG7QPEIP6BTTGA3WAAHTLJBOQGZ5NDRELBLHCTVXT6QLUY3SZLQQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.597242784 (68h27m55.53169695s) [noise=true , address=77.90.31.10:4517 , piece_id=G6HDYUMG2OLIM2NC2E6BSFA2QZ2LE3J4THUPKUQONBA3PIWNNYIA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.597701910 (68h27m55.53215605s) [noise=true , address=45.91.116.10:4085 , piece_id=3RPQXF5JELU5DJXZTCRRYVV6CVP4VKU62RBGMUO7V27Y2WO3BOXQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.597782761 (68h27m55.532236904s) [noise=true , address=145.79.227.46:4602 , piece_id=DRUFEHS3GPEJAC667THBEZUG4GZRLLZYUYGNNBOTTW27QYDLOGYQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.598186333 (68h27m55.532640476s) [noise=true , address=145.79.227.47:4270 , piece_id=3MVDVKVT6IJRR6OR3BAWE3ZJLUNFJKMN23FC2ZXZR742LP6G5FTQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.598393977 (68h27m55.532848119s) [noise=true , address=145.79.227.19:4080 , piece_id=ILIBB7LUYUSGL7XP57ZJGWVR25RUKGMGF52KK4AY2EHJ63XD5WJA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.598608817 (68h27m55.533062936s) [noise=true , address=79.127.219.46:4889 , piece_id=4CRWZPS2GWYDXJMIMRI6XDNAV5PFGUXS3PYOI6LNDFCIWGEFA47A, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.599004199 (68h27m55.533458338s) [noise=true , address=145.79.227.12:4770 , piece_id=4XYZNU6YXWJ6PBAAW5DG2G6C3PD4Q7BYLJHCGCRRLRAKDY3NVIAQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.599028518 (68h27m55.533482661s) [noise=true , address=145.79.227.40:4050 , piece_id=2AGPHLK5LNPGQ5KIBVZHETWSMPU4LVYFMVLQDCQKXVMTRXKXUFNA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.605268614 (68h27m55.539722756s) [noise=true , address=145.79.227.39:4013 , piece_id=IZ32FZB2YA4CQAKG5CMW5OEQIUIGLNWABWAXPJEQ4JP7JZL5WNBA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.607176128 (68h27m55.541630273s) [noise=true , address=45.91.116.13:4153 , piece_id=RR3WFLSGY5A32XYPWUWKIDT7MLASCYJ6MPCY7DW5YGTXET3OA3FA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.608953153 (68h27m55.543407309s) [noise=true , address=77.90.31.18:4805 , piece_id=K7UFW4PFOTSNMJDOG37Y6VDPMNINLKD3SPWY5Z44FI7ZS6SDWCEA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:51.208118888 (68h27m56.142573011s) [upload=60200]: Next returned nil segment
Feb 20 16:44:51.208162534 (68h27m56.142616667s) [upload=60200]: Waiting for error group managing segments...
Feb 20 16:44:51.346661101 (68h27m56.281115246s) [noise=true , address=45.91.116.10:4085 , piece_id=3RPQXF5JELU5DJXZTCRRYVV6CVP4VKU62RBGMUO7V27Y2WO3BOXQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:51.351051292 (68h27m56.285505426s) [noise=true , address=79.127.219.46:4889 , piece_id=4CRWZPS2GWYDXJMIMRI6XDNAV5PFGUXS3PYOI6LNDFCIWGEFA47A, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:51.352299751 (68h27m56.286753884s) [noise=true , address=45.91.116.13:4153 , piece_id=RR3WFLSGY5A32XYPWUWKIDT7MLASCYJ6MPCY7DW5YGTXET3OA3FA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:51.406778606 (68h27m56.341232742s) [noise=true , address=77.90.31.10:4517 , piece_id=G6HDYUMG2OLIM2NC2E6BSFA2QZ2LE3J4THUPKUQONBA3PIWNNYIA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:51.425760025 (68h27m56.360214147s) [noise=true , address=77.90.31.18:4805 , piece_id=K7UFW4PFOTSNMJDOG37Y6VDPMNINLKD3SPWY5Z44FI7ZS6SDWCEA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:52.243171712 (68h27m57.177625854s) [noise=true , address=145.79.227.18:4011 , piece_id=DS6KVGQ73DI4K4OFV2LDOOFE3VXT4XENOCQIOPCX74HLIX33ZY3A, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:52.295919301 (68h27m57.230373434s) [noise=true , address=145.79.227.22:4513 , piece_id=RTX3JV7TVFXGBU36O2HYPSTABLR6DH2EZEZLLQFWM4Y3ML6RC46Q, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:52.648309998 (68h27m57.582764136s) [noise=true , address=145.79.227.34:4908 , piece_id=RIX4CYF3FMWDIPBKPZXZUCA4VG7426Q7LRBTGYKXR52KZQRXJMYA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:54.486503741 (68h27m59.420957877s) [noise=true , address=145.79.227.12:4770 , piece_id=4XYZNU6YXWJ6PBAAW5DG2G6C3PD4Q7BYLJHCGCRRLRAKDY3NVIAQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:45:18.671793403 (68h28m23.60624754s) [noise=true , address=145.79.227.46:4602 , piece_id=DRUFEHS3GPEJAC667THBEZUG4GZRLLZYUYGNNBOTTW27QYDLOGYQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:45:19.116480417 (68h28m24.050934551s) [noise=true , address=145.79.227.39:4013 , piece_id=IZ32FZB2YA4CQAKG5CMW5OEQIUIGLNWABWAXPJEQ4JP7JZL5WNBA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:45:19.602945623 (68h28m24.537399748s) [noise=true , address=145.79.227.47:4270 , piece_id=3MVDVKVT6IJRR6OR3BAWE3ZJLUNFJKMN23FC2ZXZR742LP6G5FTQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:45:20.190768336 (68h28m25.125222479s) [noise=true , address=145.79.227.10:4404 , piece_id=SG7QPEIP6BTTGA3WAAHTLJBOQGZ5NDRELBLHCTVXT6QLUY3SZLQQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: ecclient: upload failed (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b, address:145.79.227.10:4404): protocol: write tcp 139.59.144.22:51132->145.79.227.10:4404: use of closed network connection; write tcp 139.59.144.22:51132->145.79.227.10:4404: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51132->145.79.227.10:4404: use of closed network connection
Feb 20 16:45:20.190943768 (68h28m25.125397914s) [noise=true , address=145.79.227.43:4157 , piece_id=DMBQZODHBMJJNLX7N6THUA2OSI264AC4QYNO2V34HHA3OBUN7EOA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: write tcp 139.59.144.22:52494->145.79.227.43:4157: use of closed network connection; write tcp 139.59.144.22:52494->145.79.227.43:4157: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52494->145.79.227.43:4157: use of closed network connection
Feb 20 16:45:20.191073046 (68h28m25.125527193s) [noise=true , address=145.79.227.19:4080 , piece_id=ILIBB7LUYUSGL7XP57ZJGWVR25RUKGMGF52KK4AY2EHJ63XD5WJA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: ecclient: upload failed (node:12KK51wudKiZb39Ku7wZhgBYEYmgsZTHfjiNNLmpBU9uuNFapt3, address:145.79.227.19:4080): protocol: write tcp 139.59.144.22:49748->145.79.227.19:4080: use of closed network connection; write tcp 139.59.144.22:49748->145.79.227.19:4080: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49748->145.79.227.19:4080: use of closed network connection
Feb 20 16:45:20.191374693 (68h28m25.125828835s) [noise=true , address=145.79.227.40:4050 , piece_id=2AGPHLK5LNPGQ5KIBVZHETWSMPU4LVYFMVLQDCQKXVMTRXKXUFNA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: ecclient: upload failed (node:12Vw9PtVFLQPpm2uGV55tCoK7VfopaBU4EcWNBUyqhNeJjgjG64, address:145.79.227.40:4050): protocol: write tcp 139.59.144.22:54470->145.79.227.40:4050: use of closed network connection; write tcp 139.59.144.22:54470->145.79.227.40:4050: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54470->145.79.227.40:4050: use of closed network connection
Feb 20 16:45:20.191414731 (68h28m25.125868865s) [seg_pos={0 0}, upload=60200]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Feb 20 16:45:20.300131418 (68h28m25.234585558s) [upload=60200]: Done uploading segments...
Feb 20 16:45:20.300208120 (68h28m25.23466226s) [upload=60200]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 2.326168104s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
301.293013ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18960469C6467165 X-Request-Id=Rz8UuTQwLiL X-Xss-Protection=1; mode=block Content-Length=284 Date=Fri, 20 Feb 2026 17:25:55 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/b67dcd9daa8685
FAIL (2026-02-20 17:25:55 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18960469C6467165</RequestId><HostId></HostId></Error>"
Duration: 301.321477ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....XX.....................................................] duration:
2.270602162s trace:
https://jaeger.dev.storj.io/trace/3ac1ab078928520a
FAIL (2026-02-20 17:25:46 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Feb 20 16:44:50.481178884 (68h27m55.415633017s) [upload=60200]: Starting upload
Feb 20 16:44:50.481274720 (68h27m55.415728842s) [upload=60200]: Done starting upload
Feb 20 16:44:50.481317460 (68h27m55.415771582s) [upload=60200]: Uploading segments...
Feb 20 16:44:50.481734381 (68h27m55.416188518s) [upload=60200]: Got next segment. Inline: false
Feb 20 16:44:50.481813204 (68h27m55.416267339s) [upload=60200]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 20 16:44:50.481818809 (68h27m55.416272941s) [upload=60200]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 20 16:44:50.594982281 (68h27m55.529436424s) [seg_pos={0 0}, upload=60200]: Begin upload segment...
Feb 20 16:44:50.595073429 (68h27m55.52952757s) [seg_pos={0 0}, upload=60200]: Done begin upload segment.
Feb 20 16:44:50.595132039 (68h27m55.52958618s) [noise=true , address=145.79.227.34:4908 , piece_id=RIX4CYF3FMWDIPBKPZXZUCA4VG7426Q7LRBTGYKXR52KZQRXJMYA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.596200668 (68h27m55.530654808s) [noise=true , address=145.79.227.43:4157 , piece_id=DMBQZODHBMJJNLX7N6THUA2OSI264AC4QYNO2V34HHA3OBUN7EOA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.596320462 (68h27m55.530774605s) [noise=true , address=145.79.227.18:4011 , piece_id=DS6KVGQ73DI4K4OFV2LDOOFE3VXT4XENOCQIOPCX74HLIX33ZY3A, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.596718391 (68h27m55.531172534s) [noise=true , address=145.79.227.22:4513 , piece_id=RTX3JV7TVFXGBU36O2HYPSTABLR6DH2EZEZLLQFWM4Y3ML6RC46Q, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.597160367 (68h27m55.531614509s) [noise=true , address=145.79.227.10:4404 , piece_id=SG7QPEIP6BTTGA3WAAHTLJBOQGZ5NDRELBLHCTVXT6QLUY3SZLQQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.597242784 (68h27m55.53169695s) [noise=true , address=77.90.31.10:4517 , piece_id=G6HDYUMG2OLIM2NC2E6BSFA2QZ2LE3J4THUPKUQONBA3PIWNNYIA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.597701910 (68h27m55.53215605s) [noise=true , address=45.91.116.10:4085 , piece_id=3RPQXF5JELU5DJXZTCRRYVV6CVP4VKU62RBGMUO7V27Y2WO3BOXQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.597782761 (68h27m55.532236904s) [noise=true , address=145.79.227.46:4602 , piece_id=DRUFEHS3GPEJAC667THBEZUG4GZRLLZYUYGNNBOTTW27QYDLOGYQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.598186333 (68h27m55.532640476s) [noise=true , address=145.79.227.47:4270 , piece_id=3MVDVKVT6IJRR6OR3BAWE3ZJLUNFJKMN23FC2ZXZR742LP6G5FTQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.598393977 (68h27m55.532848119s) [noise=true , address=145.79.227.19:4080 , piece_id=ILIBB7LUYUSGL7XP57ZJGWVR25RUKGMGF52KK4AY2EHJ63XD5WJA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.598608817 (68h27m55.533062936s) [noise=true , address=79.127.219.46:4889 , piece_id=4CRWZPS2GWYDXJMIMRI6XDNAV5PFGUXS3PYOI6LNDFCIWGEFA47A, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.599004199 (68h27m55.533458338s) [noise=true , address=145.79.227.12:4770 , piece_id=4XYZNU6YXWJ6PBAAW5DG2G6C3PD4Q7BYLJHCGCRRLRAKDY3NVIAQ, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.599028518 (68h27m55.533482661s) [noise=true , address=145.79.227.40:4050 , piece_id=2AGPHLK5LNPGQ5KIBVZHETWSMPU4LVYFMVLQDCQKXVMTRXKXUFNA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.605268614 (68h27m55.539722756s) [noise=true , address=145.79.227.39:4013 , piece_id=IZ32FZB2YA4CQAKG5CMW5OEQIUIGLNWABWAXPJEQ4JP7JZL5WNBA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.607176128 (68h27m55.541630273s) [noise=true , address=45.91.116.13:4153 , piece_id=RR3WFLSGY5A32XYPWUWKIDT7MLASCYJ6MPCY7DW5YGTXET3OA3FA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:50.608953153 (68h27m55.543407309s) [noise=true , address=77.90.31.18:4805 , piece_id=K7UFW4PFOTSNMJDOG37Y6VDPMNINLKD3SPWY5Z44FI7ZS6SDWCEA, seg_pos={0 0}, upload=60200]: Uploading piece...
Feb 20 16:44:51.208118888 (68h27m56.142573011s) [upload=60200]: Next returned nil segment
Feb 20 16:44:51.208162534 (68h27m56.142616667s) [upload=60200]: Waiting for error group managing segments...
Feb 20 16:44:51.346661101 (68h27m56.281115246s) [noise=true , address=45.91.116.10:4085 , piece_id=3RPQXF5JELU5DJXZTCRRYVV6CVP4VKU62RBGMUO7V27Y2WO3BOXQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:51.351051292 (68h27m56.285505426s) [noise=true , address=79.127.219.46:4889 , piece_id=4CRWZPS2GWYDXJMIMRI6XDNAV5PFGUXS3PYOI6LNDFCIWGEFA47A, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:51.352299751 (68h27m56.286753884s) [noise=true , address=45.91.116.13:4153 , piece_id=RR3WFLSGY5A32XYPWUWKIDT7MLASCYJ6MPCY7DW5YGTXET3OA3FA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:51.406778606 (68h27m56.341232742s) [noise=true , address=77.90.31.10:4517 , piece_id=G6HDYUMG2OLIM2NC2E6BSFA2QZ2LE3J4THUPKUQONBA3PIWNNYIA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:51.425760025 (68h27m56.360214147s) [noise=true , address=77.90.31.18:4805 , piece_id=K7UFW4PFOTSNMJDOG37Y6VDPMNINLKD3SPWY5Z44FI7ZS6SDWCEA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:52.243171712 (68h27m57.177625854s) [noise=true , address=145.79.227.18:4011 , piece_id=DS6KVGQ73DI4K4OFV2LDOOFE3VXT4XENOCQIOPCX74HLIX33ZY3A, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:52.295919301 (68h27m57.230373434s) [noise=true , address=145.79.227.22:4513 , piece_id=RTX3JV7TVFXGBU36O2HYPSTABLR6DH2EZEZLLQFWM4Y3ML6RC46Q, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:52.648309998 (68h27m57.582764136s) [noise=true , address=145.79.227.34:4908 , piece_id=RIX4CYF3FMWDIPBKPZXZUCA4VG7426Q7LRBTGYKXR52KZQRXJMYA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:44:54.486503741 (68h27m59.420957877s) [noise=true , address=145.79.227.12:4770 , piece_id=4XYZNU6YXWJ6PBAAW5DG2G6C3PD4Q7BYLJHCGCRRLRAKDY3NVIAQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:45:18.671793403 (68h28m23.60624754s) [noise=true , address=145.79.227.46:4602 , piece_id=DRUFEHS3GPEJAC667THBEZUG4GZRLLZYUYGNNBOTTW27QYDLOGYQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:45:19.116480417 (68h28m24.050934551s) [noise=true , address=145.79.227.39:4013 , piece_id=IZ32FZB2YA4CQAKG5CMW5OEQIUIGLNWABWAXPJEQ4JP7JZL5WNBA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:45:19.602945623 (68h28m24.537399748s) [noise=true , address=145.79.227.47:4270 , piece_id=3MVDVKVT6IJRR6OR3BAWE3ZJLUNFJKMN23FC2ZXZR742LP6G5FTQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: <nil>
Feb 20 16:45:20.190768336 (68h28m25.125222479s) [noise=true , address=145.79.227.10:4404 , piece_id=SG7QPEIP6BTTGA3WAAHTLJBOQGZ5NDRELBLHCTVXT6QLUY3SZLQQ, seg_pos={0 0}, upload=60200]: Done uploading piece. err: ecclient: upload failed (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b, address:145.79.227.10:4404): protocol: write tcp 139.59.144.22:51132->145.79.227.10:4404: use of closed network connection; write tcp 139.59.144.22:51132->145.79.227.10:4404: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51132->145.79.227.10:4404: use of closed network connection
Feb 20 16:45:20.190943768 (68h28m25.125397914s) [noise=true , address=145.79.227.43:4157 , piece_id=DMBQZODHBMJJNLX7N6THUA2OSI264AC4QYNO2V34HHA3OBUN7EOA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: write tcp 139.59.144.22:52494->145.79.227.43:4157: use of closed network connection; write tcp 139.59.144.22:52494->145.79.227.43:4157: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52494->145.79.227.43:4157: use of closed network connection
Feb 20 16:45:20.191073046 (68h28m25.125527193s) [noise=true , address=145.79.227.19:4080 , piece_id=ILIBB7LUYUSGL7XP57ZJGWVR25RUKGMGF52KK4AY2EHJ63XD5WJA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: ecclient: upload failed (node:12KK51wudKiZb39Ku7wZhgBYEYmgsZTHfjiNNLmpBU9uuNFapt3, address:145.79.227.19:4080): protocol: write tcp 139.59.144.22:49748->145.79.227.19:4080: use of closed network connection; write tcp 139.59.144.22:49748->145.79.227.19:4080: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49748->145.79.227.19:4080: use of closed network connection
Feb 20 16:45:20.191374693 (68h28m25.125828835s) [noise=true , address=145.79.227.40:4050 , piece_id=2AGPHLK5LNPGQ5KIBVZHETWSMPU4LVYFMVLQDCQKXVMTRXKXUFNA, seg_pos={0 0}, upload=60200]: Done uploading piece. err: ecclient: upload failed (node:12Vw9PtVFLQPpm2uGV55tCoK7VfopaBU4EcWNBUyqhNeJjgjG64, address:145.79.227.40:4050): protocol: write tcp 139.59.144.22:54470->145.79.227.40:4050: use of closed network connection; write tcp 139.59.144.22:54470->145.79.227.40:4050: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54470->145.79.227.40:4050: use of closed network connection
Feb 20 16:45:20.191414731 (68h28m25.125868865s) [seg_pos={0 0}, upload=60200]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Feb 20 16:45:20.300131418 (68h28m25.234585558s) [upload=60200]: Done uploading segments...
Feb 20 16:45:20.300208120 (68h28m25.23466226s) [upload=60200]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 2.270634642s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
311.061206ms target:
https://us1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/7c10297159ec23b3
FAIL (2026-02-20 17:25:40 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 311.077734ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.830914ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Type=application/xml X-Xss-Protection=1; mode=block Date=Fri, 20 Feb 2026 17:25:28 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=189604637450E5B6 X-Request-Id=JAP1krXe7cY Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/98df960b333657d
FAIL (2026-02-20 17:25:28 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189604637450E5B6</RequestId><HostId></HostId></Error>"
Duration: 7.854045ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
325.536527ms remote:
"tcp:45.38.24.2:443" response headers:
Server=Storj X-Xss-Protection=1; mode=block Date=Fri, 20 Feb 2026 17:25:24 GMT Accept-Ranges=bytes Content-Type=application/xml Vary=Origin X-Amz-Request-Id=189604627A04705F X-Request-Id=FBy89mjbgcK Content-Length=284 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/6c10e54306f3296a
FAIL (2026-02-20 17:25:24 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189604627A04705F</RequestId><HostId></HostId></Error>"
Duration: 325.568227ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
19.305234ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18960461C987A0B7 X-Request-Id=S7yhLoSDd21 Date=Fri, 20 Feb 2026 17:25:21 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/1e11cb61481a7964
FAIL (2026-02-20 17:25:21 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18960461C987A0B7</RequestId><HostId></HostId></Error>"
Duration: 19.366537ms
edge
gateway
vhost
bgp
eu1
|