Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
39 out of 60 is failed (threshold=3) [...................XXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXX.] duration:
28.111943534s trace:
https://jaeger.dev.storj.io/trace/30d8e2a6a3198912
FAIL (2026-02-24 18:45:26 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 28.111969048s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
36 out of 60 is failed (threshold=3) [.......................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.] duration:
30.002374052s trace:
https://jaeger.dev.storj.io/trace/65d78979415e911b
FAIL (2026-02-24 18:45:25 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:44:25.621738472 (166h27m30.55619262s) [upload=146303]: Starting upload
Feb 24 18:44:25.621822744 (166h27m30.556276878s) [upload=146303]: Done starting upload
Feb 24 18:44:25.621970435 (166h27m30.556424555s) [upload=146303]: Uploading segments...
Feb 24 18:44:25.623351481 (166h27m30.557805646s) [upload=146303]: Got next segment. Inline: false
Feb 24 18:44:25.623473970 (166h27m30.557928122s) [upload=146303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:44:25.623481806 (166h27m30.557935944s) [upload=146303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 24 18:44:34.935332081 (166h27m39.869786223s) [seg_pos={0 0}, upload=146303]: Begin upload segment...
Feb 24 18:44:34.935452908 (166h27m39.869907028s) [seg_pos={0 0}, upload=146303]: Done begin upload segment.
Feb 24 18:44:34.935470940 (166h27m39.869925072s) [noise=true , address=45.91.116.9:4263 , piece_id=W6M2YGDXWXWYQVWNIWFABEZ723EHRB3BXZFNXTNKIBW3G4YOUWHQ, seg_pos={0 0}, upload=146303]: Uploading piece...
Feb 24 18:44:34.935502977 (166h27m39.869957124s) [noise=true , address=145.79.227.6:4262 , piece_id=6TO6SW5M6ECKAW5HA227R3PJITUHDSBMQGYS2HJZ3K5OGW6W3QXA, seg_pos={0 0}, upload=146303]: Uploading piece...
Feb 24 18:44:34.936238244 (166h27m39.870692385s) [noise=true , address=145.79.227.38:4977 , piece_id=Z3KNZ7DD2ALJGOGH3HXV4POOXOJKIXDRIABLWPG43BMFCEVCWFPQ, seg_pos={0 0}, upload=146303]: Uploading piece...
Feb 24 18:44:34.936390553 (166h27m39.870844691s) [noise=true , address=145.79.227.41:4087 , piece_id=DAXOVZLTW6GDWIHBPIUJTWQOW4ALWS7VHZ4H7OQYXR5VNHBCHQGQ, seg_pos={0 0}, upload=146303]: Uploading piece...
Feb 24 18:44:34.936869913 (166h27m39.871324045s) [noise=true , address=145.79.227.43:4159 , piece_id=XDH4GF7FZIISYRZC4ARULDMW63K6KGZWDV5DJDHEV4SG5I2N54HQ, seg_pos={0 0}, upload=146303]: Uploading piece...
Feb 24 18:44:34.936916146 (166h27m39.871370306s) [noise=true , address=145.79.227.33:4871 , piece_id=4HDJKVWDUY3OH2ZMNKYMITP3XHKVO2LRDJG4PAI5X5X7CL2DZSUQ, seg_pos={0 0}, upload=146303]: Uploading piece...
Feb 24 18:44:34.937428088 (166h27m39.871882221s) [noise=true , address=145.79.227.15:4878 , piece_id=AZWM4XRDHIZ66AKA6XHVIWYA6XV4VTQB6YBYLP4QUYU7OGH5S7MQ, seg_pos={0 0}, upload=146303]: Uploading piece...
Feb 24 18:44:34.937598993 (166h27m39.872053131s) [noise=true , address=145.79.227.2:4114 , piece_id=PEEULOPECVYCZM6CAZWBUDPSR6M5BGZRQAAPO3TK4XTE27ZNM2JQ, seg_pos={0 0}, upload=146303]: Uploading piece...
Feb 24 18:44:34.938045240 (166h27m39.872499373s) [noise=true , address=79.127.219.38:4817 , piece_id=MONZTSKXVUK266AQBTR3QISWFJN55MDFBZTQDGAU4QWDFQV3YOUQ, seg_pos={0 0}, upload=146303]: Uploading piece...
Feb 24 18:44:34.938199591 (166h27m39.872653732s) [noise=true , address=145.79.227.20:4437 , piece_id=QC2U55FFJI2HPG2UAGGZWHWVP5ZHYVIQT5ZVGAJ4JTTYZCGCX7HA, seg_pos={0 0}, upload=146303]: Uploading piece...
Feb 24 18:44:34.938498023 (166h27m39.872952159s) [noise=true , address=145.79.227.23:4551 , piece_id=GANBLEY3IY5TVSR45EAWWHW6XA5UEVD73JQAH4NRAHB5UWE3H3PQ, seg_pos={0 0}, upload=146303]: Uploading piece...
Feb 24 18:44:34.938749086 (166h27m39.873203221s) [noise=true , address=145.79.227.27:4690 , piece_id=KKC2QAAHTWDDSJ5FGB57DOEU2RR4AJOBCEJOE4WHPPKC7NHQ4WGQ, seg_pos={0 0}, upload=146303]: Uploading piece...
Feb 24 18:44:34.939305313 (166h27m39.873759451s) [noise=true , address=45.91.116.4:4939 , piece_id=NQVKAQSGIEVY4VJKNZGQYROXAVML2VXBWJIHCLSTAK5LD3KPXNDQ, seg_pos={0 0}, upload=146303]: Uploading piece...
Feb 24 18:44:34.939770507 (166h27m39.874224651s) [noise=true , address=145.79.227.13:4806 , piece_id=XZX7DDIREJ3J4W56PQ6DYWW7UGL3LZMSZXMSESLL2OKBIDNERLVA, seg_pos={0 0}, upload=146303]: Uploading piece...
Feb 24 18:44:34.940298761 (166h27m39.874752887s) [noise=true , address=145.79.227.39:4013 , piece_id=QCNEO6IABSQOOUVZBWOX36TJW3YGKK5AVK3GJ5MBHYKZJBQL5UHQ, seg_pos={0 0}, upload=146303]: Uploading piece...
Feb 24 18:44:34.940508043 (166h27m39.874962175s) [noise=true , address=145.79.227.24:4584 , piece_id=RKS2O3PKXZ4S3HE2SBWPDAUO73EZTZMUQICLR5DBCLKO7OJJAHJQ, seg_pos={0 0}, upload=146303]: Uploading piece...
Feb 24 18:44:35.548093229 (166h27m40.482547366s) [upload=146303]: Next returned nil segment
Feb 24 18:44:35.548147298 (166h27m40.482601434s) [upload=146303]: Waiting for error group managing segments...
Feb 24 18:44:35.683777399 (166h27m40.618231543s) [noise=true , address=145.79.227.24:4584 , piece_id=RKS2O3PKXZ4S3HE2SBWPDAUO73EZTZMUQICLR5DBCLKO7OJJAHJQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil>
Feb 24 18:44:35.684454673 (166h27m40.618908805s) [noise=true , address=145.79.227.20:4437 , piece_id=QC2U55FFJI2HPG2UAGGZWHWVP5ZHYVIQT5ZVGAJ4JTTYZCGCX7HA, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil>
Feb 24 18:44:35.687431523 (166h27m40.621885664s) [noise=true , address=145.79.227.2:4114 , piece_id=PEEULOPECVYCZM6CAZWBUDPSR6M5BGZRQAAPO3TK4XTE27ZNM2JQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil>
Feb 24 18:44:35.688566587 (166h27m40.623020726s) [noise=true , address=145.79.227.39:4013 , piece_id=QCNEO6IABSQOOUVZBWOX36TJW3YGKK5AVK3GJ5MBHYKZJBQL5UHQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil>
Feb 24 18:44:35.689228447 (166h27m40.623682598s) [noise=true , address=145.79.227.6:4262 , piece_id=6TO6SW5M6ECKAW5HA227R3PJITUHDSBMQGYS2HJZ3K5OGW6W3QXA, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil>
Feb 24 18:44:35.691286463 (166h27m40.625740595s) [noise=true , address=45.91.116.4:4939 , piece_id=NQVKAQSGIEVY4VJKNZGQYROXAVML2VXBWJIHCLSTAK5LD3KPXNDQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil>
Feb 24 18:44:35.691717184 (166h27m40.626171317s) [noise=true , address=45.91.116.9:4263 , piece_id=W6M2YGDXWXWYQVWNIWFABEZ723EHRB3BXZFNXTNKIBW3G4YOUWHQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil>
Feb 24 18:44:35.694290576 (166h27m40.628744723s) [noise=true , address=145.79.227.13:4806 , piece_id=XZX7DDIREJ3J4W56PQ6DYWW7UGL3LZMSZXMSESLL2OKBIDNERLVA, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil>
Feb 24 18:44:35.697227409 (166h27m40.631681548s) [noise=true , address=145.79.227.33:4871 , piece_id=4HDJKVWDUY3OH2ZMNKYMITP3XHKVO2LRDJG4PAI5X5X7CL2DZSUQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil>
Feb 24 18:44:35.697288805 (166h27m40.631742946s) [noise=true , address=145.79.227.27:4690 , piece_id=KKC2QAAHTWDDSJ5FGB57DOEU2RR4AJOBCEJOE4WHPPKC7NHQ4WGQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil>
Feb 24 18:44:35.699730434 (166h27m40.634184574s) [noise=true , address=145.79.227.23:4551 , piece_id=GANBLEY3IY5TVSR45EAWWHW6XA5UEVD73JQAH4NRAHB5UWE3H3PQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil>
Feb 24 18:44:35.705833249 (166h27m40.640287381s) [noise=true , address=145.79.227.38:4977 , piece_id=Z3KNZ7DD2ALJGOGH3HXV4POOXOJKIXDRIABLWPG43BMFCEVCWFPQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil>
Feb 24 18:44:35.754105230 (166h27m40.688559366s) [noise=true , address=145.79.227.15:4878 , piece_id=AZWM4XRDHIZ66AKA6XHVIWYA6XV4VTQB6YBYLP4QUYU7OGH5S7MQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil>
Feb 24 18:44:35.754141889 (166h27m40.688596025s) [seg_pos={0 0}, upload=146303]: Satisfied cohort requirements after 13 pieces
Feb 24 18:44:35.754487434 (166h27m40.688941571s) [noise=true , address=145.79.227.43:4159 , piece_id=XDH4GF7FZIISYRZC4ARULDMW63K6KGZWDV5DJDHEV4SG5I2N54HQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ULUPKjJwZocjV1R6Dy7vmWSrZ4hKx3YAHLAihgtMKf8Uw2UgA): protocol: expected piece hash; context canceled; EOF
Feb 24 18:44:35.754498469 (166h27m40.688952605s) [noise=true , address=145.79.227.43:4159 , piece_id=XDH4GF7FZIISYRZC4ARULDMW63K6KGZWDV5DJDHEV4SG5I2N54HQ, seg_pos={0 0}, upload=146303]: Long tail cancellation due to optimal threshold
Feb 24 18:44:35.754536013 (166h27m40.688990157s) [noise=true , address=145.79.227.41:4087 , piece_id=DAXOVZLTW6GDWIHBPIUJTWQOW4ALWS7VHZ4H7OQYXR5VNHBCHQGQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BfeGD2MGRPqsBRGLioTiTAcPykpSTUUx2CBVSPQcz4LQqFdWR): protocol: expected piece hash; context canceled; EOF
Feb 24 18:44:35.754552737 (166h27m40.689006877s) [noise=true , address=145.79.227.41:4087 , piece_id=DAXOVZLTW6GDWIHBPIUJTWQOW4ALWS7VHZ4H7OQYXR5VNHBCHQGQ, seg_pos={0 0}, upload=146303]: Long tail cancellation due to optimal threshold
Feb 24 18:44:35.754742786 (166h27m40.689196928s) [noise=true , address=79.127.219.38:4817 , piece_id=MONZTSKXVUK266AQBTR3QISWFJN55MDFBZTQDGAU4QWDFQV3YOUQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1io2wPA1rsWxYwkFhiYwiKSeXQAuNDjqSxAdzkdJCdFsNpQLHZ): protocol: expected piece hash; context canceled; EOF
Feb 24 18:44:35.754754029 (166h27m40.689208167s) [noise=true , address=79.127.219.38:4817 , piece_id=MONZTSKXVUK266AQBTR3QISWFJN55MDFBZTQDGAU4QWDFQV3YOUQ, seg_pos={0 0}, upload=146303]: Long tail cancellation due to optimal threshold
Feb 24 18:44:35.754783245 (166h27m40.689237379s) [seg_pos={0 0}, upload=146303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 24 18:44:35.754901862 (166h27m40.689356004s) [upload=146303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 24 18:44:35.754909251 (166h27m40.689363389s) [upload=146303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:44:48.936885953 (166h27m53.871340088s) [upload=146303]: Done uploading segments...
Feb 24 18:44:48.936915118 (166h27m53.871369252s) [upload=146303]: Upload finished. err: <nil>
Duration: 30.002414758s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.701968ms remote:
"tcp:185.244.226.3:443" response headers:
Date=Tue, 24 Feb 2026 18:45:25 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=RQzyQtNaZxn X-Xss-Protection=1; mode=block Content-Type=application/xml Vary=Origin X-Amz-Request-Id=189743127EE5C8F4 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/1a2a5327f43cbc65
FAIL (2026-02-24 18:45:25 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189743127EE5C8F4</RequestId><HostId></HostId></Error>"
Duration: 10.73119ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.778643ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Request-Id=QekALf5J1Fu X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 18:45:24 GMT Content-Length=274 Vary=Origin X-Amz-Request-Id=189743126D0B2C4B target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/4c3871ab6ee21d5a
FAIL (2026-02-24 18:45:24 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189743126D0B2C4B</RequestId><HostId></HostId></Error>"
Duration: 10.800484ms
edge
gateway
vhost
bgp
eu1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
40 out of 60 is failed (threshold=3) [....................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.001797727s trace:
https://jaeger.dev.storj.io/trace/10dc5f232dfe5501
FAIL (2026-02-24 18:45:20 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001823335s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
30 out of 60 is failed (threshold=3) [...........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...] duration:
9.380458186s trace:
https://jaeger.dev.storj.io/trace/7fde6e39a6e83ecb
FAIL (2026-02-24 18:45:18 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 9.380485352s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
18 out of 60 is failed (threshold=3) [........................................XXXXXXXXXXXXXXXXXX..] duration:
25.574233256s trace:
https://jaeger.dev.storj.io/trace/73cef0d4f8588a82
FAIL (2026-02-24 18:45:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Feb 24 18:42:40.331706604 (166h25m45.266160746s) [upload=146280]: Starting upload Feb 24 18:42:40.331826626 (166h25m45.266280764s) [upload=146280]: Done starting upload Feb 24 18:42:40.331904481 (166h25m45.266358598s) [upload=146280]: Uploading segments... Feb 24 18:42:40.332266211 (166h25m45.266720352s) [upload=146280]: Got next segment. Inline: false Feb 24 18:42:40.332351248 (166h25m45.266805381s) [upload=146280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:42:40.332357321 (166h25m45.266811453s) [upload=146280]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Feb 24 18:43:40.022165933 (166h26m44.956620058s) [upload=146280]: Next segment err: context deadline exceeded Feb 24 18:43:40.022586871 (166h26m44.957040994s) [upload=146280]: Done uploading segments... Feb 24 18:43:40.022728565 (166h26m44.957182691s) [upload=146280]: Upload finished. err: context deadline exceeded
Duration: 25.574250318s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
39 out of 60 is failed (threshold=3) [...................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXXX.X] duration:
30.001835136s trace:
https://jaeger.dev.storj.io/trace/46ed736203e9448f
FAIL (2026-02-24 18:45:16 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 30.001857293s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
42 out of 60 is failed (threshold=3) [.................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXX] duration:
30.001584326s trace:
https://jaeger.dev.storj.io/trace/7f0556b50233dcf
FAIL (2026-02-24 18:45:08 UTC)
orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:44:38.736661269 (166h27m43.671115407s) [upload=146306]: Starting upload Feb 24 18:44:38.736789536 (166h27m43.67124368s) [upload=146306]: Done starting upload Feb 24 18:44:38.736870341 (166h27m43.671324482s) [upload=146306]: Uploading segments... Feb 24 18:44:38.737444496 (166h27m43.671898631s) [upload=146306]: Got next segment. Inline: true Feb 24 18:44:38.737459641 (166h27m43.671913778s) [upload=146306]: Waiting for error group managing segments... Feb 24 18:44:38.737569732 (166h27m43.672023869s) [upload=146306]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:44:38.737603924 (166h27m43.672058062s) [upload=146306]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Feb 24 18:44:38.737612113 (166h27m43.672066252s) [upload=146306]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Feb 24 18:44:55.029518776 (166h27m59.96397291s) [upload=146306]: Done uploading segments... Feb 24 18:44:55.029540622 (166h27m59.96399476s) [upload=146306]: Upload finished. err: <nil>
Duration: 30.001678731s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
19 out of 60 is failed (threshold=6) [....X....X..XX..X.................X...XX...X.XX.XXXX..XX.XX.] duration:
2.059627131s trace:
https://jaeger.dev.storj.io/trace/735f4b0581be18ee
FAIL (2026-02-24 18:45:08 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.059670695s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.501517ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=YqQWLXX6D4B X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 18:45:01 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=1897430CF390D059 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/6c2316ce46a385dc
FAIL (2026-02-24 18:45:01 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897430CF390D059</RequestId><HostId></HostId></Error>"
Duration: 9.532361ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.371728ms remote:
"tcp:185.244.226.3:443" response headers:
Server=Storj Vary=Origin X-Amz-Request-Id=1897430C459785DE X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 18:44:58 GMT Content-Type=application/xml X-Request-Id=LtjXPkYPgnf Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/126681ab5d27f41a
FAIL (2026-02-24 18:44:58 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897430C459785DE</RequestId><HostId></HostId></Error>"
Duration: 12.45959ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
36 out of 60 is failed (threshold=3) [........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.002710497s trace:
https://jaeger.dev.storj.io/trace/65d78979415e911b
FAIL (2026-02-24 18:44:55 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:44:25.621738472 (166h27m30.55619262s) [upload=146303]: Starting upload
Feb 24 18:44:25.621822744 (166h27m30.556276878s) [upload=146303]: Done starting upload
Feb 24 18:44:25.621970435 (166h27m30.556424555s) [upload=146303]: Uploading segments...
Feb 24 18:44:25.623351481 (166h27m30.557805646s) [upload=146303]: Got next segment. Inline: false
Feb 24 18:44:25.623473970 (166h27m30.557928122s) [upload=146303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:44:25.623481806 (166h27m30.557935944s) [upload=146303]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 24 18:44:34.935332081 (166h27m39.869786223s) [seg_pos={0 0}, upload=146303]: Begin upload segment...
Feb 24 18:44:34.935452908 (166h27m39.869907028s) [seg_pos={0 0}, upload=146303]: Done begin upload segment.
Feb 24 18:44:34.935470940 (166h27m39.869925072s) [noise=true , address=45.91.116.9:4263 , piece_id=W6M2YGDXWXWYQVWNIWFABEZ723EHRB3BXZFNXTNKIBW3G4YOUWHQ, seg_pos={0 0}, upload=146303]: Uploading piece...
Feb 24 18:44:34.935502977 (166h27m39.869957124s) [noise=true , address=145.79.227.6:4262 , piece_id=6TO6SW5M6ECKAW5HA227R3PJITUHDSBMQGYS2HJZ3K5OGW6W3QXA, seg_pos={0 0}, upload=146303]: Uploading piece...
Feb 24 18:44:34.936238244 (166h27m39.870692385s) [noise=true , address=145.79.227.38:4977 , piece_id=Z3KNZ7DD2ALJGOGH3HXV4POOXOJKIXDRIABLWPG43BMFCEVCWFPQ, seg_pos={0 0}, upload=146303]: Uploading piece...
Feb 24 18:44:34.936390553 (166h27m39.870844691s) [noise=true , address=145.79.227.41:4087 , piece_id=DAXOVZLTW6GDWIHBPIUJTWQOW4ALWS7VHZ4H7OQYXR5VNHBCHQGQ, seg_pos={0 0}, upload=146303]: Uploading piece...
Feb 24 18:44:34.936869913 (166h27m39.871324045s) [noise=true , address=145.79.227.43:4159 , piece_id=XDH4GF7FZIISYRZC4ARULDMW63K6KGZWDV5DJDHEV4SG5I2N54HQ, seg_pos={0 0}, upload=146303]: Uploading piece...
Feb 24 18:44:34.936916146 (166h27m39.871370306s) [noise=true , address=145.79.227.33:4871 , piece_id=4HDJKVWDUY3OH2ZMNKYMITP3XHKVO2LRDJG4PAI5X5X7CL2DZSUQ, seg_pos={0 0}, upload=146303]: Uploading piece...
Feb 24 18:44:34.937428088 (166h27m39.871882221s) [noise=true , address=145.79.227.15:4878 , piece_id=AZWM4XRDHIZ66AKA6XHVIWYA6XV4VTQB6YBYLP4QUYU7OGH5S7MQ, seg_pos={0 0}, upload=146303]: Uploading piece...
Feb 24 18:44:34.937598993 (166h27m39.872053131s) [noise=true , address=145.79.227.2:4114 , piece_id=PEEULOPECVYCZM6CAZWBUDPSR6M5BGZRQAAPO3TK4XTE27ZNM2JQ, seg_pos={0 0}, upload=146303]: Uploading piece...
Feb 24 18:44:34.938045240 (166h27m39.872499373s) [noise=true , address=79.127.219.38:4817 , piece_id=MONZTSKXVUK266AQBTR3QISWFJN55MDFBZTQDGAU4QWDFQV3YOUQ, seg_pos={0 0}, upload=146303]: Uploading piece...
Feb 24 18:44:34.938199591 (166h27m39.872653732s) [noise=true , address=145.79.227.20:4437 , piece_id=QC2U55FFJI2HPG2UAGGZWHWVP5ZHYVIQT5ZVGAJ4JTTYZCGCX7HA, seg_pos={0 0}, upload=146303]: Uploading piece...
Feb 24 18:44:34.938498023 (166h27m39.872952159s) [noise=true , address=145.79.227.23:4551 , piece_id=GANBLEY3IY5TVSR45EAWWHW6XA5UEVD73JQAH4NRAHB5UWE3H3PQ, seg_pos={0 0}, upload=146303]: Uploading piece...
Feb 24 18:44:34.938749086 (166h27m39.873203221s) [noise=true , address=145.79.227.27:4690 , piece_id=KKC2QAAHTWDDSJ5FGB57DOEU2RR4AJOBCEJOE4WHPPKC7NHQ4WGQ, seg_pos={0 0}, upload=146303]: Uploading piece...
Feb 24 18:44:34.939305313 (166h27m39.873759451s) [noise=true , address=45.91.116.4:4939 , piece_id=NQVKAQSGIEVY4VJKNZGQYROXAVML2VXBWJIHCLSTAK5LD3KPXNDQ, seg_pos={0 0}, upload=146303]: Uploading piece...
Feb 24 18:44:34.939770507 (166h27m39.874224651s) [noise=true , address=145.79.227.13:4806 , piece_id=XZX7DDIREJ3J4W56PQ6DYWW7UGL3LZMSZXMSESLL2OKBIDNERLVA, seg_pos={0 0}, upload=146303]: Uploading piece...
Feb 24 18:44:34.940298761 (166h27m39.874752887s) [noise=true , address=145.79.227.39:4013 , piece_id=QCNEO6IABSQOOUVZBWOX36TJW3YGKK5AVK3GJ5MBHYKZJBQL5UHQ, seg_pos={0 0}, upload=146303]: Uploading piece...
Feb 24 18:44:34.940508043 (166h27m39.874962175s) [noise=true , address=145.79.227.24:4584 , piece_id=RKS2O3PKXZ4S3HE2SBWPDAUO73EZTZMUQICLR5DBCLKO7OJJAHJQ, seg_pos={0 0}, upload=146303]: Uploading piece...
Feb 24 18:44:35.548093229 (166h27m40.482547366s) [upload=146303]: Next returned nil segment
Feb 24 18:44:35.548147298 (166h27m40.482601434s) [upload=146303]: Waiting for error group managing segments...
Feb 24 18:44:35.683777399 (166h27m40.618231543s) [noise=true , address=145.79.227.24:4584 , piece_id=RKS2O3PKXZ4S3HE2SBWPDAUO73EZTZMUQICLR5DBCLKO7OJJAHJQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil>
Feb 24 18:44:35.684454673 (166h27m40.618908805s) [noise=true , address=145.79.227.20:4437 , piece_id=QC2U55FFJI2HPG2UAGGZWHWVP5ZHYVIQT5ZVGAJ4JTTYZCGCX7HA, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil>
Feb 24 18:44:35.687431523 (166h27m40.621885664s) [noise=true , address=145.79.227.2:4114 , piece_id=PEEULOPECVYCZM6CAZWBUDPSR6M5BGZRQAAPO3TK4XTE27ZNM2JQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil>
Feb 24 18:44:35.688566587 (166h27m40.623020726s) [noise=true , address=145.79.227.39:4013 , piece_id=QCNEO6IABSQOOUVZBWOX36TJW3YGKK5AVK3GJ5MBHYKZJBQL5UHQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil>
Feb 24 18:44:35.689228447 (166h27m40.623682598s) [noise=true , address=145.79.227.6:4262 , piece_id=6TO6SW5M6ECKAW5HA227R3PJITUHDSBMQGYS2HJZ3K5OGW6W3QXA, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil>
Feb 24 18:44:35.691286463 (166h27m40.625740595s) [noise=true , address=45.91.116.4:4939 , piece_id=NQVKAQSGIEVY4VJKNZGQYROXAVML2VXBWJIHCLSTAK5LD3KPXNDQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil>
Feb 24 18:44:35.691717184 (166h27m40.626171317s) [noise=true , address=45.91.116.9:4263 , piece_id=W6M2YGDXWXWYQVWNIWFABEZ723EHRB3BXZFNXTNKIBW3G4YOUWHQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil>
Feb 24 18:44:35.694290576 (166h27m40.628744723s) [noise=true , address=145.79.227.13:4806 , piece_id=XZX7DDIREJ3J4W56PQ6DYWW7UGL3LZMSZXMSESLL2OKBIDNERLVA, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil>
Feb 24 18:44:35.697227409 (166h27m40.631681548s) [noise=true , address=145.79.227.33:4871 , piece_id=4HDJKVWDUY3OH2ZMNKYMITP3XHKVO2LRDJG4PAI5X5X7CL2DZSUQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil>
Feb 24 18:44:35.697288805 (166h27m40.631742946s) [noise=true , address=145.79.227.27:4690 , piece_id=KKC2QAAHTWDDSJ5FGB57DOEU2RR4AJOBCEJOE4WHPPKC7NHQ4WGQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil>
Feb 24 18:44:35.699730434 (166h27m40.634184574s) [noise=true , address=145.79.227.23:4551 , piece_id=GANBLEY3IY5TVSR45EAWWHW6XA5UEVD73JQAH4NRAHB5UWE3H3PQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil>
Feb 24 18:44:35.705833249 (166h27m40.640287381s) [noise=true , address=145.79.227.38:4977 , piece_id=Z3KNZ7DD2ALJGOGH3HXV4POOXOJKIXDRIABLWPG43BMFCEVCWFPQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil>
Feb 24 18:44:35.754105230 (166h27m40.688559366s) [noise=true , address=145.79.227.15:4878 , piece_id=AZWM4XRDHIZ66AKA6XHVIWYA6XV4VTQB6YBYLP4QUYU7OGH5S7MQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil>
Feb 24 18:44:35.754141889 (166h27m40.688596025s) [seg_pos={0 0}, upload=146303]: Satisfied cohort requirements after 13 pieces
Feb 24 18:44:35.754487434 (166h27m40.688941571s) [noise=true , address=145.79.227.43:4159 , piece_id=XDH4GF7FZIISYRZC4ARULDMW63K6KGZWDV5DJDHEV4SG5I2N54HQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ULUPKjJwZocjV1R6Dy7vmWSrZ4hKx3YAHLAihgtMKf8Uw2UgA): protocol: expected piece hash; context canceled; EOF
Feb 24 18:44:35.754498469 (166h27m40.688952605s) [noise=true , address=145.79.227.43:4159 , piece_id=XDH4GF7FZIISYRZC4ARULDMW63K6KGZWDV5DJDHEV4SG5I2N54HQ, seg_pos={0 0}, upload=146303]: Long tail cancellation due to optimal threshold
Feb 24 18:44:35.754536013 (166h27m40.688990157s) [noise=true , address=145.79.227.41:4087 , piece_id=DAXOVZLTW6GDWIHBPIUJTWQOW4ALWS7VHZ4H7OQYXR5VNHBCHQGQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BfeGD2MGRPqsBRGLioTiTAcPykpSTUUx2CBVSPQcz4LQqFdWR): protocol: expected piece hash; context canceled; EOF
Feb 24 18:44:35.754552737 (166h27m40.689006877s) [noise=true , address=145.79.227.41:4087 , piece_id=DAXOVZLTW6GDWIHBPIUJTWQOW4ALWS7VHZ4H7OQYXR5VNHBCHQGQ, seg_pos={0 0}, upload=146303]: Long tail cancellation due to optimal threshold
Feb 24 18:44:35.754742786 (166h27m40.689196928s) [noise=true , address=79.127.219.38:4817 , piece_id=MONZTSKXVUK266AQBTR3QISWFJN55MDFBZTQDGAU4QWDFQV3YOUQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1io2wPA1rsWxYwkFhiYwiKSeXQAuNDjqSxAdzkdJCdFsNpQLHZ): protocol: expected piece hash; context canceled; EOF
Feb 24 18:44:35.754754029 (166h27m40.689208167s) [noise=true , address=79.127.219.38:4817 , piece_id=MONZTSKXVUK266AQBTR3QISWFJN55MDFBZTQDGAU4QWDFQV3YOUQ, seg_pos={0 0}, upload=146303]: Long tail cancellation due to optimal threshold
Feb 24 18:44:35.754783245 (166h27m40.689237379s) [seg_pos={0 0}, upload=146303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 24 18:44:35.754901862 (166h27m40.689356004s) [upload=146303]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 24 18:44:35.754909251 (166h27m40.689363389s) [upload=146303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:44:48.936885953 (166h27m53.871340088s) [upload=146303]: Done uploading segments...
Feb 24 18:44:48.936915118 (166h27m53.871369252s) [upload=146303]: Upload finished. err: <nil>
Duration: 30.002740202s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
19 out of 60 is failed (threshold=6) [.....X....X..XX..X.................X...XX...X.XX.XXXX..XX.XX] duration:
5.001259326s trace:
https://jaeger.dev.storj.io/trace/735f4b0581be18ee
FAIL (2026-02-24 18:44:54 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001697857s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
292.323855ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=1897430A41499FB6 X-Request-Id=At2bgHDUhJE Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 18:44:49 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/5a5ed7f6612a70f1
FAIL (2026-02-24 18:44:49 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897430A41499FB6</RequestId><HostId></HostId></Error>"
Duration: 292.350255ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
39 out of 60 is failed (threshold=3) [....................XXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXX] duration:
30.001578472s trace:
https://jaeger.dev.storj.io/trace/30d8e2a6a3198912
FAIL (2026-02-24 18:44:48 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001604419s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
30 out of 60 is failed (threshold=3) [............................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..] duration:
8.05026801s trace:
https://jaeger.dev.storj.io/trace/7fde6e39a6e83ecb
FAIL (2026-02-24 18:44:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 8.050297436s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
41 out of 60 is failed (threshold=3) [..................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.] duration:
13.303602261s trace:
https://jaeger.dev.storj.io/trace/55750a6cec7fc997
FAIL (2026-02-24 18:44:44 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 13.303633563s
core
uplink
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.229758ms remote:
"tcp:185.244.226.3:443" response headers:
X-Xss-Protection=1; mode=block Accept-Ranges=bytes Vary=Origin Date=Tue, 24 Feb 2026 18:44:42 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1897430884CA2670 X-Request-Id=HWRRCeEyTrt target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/d722b80d9f7a870
FAIL (2026-02-24 18:44:42 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897430884CA2670</RequestId><HostId></HostId></Error>"
Duration: 7.253972ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
31 out of 60 is failed (threshold=3) [............................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.] duration:
29.476412794s trace:
https://jaeger.dev.storj.io/trace/7ebec86835c4464b
FAIL (2026-02-24 18:44:41 UTC)
orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:43:06.746940362 (166h26m11.681394495s) [upload=146286]: Starting upload Feb 24 18:43:06.747106775 (166h26m11.681560915s) [upload=146286]: Done starting upload Feb 24 18:43:06.747390196 (166h26m11.681844318s) [upload=146286]: Uploading segments... Feb 24 18:43:06.747735916 (166h26m11.682190059s) [upload=146286]: Got next segment. Inline: true Feb 24 18:43:06.747744937 (166h26m11.682199074s) [upload=146286]: Waiting for error group managing segments... Feb 24 18:43:06.747919695 (166h26m11.682373826s) [upload=146286]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:43:06.747926018 (166h26m11.68238015s) [upload=146286]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Feb 24 18:43:06.747929848 (166h26m11.68238398s) [upload=146286]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Feb 24 18:43:47.388785505 (166h26m52.32323964s) [upload=146286]: Done uploading segments... Feb 24 18:43:47.388809684 (166h26m52.323263817s) [upload=146286]: Upload finished. err: <nil>
Duration: 29.47646277s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.551351ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Type=application/xml Vary=Origin X-Amz-Request-Id=189743072AA7A7E3 X-Request-Id=jaiZUHrGhDu X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Date=Tue, 24 Feb 2026 18:44:36 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/d7f63e61375b96b
FAIL (2026-02-24 18:44:36 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189743072AA7A7E3</RequestId><HostId></HostId></Error>"
Duration: 12.576804ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)antiblip:
14 out of 60 is failed (threshold=6) [.......................................XX.XX.XXXXX.XX.XXX...] duration:
119.292431ms remote:
"tcp:185.244.226.4:443" target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/43ad6243e9f92940
FAIL (2026-02-24 18:44:32 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 119.386046ms
edge
linksharing
bgp
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
18 out of 60 is failed (threshold=6) [......X....X..XX..X.................X...XX...X.XX.XXXX..XX.X] duration:
5.001118772s trace:
https://jaeger.dev.storj.io/trace/491ae0a448d76a00
FAIL (2026-02-24 18:44:21 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 5.001147747s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.29861ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin Content-Length=274 Server=Storj X-Amz-Request-Id=18974302D6BE4343 X-Request-Id=G8AVzcCzkzC X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 18:44:17 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/1e1414c323545831
FAIL (2026-02-24 18:44:17 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18974302D6BE4343</RequestId><HostId></HostId></Error>"
Duration: 13.318425ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
41 out of 60 is failed (threshold=3) [...................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.006953503s trace:
https://jaeger.dev.storj.io/trace/55750a6cec7fc997
FAIL (2026-02-24 18:44:16 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 30.007040548s
core
uplink
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
30 out of 60 is failed (threshold=3) [.............................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.] duration:
15.32615687s trace:
https://jaeger.dev.storj.io/trace/7fde6e39a6e83ecb
FAIL (2026-02-24 18:44:15 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 15.32617872s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
39 out of 60 is failed (threshold=3) [.....................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.001038616s trace:
https://jaeger.dev.storj.io/trace/75836c50fef4c937
FAIL (2026-02-24 18:44:09 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001064947s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
31 out of 60 is failed (threshold=3) [.............................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
1m0.000994284s trace:
https://jaeger.dev.storj.io/trace/7ebec86835c4464b
FAIL (2026-02-24 18:44:06 UTC)
orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:43:06.746940362 (166h26m11.681394495s) [upload=146286]: Starting upload Feb 24 18:43:06.747106775 (166h26m11.681560915s) [upload=146286]: Done starting upload Feb 24 18:43:06.747390196 (166h26m11.681844318s) [upload=146286]: Uploading segments... Feb 24 18:43:06.747735916 (166h26m11.682190059s) [upload=146286]: Got next segment. Inline: true Feb 24 18:43:06.747744937 (166h26m11.682199074s) [upload=146286]: Waiting for error group managing segments... Feb 24 18:43:06.747919695 (166h26m11.682373826s) [upload=146286]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:43:06.747926018 (166h26m11.68238015s) [upload=146286]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Feb 24 18:43:06.747929848 (166h26m11.68238398s) [upload=146286]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Feb 24 18:43:47.388785505 (166h26m52.32323964s) [upload=146286]: Done uploading segments... Feb 24 18:43:47.388809684 (166h26m52.323263817s) [upload=146286]: Upload finished. err: <nil>
Duration: 1m0.001009787s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
18 out of 60 is failed (threshold=3) [.........................................XXXXXXXXXXXXXXXXXX.] duration:
22.021085572s trace:
https://jaeger.dev.storj.io/trace/73cef0d4f8588a82
FAIL (2026-02-24 18:44:02 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Feb 24 18:42:40.331706604 (166h25m45.266160746s) [upload=146280]: Starting upload Feb 24 18:42:40.331826626 (166h25m45.266280764s) [upload=146280]: Done starting upload Feb 24 18:42:40.331904481 (166h25m45.266358598s) [upload=146280]: Uploading segments... Feb 24 18:42:40.332266211 (166h25m45.266720352s) [upload=146280]: Got next segment. Inline: false Feb 24 18:42:40.332351248 (166h25m45.266805381s) [upload=146280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:42:40.332357321 (166h25m45.266811453s) [upload=146280]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Feb 24 18:43:40.022165933 (166h26m44.956620058s) [upload=146280]: Next segment err: context deadline exceeded Feb 24 18:43:40.022586871 (166h26m44.957040994s) [upload=146280]: Done uploading segments... Feb 24 18:43:40.022728565 (166h26m44.957182691s) [upload=146280]: Upload finished. err: context deadline exceeded
Duration: 22.021112305s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
30 out of 60 is failed (threshold=3) [..............................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
1m0.001142015s trace:
https://jaeger.dev.storj.io/trace/7fde6e39a6e83ecb
FAIL (2026-02-24 18:43:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.001156543s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
38 out of 60 is failed (threshold=3) [....................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXXX.] duration:
23.264463765s trace:
https://jaeger.dev.storj.io/trace/69dbbbdee3724edd
FAIL (2026-02-24 18:43:57 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 23.264488324s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
41 out of 60 is failed (threshold=3) [..................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XX] duration:
30.000793548s trace:
https://jaeger.dev.storj.io/trace/7a3994efd4755bcd
FAIL (2026-02-24 18:43:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:43:26.851104246 (166h26m31.785558382s) [upload=146292]: Starting upload Feb 24 18:43:26.851253850 (166h26m31.785707982s) [upload=146292]: Done starting upload Feb 24 18:43:26.851322961 (166h26m31.785777082s) [upload=146292]: Uploading segments... Feb 24 18:43:26.851415107 (166h26m31.785869239s) [upload=146292]: Got next segment. Inline: true Feb 24 18:43:26.851421665 (166h26m31.785875797s) [upload=146292]: Waiting for error group managing segments... Feb 24 18:43:26.851503870 (166h26m31.785958002s) [upload=146292]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:43:26.851509611 (166h26m31.785963744s) [upload=146292]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Feb 24 18:43:26.851513115 (166h26m31.785967246s) [upload=146292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Feb 24 18:43:56.557275701 (166h27m1.491729838s) [upload=146292]: Done uploading segments... Feb 24 18:43:56.557311067 (166h27m1.491765205s) [upload=146292]: Upload finished. err: metaclient: context deadline exceeded
Duration: 30.000818371s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.969289ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=XEsR5JjkX3x Date=Tue, 24 Feb 2026 18:43:54 GMT Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Amz-Request-Id=189742FD72CA0CC0 X-Xss-Protection=1; mode=block Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/11270b872317004f
FAIL (2026-02-24 18:43:54 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189742FD72CA0CC0</RequestId><HostId></HostId></Error>"
Duration: 7.997967ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
297.974024ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=VecCMQd8ux X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 18:43:53 GMT Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Server=Storj X-Amz-Request-Id=189742FD16A5F478 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/132633671ecbea52
FAIL (2026-02-24 18:43:53 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189742FD16A5F478</RequestId><HostId></HostId></Error>"
Duration: 297.996546ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.679128ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Type=application/xml Vary=Origin X-Amz-Request-Id=189742FD36D82113 X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 18:43:53 GMT Accept-Ranges=bytes Content-Length=274 Server=Storj X-Request-Id=N2MSmHRAcHA Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/3cbffd4eb319eba9
FAIL (2026-02-24 18:43:53 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189742FD36D82113</RequestId><HostId></HostId></Error>"
Duration: 10.707191ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
35 out of 60 is failed (threshold=3) [.........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.106811309s trace:
https://jaeger.dev.storj.io/trace/491ecd12ba9e05d3
FAIL (2026-02-24 18:43:52 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0)
======LOGS======
8s) [noise=true , address=45.91.116.11:4118 , piece_id=KVKPDLIXTVNF54P2LXZYDVAYPE7L44PF6AALIMGKCKO2DXQUYYIQ, seg_pos={0 0}, upload=146290]: Uploading piece...
Feb 24 18:43:52.125866800 (166h26m57.060320923s) [noise=true , address=145.79.227.41:4086 , piece_id=XOE2AM4V7AUQKFFHNCGJ5FI4ERBUBH7DKVQQMMW7J2VAG2KDQGHA, seg_pos={0 0}, upload=146290]: Uploading piece...
Feb 24 18:43:52.126365030 (166h26m57.060819171s) [noise=true , address=145.79.227.7:4296 , piece_id=Z7DDVWHTECK7T34NYF3GCI37YJ3YCPGAUQBK7IFQFYBXQRNYDFKA, seg_pos={0 0}, upload=146290]: Uploading piece...
Feb 24 18:43:52.128274599 (166h26m57.062728748s) [noise=true , address=145.79.227.16:4914 , piece_id=O66YQIITX3LPZC54TTYVFTO352XIMODCCBXRYXWYQM2B4FYFVGSA, seg_pos={0 0}, upload=146290]: Uploading piece...
Feb 24 18:43:52.130521066 (166h26m57.064975209s) [noise=true , address=145.79.227.27:4695 , piece_id=XLCPEYBK5TTNY477GHAZCI75FLJPLJLZYJDPU3B4XPTNPH44KSZQ, seg_pos={0 0}, upload=146290]: Uploading piece...
Feb 24 18:43:52.131216344 (166h26m57.065670487s) [noise=true , address=145.79.227.31:4797 , piece_id=ZGXCNCRZLRJ2BXP76WLLXDLQD7E4IGJQEKL63Q5U6PKFAJEPZHDQ, seg_pos={0 0}, upload=146290]: Uploading piece...
Feb 24 18:43:52.134413421 (166h26m57.06886756s) [noise=true , address=45.91.116.13:4188 , piece_id=PGWTAD5MYKYD3MIDFEHEV6JQGPQDXBQ734K4DJ7MRBNWVLAOBRLQ, seg_pos={0 0}, upload=146290]: Uploading piece...
Feb 24 18:43:52.135071665 (166h26m57.069525805s) [noise=true , address=145.79.227.42:4124 , piece_id=S7L3BOB6APCTUTICX5NET6ELRTF4ZKEOAZQAJNX47SSHHWFJ4QHQ, seg_pos={0 0}, upload=146290]: Uploading piece...
Feb 24 18:43:52.135693590 (166h26m57.070147722s) [noise=true , address=145.79.227.32:4838 , piece_id=POLUCYEAYXPFRQC4MZDDE5JWKVA7F2HCACSGSPAACIDKCWZQRMYQ, seg_pos={0 0}, upload=146290]: Uploading piece...
Feb 24 18:43:52.136963470 (166h26m57.071417612s) [noise=true , address=145.79.227.45:4233 , piece_id=VUF3GYVWLPB4PF6FKVP3JBIA3YGFN5GKQUI3CIA6MWYIVZNJEKTQ, seg_pos={0 0}, upload=146290]: Uploading piece...
Feb 24 18:43:52.393935303 (166h26m57.328389436s) [noise=true , address=145.79.227.24:4587 , piece_id=CHBO3VEX72NWS2EAENB5A3P7XZZDUFP4PRE455LQTHZRZCDOUW6A, seg_pos={0 0}, upload=146290]: Done uploading piece. err: ecclient: upload failed (node:1T4C5mqpUTmi8sZq38KuFakx6Xh6FTVBn5jCFqFHr5GAyBBDaY, address:145.79.227.24:4587): protocol: read tcp 139.59.144.22:35364->145.79.227.24:4587: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 18:43:52.394022546 (166h26m57.328476688s) [noise=true , address=145.79.227.31:4797 , piece_id=ZGXCNCRZLRJ2BXP76WLLXDLQD7E4IGJQEKL63Q5U6PKFAJEPZHDQ, seg_pos={0 0}, upload=146290]: Done uploading piece. err: ecclient: upload failed (node:1VwwhXQqXCHcgP37bcQAUA6urv5YGVt7NCpRNrqMKSSE5AScK9, address:145.79.227.31:4797): protocol: read tcp 139.59.144.22:40780->145.79.227.31:4797: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 18:43:52.394066125 (166h26m57.328520269s) [upload=146290]: Next segment err: context deadline exceeded
Feb 24 18:43:52.394162742 (166h26m57.328616881s) [noise=true , address=145.79.227.7:4296 , piece_id=Z7DDVWHTECK7T34NYF3GCI37YJ3YCPGAUQBK7IFQFYBXQRNYDFKA, seg_pos={0 0}, upload=146290]: Done uploading piece. err: ecclient: upload failed (node:12cKhDbA4ptwux2LYNPNAJ7Qh8jECsGWd1KWaK6T6pD38bJWdt1, address:145.79.227.7:4296): protocol: read tcp 139.59.144.22:47178->145.79.227.7:4296: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 18:43:52.394244634 (166h26m57.328698774s) [noise=true , address=145.79.227.16:4914 , piece_id=O66YQIITX3LPZC54TTYVFTO352XIMODCCBXRYXWYQM2B4FYFVGSA, seg_pos={0 0}, upload=146290]: Done uploading piece. err: ecclient: upload failed (node:1MArPyMrdvyw4VFuArmattTtneNTaN5mt82nfGwY2sKHvQnL5D, address:145.79.227.16:4914): protocol: read tcp 139.59.144.22:54844->145.79.227.16:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 18:43:52.394425171 (166h26m57.32887933s) [noise=true , address=145.79.227.27:4695 , piece_id=XLCPEYBK5TTNY477GHAZCI75FLJPLJLZYJDPU3B4XPTNPH44KSZQ, seg_pos={0 0}, upload=146290]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: read tcp 139.59.144.22:50788->145.79.227.27:4695: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 18:43:52.394590532 (166h26m57.32904469s) [noise=true , address=145.79.227.45:4233 , piece_id=VUF3GYVWLPB4PF6FKVP3JBIA3YGFN5GKQUI3CIA6MWYIVZNJEKTQ, seg_pos={0 0}, upload=146290]: Done uploading piece. err: ecclient: upload failed (node:1DmQeoQWTnFhQeJFseJoNYzFyo7vZjYKwDtQVJ6pomksWExsTb, address:145.79.227.45:4233): protocol: read tcp 139.59.144.22:49664->145.79.227.45:4233: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 18:43:52.394774616 (166h26m57.329228758s) [noise=true , address=79.127.219.45:4858 , piece_id=TFUC5UJOTRLPEAQI7GKXPZS3AT2AWVNGS6QUBWDSDILS3K6VXYDA, seg_pos={0 0}, upload=146290]: Done uploading piece. err: ecclient: upload failed (node:12th5qojBHVBq6Br5SMAXRUbKTmKFmiiMXbtsJ1f9S87yKzNADd, address:79.127.219.45:4858): protocol: read tcp 139.59.144.22:60862->79.127.219.45:4858: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 18:43:52.394949549 (166h26m57.329403694s) [noise=true , address=45.91.116.13:4188 , piece_id=PGWTAD5MYKYD3MIDFEHEV6JQGPQDXBQ734K4DJ7MRBNWVLAOBRLQ, seg_pos={0 0}, upload=146290]: Done uploading piece. err: ecclient: upload failed (node:1dEMooKrbS5txU9AHsEUTtpfuVs1vGjVhHfeNG64n6TkPUhPvX, address:45.91.116.13:4188): protocol: read tcp 139.59.144.22:57800->45.91.116.13:4188: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 18:43:52.395064341 (166h26m57.329518479s) [noise=true , address=145.79.227.42:4124 , piece_id=S7L3BOB6APCTUTICX5NET6ELRTF4ZKEOAZQAJNX47SSHHWFJ4QHQ, seg_pos={0 0}, upload=146290]: Done uploading piece. err: ecclient: upload failed (node:12kz79BpzkFLTxbgi2Tjvz4dStT7MtrQ4GmX6bFnYw8v45jBaSy, address:145.79.227.42:4124): protocol: read tcp 139.59.144.22:50364->145.79.227.42:4124: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 18:43:52.395383843 (166h26m57.329837976s) [noise=true , address=145.79.227.8:4334 , piece_id=4OGXQ7SDL7AQRY6JZ2OOZMD5JD4DYBTMI4GGTW6OEWOA3HTO7WLQ, seg_pos={0 0}, upload=146290]: Done uploading piece. err: ecclient: upload failed (node:12KYMZAFsJbhWC4CdKRod2Z6qsC6ANcpqmpWSWx7UYajp6JvKH1, address:145.79.227.8:4334): protocol: read tcp 139.59.144.22:37222->145.79.227.8:4334: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 18:43:52.395412465 (166h26m57.329866598s) [noise=true , address=77.90.31.14:4664 , piece_id=5DP27D7BAAPLGJLWK47WZAWPARRT55XPKEZN7WWDJBZSYUSCDPYA, seg_pos={0 0}, upload=146290]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 139.59.144.22:56226->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 18:43:52.395462854 (166h26m57.329916995s) [noise=true , address=145.79.227.32:4838 , piece_id=POLUCYEAYXPFRQC4MZDDE5JWKVA7F2HCACSGSPAACIDKCWZQRMYQ, seg_pos={0 0}, upload=146290]: Done uploading piece. err: ecclient: upload failed (node:1eorQLNmgEaXv8myr6t3Q8rysGwsvtdZzu5b7sndhoANb6Waj6, address:145.79.227.32:4838): protocol: read tcp 139.59.144.22:50576->145.79.227.32:4838: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 18:43:52.395576918 (166h26m57.330031056s) [noise=true , address=145.79.227.18:4011 , piece_id=YMVYTYBJXFWBCETKUS5MYGKIS4UVLNF3RXTGQDDDAL3PFPETQU7A, seg_pos={0 0}, upload=146290]: Done uploading piece. err: ecclient: upload failed (node:12J8J47emDh4p115m69EqUYroi9GgruC3y8gmv2xVULVJSvFYYP, address:145.79.227.18:4011): protocol: read tcp 139.59.144.22:52432->145.79.227.18:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 18:43:52.395723569 (166h26m57.330177704s) [noise=true , address=45.91.116.11:4118 , piece_id=KVKPDLIXTVNF54P2LXZYDVAYPE7L44PF6AALIMGKCKO2DXQUYYIQ, seg_pos={0 0}, upload=146290]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 139.59.144.22:37766->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 18:43:52.395841843 (166h26m57.330295985s) [noise=true , address=145.79.227.41:4086 , piece_id=XOE2AM4V7AUQKFFHNCGJ5FI4ERBUBH7DKVQQMMW7J2VAG2KDQGHA, seg_pos={0 0}, upload=146290]: Done uploading piece. err: ecclient: upload failed (node:1SqSapYVaJiXrqqGfD9a1XFgf6Y8eGJXmudUmLhX7yjmYXBWTm, address:145.79.227.41:4086): protocol: read tcp 139.59.144.22:36772->145.79.227.41:4086: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 18:43:52.395886494 (166h26m57.330340635s) [noise=true , address=145.79.227.26:4656 , piece_id=53OXQD7P75AHWTTRIESXWBQSWNDEZYCYBZSTE6O7F4GHNVSOZWJQ, seg_pos={0 0}, upload=146290]: Done uploading piece. err: ecclient: upload failed (node:1u6e2ZjrPg2q3EDN2ZjDj9hzEmCAoRvt39HMeM79gcVmMVm53j, address:145.79.227.26:4656): protocol: read tcp 139.59.144.22:39766->145.79.227.26:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 18:43:52.395916237 (166h26m57.330370356s) [seg_pos={0 0}, upload=146290]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil>
Duration: 30.106825033s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)antiblip:
14 out of 60 is failed (threshold=6) [........................................XX.XX.XXXXX.XX.XXX..] duration:
2.354238195s remote:
"tcp:185.244.226.4:443" target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/43ad6243e9f92940
FAIL (2026-02-24 18:43:51 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 2.354258785s
edge
linksharing
bgp
us1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)antiblip:
14 out of 60 is failed (threshold=6) [.........................................XX.XX.XXXXX.XX.XXX.] duration:
57.245763244s remote:
"tcp:185.244.226.4:443" target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/43ad6243e9f92940
FAIL (2026-02-24 18:43:49 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 57.245780803s
edge
linksharing
bgp
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
17 out of 60 is failed (threshold=6) [.......X....X..XX..X.................X...XX...X.XX.XXXX..XX.] duration:
1.911434588s trace:
https://jaeger.dev.storj.io/trace/737af87a3b886a0c
FAIL (2026-02-24 18:43:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.91150568s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.80335ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=BbYubghzbrK X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 18:43:46 GMT Accept-Ranges=bytes Server=Storj Vary=Origin X-Amz-Request-Id=189742FB6EE80D5E target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/2076639a4e3ac18e
FAIL (2026-02-24 18:43:46 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189742FB6EE80D5E</RequestId><HostId></HostId></Error>"
Duration: 10.827572ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
18 out of 60 is failed (threshold=3) [..........................................XXXXXXXXXXXXXXXXXX] duration:
1m0.001848681s trace:
https://jaeger.dev.storj.io/trace/73cef0d4f8588a82
FAIL (2026-02-24 18:43:40 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Feb 24 18:42:40.331706604 (166h25m45.266160746s) [upload=146280]: Starting upload Feb 24 18:42:40.331826626 (166h25m45.266280764s) [upload=146280]: Done starting upload Feb 24 18:42:40.331904481 (166h25m45.266358598s) [upload=146280]: Uploading segments... Feb 24 18:42:40.332266211 (166h25m45.266720352s) [upload=146280]: Got next segment. Inline: false Feb 24 18:42:40.332351248 (166h25m45.266805381s) [upload=146280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:42:40.332357321 (166h25m45.266811453s) [upload=146280]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Feb 24 18:43:40.022165933 (166h26m44.956620058s) [upload=146280]: Next segment err: context deadline exceeded Feb 24 18:43:40.022586871 (166h26m44.957040994s) [upload=146280]: Done uploading segments... Feb 24 18:43:40.022728565 (166h26m44.957182691s) [upload=146280]: Upload finished. err: context deadline exceeded
Duration: 1m0.001864788s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
40 out of 60 is failed (threshold=3) [....................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.001431661s trace:
https://jaeger.dev.storj.io/trace/31f7ceeb222862d1
FAIL (2026-02-24 18:43:39 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 30.001456305s
core
uplink
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
38 out of 60 is failed (threshold=3) [......................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.000951351s trace:
https://jaeger.dev.storj.io/trace/63f8b509634fb2cb
FAIL (2026-02-24 18:43:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.000978898s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
38 out of 60 is failed (threshold=3) [.....................XXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXX] duration:
30.000785643s trace:
https://jaeger.dev.storj.io/trace/46cf994673df972e
FAIL (2026-02-24 18:43:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.000821632s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
38 out of 60 is failed (threshold=3) [.....................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXXX] duration:
30.002159215s trace:
https://jaeger.dev.storj.io/trace/69dbbbdee3724edd
FAIL (2026-02-24 18:43:34 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 30.002181128s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
40 out of 60 is failed (threshold=3) [...................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X] duration:
30.001738091s trace:
https://jaeger.dev.storj.io/trace/38ed432cd9f0e668
FAIL (2026-02-24 18:43:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:42:53.393879986 (166h25m58.328334108s) [upload=146283]: Starting upload Feb 24 18:42:53.394015644 (166h25m58.328469788s) [upload=146283]: Done starting upload Feb 24 18:42:53.394166144 (166h25m58.328620264s) [upload=146283]: Uploading segments... Feb 24 18:42:53.394261153 (166h25m58.328715298s) [upload=146283]: Got next segment. Inline: true Feb 24 18:42:53.394269172 (166h25m58.328723313s) [upload=146283]: Waiting for error group managing segments... Feb 24 18:42:53.394371178 (166h25m58.328825318s) [upload=146283]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:42:53.394377893 (166h25m58.328832026s) [upload=146283]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Feb 24 18:42:53.394382396 (166h25m58.328836538s) [upload=146283]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Feb 24 18:43:23.104338890 (166h26m28.03879303s) [upload=146283]: Done uploading segments... Feb 24 18:43:23.104402042 (166h26m28.038856183s) [upload=146283]: Upload finished. err: metaclient: context deadline exceeded
Duration: 30.001765015s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
34 out of 60 is failed (threshold=3) [..........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.001587682s trace:
https://jaeger.dev.storj.io/trace/5d78461f78127a1e
FAIL (2026-02-24 18:43:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Feb 24 18:42:52.536867129 (166h25m57.471321252s) [upload=146282]: Starting upload Feb 24 18:42:52.536948700 (166h25m57.471402833s) [upload=146282]: Done starting upload Feb 24 18:42:52.536990186 (166h25m57.471444307s) [upload=146282]: Uploading segments... Feb 24 18:42:52.537462956 (166h25m57.471917089s) [upload=146282]: Got next segment. Inline: false Feb 24 18:42:52.537525523 (166h25m57.471979655s) [upload=146282]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:42:52.537531106 (166h25m57.471985238s) [upload=146282]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Feb 24 18:43:22.247006886 (166h26m27.181461029s) [upload=146282]: Next segment err: context deadline exceeded Feb 24 18:43:22.247280304 (166h26m27.181734441s) [upload=146282]: Done uploading segments... Feb 24 18:43:22.247345997 (166h26m27.181800118s) [upload=146282]: Upload finished. err: context deadline exceeded
Duration: 30.001608329s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.11454ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=189742F50E017CA6 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=7gddodYq8Au Date=Tue, 24 Feb 2026 18:43:18 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/5da93b45ec442237
FAIL (2026-02-24 18:43:18 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189742F50E017CA6</RequestId><HostId></HostId></Error>"
Duration: 7.149301ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.728387ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Request-Id=BXaVkpPa8EP X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 18:43:18 GMT Vary=Origin X-Amz-Request-Id=189742F5067ABC12 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/faa21642d6b7231
FAIL (2026-02-24 18:43:18 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189742F5067ABC12</RequestId><HostId></HostId></Error>"
Duration: 8.816377ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
291.086561ms remote:
"tcp:45.38.24.2:443" response headers:
X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 18:43:07 GMT Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content X-Request-Id=2oqjveCESpw Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=189742F28FD1DBA5 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/59ba1a22673bad17
FAIL (2026-02-24 18:43:08 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189742F28FD1DBA5</RequestId><HostId></HostId></Error>"
Duration: 291.098669ms
edge
gateway
vhost
us-select-1
|