Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
310.922642ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1897424B905C3FDC Date=Tue, 24 Feb 2026 18:31:10 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=3CuAkcQwCwR X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/6cb0acf767489887
FAIL (2026-02-24 18:31:10 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897424B905C3FDC</RequestId><HostId></HostId></Error>"
Duration: 310.952325ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
8 out of 60 is failed (threshold=3) [....................................................XXXXXXXX] duration:
1m0.000900957s trace:
https://jaeger.dev.storj.io/trace/6bbaa68cdb8220e1
FAIL (2026-02-24 18:31:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Feb 24 18:30:05.439989223 (166h13m10.374443366s) [upload=146117]: Starting upload Feb 24 18:30:05.440083998 (166h13m10.374538144s) [upload=146117]: Done starting upload Feb 24 18:30:05.440520182 (166h13m10.374974421s) [upload=146117]: Uploading segments... Feb 24 18:30:05.440584798 (166h13m10.375038944s) [upload=146117]: Got next segment. Inline: false Feb 24 18:30:05.440659328 (166h13m10.375113466s) [upload=146117]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:30:05.440667491 (166h13m10.375121633s) [upload=146117]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Feb 24 18:31:05.142396213 (166h14m10.076850358s) [upload=146117]: Next segment err: context deadline exceeded Feb 24 18:31:05.142713901 (166h14m10.077168028s) [upload=146117]: Done uploading segments... Feb 24 18:31:05.142785867 (166h14m10.077239994s) [upload=146117]: Upload finished. err: context deadline exceeded
Duration: 1m0.000917113s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
24 out of 60 is failed (threshold=3) [....................................XXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.001422548s trace:
https://jaeger.dev.storj.io/trace/290c94fe50635e15
FAIL (2026-02-24 18:31:04 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001457181s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.04228ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Server=Storj Vary=Origin X-Amz-Request-Id=18974249FF56AC4C Date=Tue, 24 Feb 2026 18:31:03 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=WLCi6XHjBt9 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/4cf6436e11a3b95d
FAIL (2026-02-24 18:31:03 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18974249FF56AC4C</RequestId><HostId></HostId></Error>"
Duration: 13.080797ms
edge
gateway
vhost
bgp
eu1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
21 out of 60 is failed (threshold=3) [......................................XXXXXXXXXXXXXXXXXXXX.X] duration:
30.001564583s trace:
https://jaeger.dev.storj.io/trace/4151f1dbb58d5dc
FAIL (2026-02-24 18:30:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001594269s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
24 out of 60 is failed (threshold=3) [....................................XXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.001742662s trace:
https://jaeger.dev.storj.io/trace/e20cea70a57e58e
FAIL (2026-02-24 18:30:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:30:18.095090694 (166h13m23.029544815s) [upload=146119]: Starting upload Feb 24 18:30:18.095231482 (166h13m23.029685619s) [upload=146119]: Done starting upload Feb 24 18:30:18.095337017 (166h13m23.029791154s) [upload=146119]: Uploading segments... Feb 24 18:30:18.095457693 (166h13m23.029911833s) [upload=146119]: Got next segment. Inline: true Feb 24 18:30:18.095468548 (166h13m23.029922685s) [upload=146119]: Waiting for error group managing segments... Feb 24 18:30:18.095560786 (166h13m23.030014923s) [upload=146119]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:30:18.095571176 (166h13m23.030025317s) [upload=146119]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Feb 24 18:30:18.095576760 (166h13m23.030030894s) [upload=146119]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Feb 24 18:30:47.800701467 (166h13m52.735155609s) [upload=146119]: Done uploading segments... Feb 24 18:30:47.800760489 (166h13m52.735214623s) [upload=146119]: Upload finished. err: metaclient: context deadline exceeded
Duration: 30.00177129s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
20 out of 60 is failed (threshold=3) [........................................XXXXXXXXXXXXXXXXXXXX] duration:
30.001574222s trace:
https://jaeger.dev.storj.io/trace/7dad2ac70a34713b
FAIL (2026-02-24 18:30:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Feb 24 18:30:15.590434103 (166h13m20.524888242s) [upload=146118]: Starting upload Feb 24 18:30:15.590564380 (166h13m20.525018528s) [upload=146118]: Done starting upload Feb 24 18:30:15.590896169 (166h13m20.525350307s) [upload=146118]: Uploading segments... Feb 24 18:30:15.591059272 (166h13m20.525513407s) [upload=146118]: Got next segment. Inline: false Feb 24 18:30:15.591156438 (166h13m20.525610577s) [upload=146118]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:30:15.591166070 (166h13m20.525620216s) [upload=146118]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Feb 24 18:30:45.288247122 (166h13m50.222701265s) [upload=146118]: Next segment err: context deadline exceeded Feb 24 18:30:45.288272042 (166h13m50.222726186s) [upload=146118]: Done uploading segments... Feb 24 18:30:45.288463652 (166h13m50.222917785s) [upload=146118]: Upload finished. err: context deadline exceeded
Duration: 30.001599055s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.818127ms remote:
"tcp:185.244.226.3:443" response headers:
Vary=Origin Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Amz-Request-Id=1897424428D7B82B X-Request-Id=LKDwwURKotR X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 18:30:38 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/2c0a55b2ad811624
FAIL (2026-02-24 18:30:38 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897424428D7B82B</RequestId><HostId></HostId></Error>"
Duration: 8.84928ms
edge
gateway
vhost
bgp
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
17 out of 60 is failed (threshold=3) [...........................................XXXXXXXXXXXXXXXXX] duration:
1m0.000658984s trace:
https://jaeger.dev.storj.io/trace/12804f26f80feb04
FAIL (2026-02-24 18:30:36 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.000676972s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
311.468376ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1897424089272AA3 Date=Tue, 24 Feb 2026 18:30:23 GMT Content-Length=284 Vary=Origin X-Request-Id=3WrRZrrDScd X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/201352e1390a35e8
FAIL (2026-02-24 18:30:23 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897424089272AA3</RequestId><HostId></HostId></Error>"
Duration: 311.501981ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
7 out of 60 is failed (threshold=6) [.................X.........X....X..XX..X.................X..] duration:
1.851993977s trace:
https://jaeger.dev.storj.io/trace/380544f293be9233
FAIL (2026-02-24 18:30:18 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.852025517s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
19 out of 60 is failed (threshold=3) [.........................................XXXXXXXXXXXXXXXXXXX] duration:
30.002023488s trace:
https://jaeger.dev.storj.io/trace/64fc0a1742952f20
FAIL (2026-02-24 18:30:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Feb 24 18:29:41.962228836 (166h12m46.896682982s) [upload=146108]: Starting upload Feb 24 18:29:41.962319823 (166h12m46.896773968s) [upload=146108]: Done starting upload Feb 24 18:29:41.962420644 (166h12m46.896874781s) [upload=146108]: Uploading segments... Feb 24 18:29:41.962791067 (166h12m46.897245207s) [upload=146108]: Got next segment. Inline: false Feb 24 18:29:41.962863560 (166h12m46.897317697s) [upload=146108]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:29:41.962872646 (166h12m46.89732678s) [upload=146108]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Feb 24 18:30:11.650731598 (166h13m16.585185739s) [upload=146108]: Next segment err: context deadline exceeded Feb 24 18:30:11.651023956 (166h13m16.585478079s) [upload=146108]: Done uploading segments... Feb 24 18:30:11.651077323 (166h13m16.585531455s) [upload=146108]: Upload finished. err: context deadline exceeded
Duration: 30.002050179s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
18 out of 60 is failed (threshold=3) [..........................................XXXXXXXXXXXXXXXXXX] duration:
10.103267293s trace:
https://jaeger.dev.storj.io/trace/21151425bc83145
FAIL (2026-02-24 18:30:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Feb 24 18:30:02.039107486 (166h13m6.973561624s) [upload=146115]: Starting upload Feb 24 18:30:02.039198067 (166h13m6.973652194s) [upload=146115]: Done starting upload Feb 24 18:30:02.039305596 (166h13m6.973759733s) [upload=146115]: Uploading segments... Feb 24 18:30:02.039370400 (166h13m6.973824537s) [upload=146115]: Got next segment. Inline: true Feb 24 18:30:02.039378490 (166h13m6.973832629s) [upload=146115]: Waiting for error group managing segments... Feb 24 18:30:02.039433298 (166h13m6.973887436s) [upload=146115]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:30:02.039452285 (166h13m6.973906425s) [upload=146115]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Feb 24 18:30:02.039457116 (166h13m6.973911255s) [upload=146115]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Feb 24 18:30:11.802315024 (166h13m16.736769191s) [upload=146115]: Done uploading segments... Feb 24 18:30:11.802359144 (166h13m16.736813306s) [upload=146115]: Upload finished. err: metaclient: context canceled
Duration: 10.10328791s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.189334ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=EL7US7Gsy3f Date=Tue, 24 Feb 2026 18:30:08 GMT Content-Length=274 X-Amz-Request-Id=1897423D139DED7A X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/13afdd21cdaa6129
FAIL (2026-02-24 18:30:08 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897423D139DED7A</RequestId><HostId></HostId></Error>"
Duration: 12.217749ms
edge
gateway
vhost
bgp
ap1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
20 out of 60 is failed (threshold=3) [.......................................XXXXXXXXXXXXXXXXXXXX.] duration:
24.563667853s trace:
https://jaeger.dev.storj.io/trace/1f04d1e3732aea36
FAIL (2026-02-24 18:30:05 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 24.563742118s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
7 out of 60 is failed (threshold=3) [.....................................................XXXXXXX] duration:
11m15.002006188s trace:
https://jaeger.dev.storj.io/trace/62cd7668d0d9ce3b
FAIL (2026-02-24 18:30:04 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
69]: Uploading piece...
Feb 24 18:19:04.674033745 (166h2m9.608487894s) [noise=true , address=45.91.116.11:4122 , piece_id=SL3THREWJDCPTOIXUCZBCIWID66DY6QXXG5IU6U2IXTPKT4I7PUA, seg_pos={0 0}, upload=145969]: Uploading piece...
Feb 24 18:19:04.674588600 (166h2m9.609042734s) [noise=true , address=193.149.164.70:4137 , piece_id=MFSO4R6HDHPEGHBUKHIDOIJUCNYSNLI4NJV5CTWWMN4ZQZGNT4SA, seg_pos={0 0}, upload=145969]: Uploading piece...
Feb 24 18:19:04.675099643 (166h2m9.609553777s) [noise=true , address=193.149.164.69:4087 , piece_id=LHKPUKTIYNQ6PA7PNVAFQW63AVETYTIXZU543XG2NJUJ3UANEATA, seg_pos={0 0}, upload=145969]: Uploading piece...
Feb 24 18:19:04.675524578 (166h2m9.609978716s) [noise=true , address=145.79.227.12:4791 , piece_id=CUVZHPVQF66DNPGVVTOIXYDYCNHHPZV6OHVZE5GFAABXZ7G6Q4BQ, seg_pos={0 0}, upload=145969]: Uploading piece...
Feb 24 18:19:04.675604280 (166h2m9.61005842s) [noise=true , address=77.90.31.16:4761 , piece_id=DRIV4TESI6KGSMLGXDOT5FBC3T6E5FKYLYYBMYCANNXPAFUNK2FQ, seg_pos={0 0}, upload=145969]: Uploading piece...
Feb 24 18:19:04.676088553 (166h2m9.610542699s) [noise=true , address=77.90.31.11:4564 , piece_id=P77JUDMZVJOXGI3QTOF32BBLY34JDZZW3336QJIJXQTCCMKF44MQ, seg_pos={0 0}, upload=145969]: Uploading piece...
Feb 24 18:19:04.676409797 (166h2m9.610863941s) [noise=true , address=77.90.31.13:4646 , piece_id=PPGFVXSIADC7U7UFOXPSVP5SZEVBEM6PTGSYSYTOIUYWSMSYFC6A, seg_pos={0 0}, upload=145969]: Uploading piece...
Feb 24 18:19:04.676827264 (166h2m9.611281408s) [noise=true , address=193.149.164.67:4027 , piece_id=FAOCOOGD5AVNXFC3J4NNJ3QQBNZBWMBX6WBBAPE7TH64I23TH5MQ, seg_pos={0 0}, upload=145969]: Uploading piece...
Feb 24 18:19:04.677209802 (166h2m9.611663945s) [noise=true , address=167.17.72.68:4657 , piece_id=SJA3O6M3BUK4MM6J6RBS5AYB7GSC2CTATI5LHDULA6N55CMWEOUQ, seg_pos={0 0}, upload=145969]: Uploading piece...
Feb 24 18:19:04.677760497 (166h2m9.612214629s) [noise=true , address=45.91.116.4:4944 , piece_id=Y3TK4M4GWFTUCABT7KTX2AGGRD73UCPB6SOER4WH3GP2FW5BLSTQ, seg_pos={0 0}, upload=145969]: Uploading piece...
Feb 24 18:19:04.678165092 (166h2m9.612619225s) [noise=true , address=79.127.219.45:4865 , piece_id=PI2ZGZQTFHPPIV6PVLNSGUYVCHUSOH52S2OWJ3LQNAM4U33SVPAA, seg_pos={0 0}, upload=145969]: Uploading piece...
Feb 24 18:19:04.678455398 (166h2m9.612909541s) [noise=true , address=79.127.205.235:4269 , piece_id=VEBAXBPOZYJWAQCBNMJEEWZKCJKRDJQWPAYKPZENPT6KOSRCOPGQ, seg_pos={0 0}, upload=145969]: Uploading piece...
Feb 24 18:19:04.679180682 (166h2m9.613634823s) [noise=true , address=45.91.116.6:4000 , piece_id=MWYIINCU7BS3HHCXTFSMEYEZ3NSPFT5U7KJI3TDATDPUFAYKBE3A, seg_pos={0 0}, upload=145969]: Uploading piece...
Feb 24 18:19:04.679664153 (166h2m9.614118285s) [noise=true , address=193.149.164.66:4974 , piece_id=OOCLD4J6X3NUGEL2M73Z552S47TE6OHDAABODP5LPYQKGLNKN3QQ, seg_pos={0 0}, upload=145969]: Uploading piece...
Feb 24 18:19:04.680069685 (166h2m9.614523831s) [noise=true , address=79.127.205.234:4202 , piece_id=DKICV2P54YZUKREYW5MPAHDAKZADEIDV5WPUYG2JVORRVEX4ULMA, seg_pos={0 0}, upload=145969]: Uploading piece...
Feb 24 18:19:04.680378447 (166h2m9.614832589s) [noise=true , address=79.127.205.237:4244 , piece_id=3ZNON65OZXFHEPYHERWQJ73MHAA2EGCVH3LLSJHQ3FNAMAEHFPPQ, seg_pos={0 0}, upload=145969]: Uploading piece...
Feb 24 18:19:04.680827261 (166h2m9.615281397s) [noise=true , address=145.79.227.20:4455 , piece_id=76GIW5MBOS37LKKJS2WI6G6FQY463MCWIDNLR73ERD4UJFIE52SQ, seg_pos={0 0}, upload=145969]: Uploading piece...
Feb 24 18:19:05.222622481 (166h2m10.157076622s) [upload=145969]: Next returned nil segment
Feb 24 18:19:05.222639057 (166h2m10.157093179s) [upload=145969]: Waiting for error group managing segments...
Feb 24 18:19:05.386000117 (166h2m10.320454247s) [noise=true , address=45.91.116.11:4122 , piece_id=SL3THREWJDCPTOIXUCZBCIWID66DY6QXXG5IU6U2IXTPKT4I7PUA, seg_pos={0 0}, upload=145969]: Done uploading piece. err: <nil>
Feb 24 18:19:05.388747891 (166h2m10.323202034s) [noise=true , address=45.91.116.4:4944 , piece_id=Y3TK4M4GWFTUCABT7KTX2AGGRD73UCPB6SOER4WH3GP2FW5BLSTQ, seg_pos={0 0}, upload=145969]: Done uploading piece. err: <nil>
Feb 24 18:19:05.395530006 (166h2m10.329984142s) [noise=true , address=45.91.116.6:4000 , piece_id=MWYIINCU7BS3HHCXTFSMEYEZ3NSPFT5U7KJI3TDATDPUFAYKBE3A, seg_pos={0 0}, upload=145969]: Done uploading piece. err: <nil>
Feb 24 18:19:05.409009318 (166h2m10.34346346s) [noise=true , address=145.79.227.12:4791 , piece_id=CUVZHPVQF66DNPGVVTOIXYDYCNHHPZV6OHVZE5GFAABXZ7G6Q4BQ, seg_pos={0 0}, upload=145969]: Done uploading piece. err: <nil>
Feb 24 18:19:05.414683787 (166h2m10.34913792s) [noise=true , address=145.79.227.20:4455 , piece_id=76GIW5MBOS37LKKJS2WI6G6FQY463MCWIDNLR73ERD4UJFIE52SQ, seg_pos={0 0}, upload=145969]: Done uploading piece. err: <nil>
Feb 24 18:19:05.458406029 (166h2m10.392860171s) [noise=true , address=77.90.31.11:4564 , piece_id=P77JUDMZVJOXGI3QTOF32BBLY34JDZZW3336QJIJXQTCCMKF44MQ, seg_pos={0 0}, upload=145969]: Done uploading piece. err: <nil>
Feb 24 18:19:05.463961323 (166h2m10.398415458s) [noise=true , address=79.127.219.45:4865 , piece_id=PI2ZGZQTFHPPIV6PVLNSGUYVCHUSOH52S2OWJ3LQNAM4U33SVPAA, seg_pos={0 0}, upload=145969]: Done uploading piece. err: <nil>
Feb 24 18:19:05.481758208 (166h2m10.416212348s) [noise=true , address=77.90.31.13:4646 , piece_id=PPGFVXSIADC7U7UFOXPSVP5SZEVBEM6PTGSYSYTOIUYWSMSYFC6A, seg_pos={0 0}, upload=145969]: Done uploading piece. err: <nil>
Feb 24 18:19:05.487154515 (166h2m10.421608648s) [noise=true , address=77.90.31.16:4761 , piece_id=DRIV4TESI6KGSMLGXDOT5FBC3T6E5FKYLYYBMYCANNXPAFUNK2FQ, seg_pos={0 0}, upload=145969]: Done uploading piece. err: <nil>
Feb 24 18:19:05.694578412 (166h2m10.629032551s) [noise=true , address=167.17.72.68:4657 , piece_id=SJA3O6M3BUK4MM6J6RBS5AYB7GSC2CTATI5LHDULA6N55CMWEOUQ, seg_pos={0 0}, upload=145969]: Done uploading piece. err: <nil>
Feb 24 18:19:05.750727055 (166h2m10.68518119s) [noise=true , address=167.17.72.69:4715 , piece_id=2IXBTNWSJ4Q7UC7QDXWKZBLMNOBZEMAXNQGBJ33NMYKZ76E22GSA, seg_pos={0 0}, upload=145969]: Done uploading piece. err: <nil>
Feb 24 18:19:05.910990123 (166h2m10.845444243s) [noise=true , address=193.149.164.67:4027 , piece_id=FAOCOOGD5AVNXFC3J4NNJ3QQBNZBWMBX6WBBAPE7TH64I23TH5MQ, seg_pos={0 0}, upload=145969]: Done uploading piece. err: <nil>
Feb 24 18:19:05.915313447 (166h2m10.84976758s) [noise=true , address=193.149.164.70:4137 , piece_id=MFSO4R6HDHPEGHBUKHIDOIJUCNYSNLI4NJV5CTWWMN4ZQZGNT4SA, seg_pos={0 0}, upload=145969]: Done uploading piece. err: <nil>
Feb 24 18:19:05.920648690 (166h2m10.855102833s) [noise=true , address=193.149.164.69:4087 , piece_id=LHKPUKTIYNQ6PA7PNVAFQW63AVETYTIXZU543XG2NJUJ3UANEATA, seg_pos={0 0}, upload=145969]: Done uploading piece. err: <nil>
Feb 24 18:19:05.920671439 (166h2m10.855125573s) [seg_pos={0 0}, upload=145969]: Satisfied cohort requirements after 14 pieces
Feb 24 18:19:05.920944394 (166h2m10.855398536s) [noise=true , address=79.127.205.235:4269 , piece_id=VEBAXBPOZYJWAQCBNMJEEWZKCJKRDJQWPAYKPZENPT6KOSRCOPGQ, seg_pos={0 0}, upload=145969]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GiX8XkEzQ3q9SdEsMmnADDJqFgJhvvK5Lxq3uk9htuGn1BjEA): protocol: expected piece hash; context canceled; EOF
Feb 24 18:19:05.920956696 (166h2m10.855410819s) [noise=true , address=79.127.205.235:4269 , piece_id=VEBAXBPOZYJWAQCBNMJEEWZKCJKRDJQWPAYKPZENPT6KOSRCOPGQ, seg_pos={0 0}, upload=145969]: Long tail cancellation due to optimal threshold
Feb 24 18:19:05.921126276 (166h2m10.855580416s) [noise=true , address=193.149.164.66:4974 , piece_id=OOCLD4J6X3NUGEL2M73Z552S47TE6OHDAABODP5LPYQKGLNKN3QQ, seg_pos={0 0}, upload=145969]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUUmz1id7npW5m6pLMNgM4inztu5u2NWNSVK2KmJbZf94nRqj): protocol: expected piece hash; context canceled; EOF
Feb 24 18:19:05.921134623 (166h2m10.855588765s) [noise=true , address=193.149.164.66:4974 , piece_id=OOCLD4J6X3NUGEL2M73Z552S47TE6OHDAABODP5LPYQKGLNKN3QQ, seg_pos={0 0}, upload=145969]: Long tail cancellation due to optimal threshold
Feb 24 18:19:05.921195506 (166h2m10.855649625s) [noise=true , address=79.127.205.237:4244 , piece_id=3ZNON65OZXFHEPYHERWQJ73MHAA2EGCVH3LLSJHQ3FNAMAEHFPPQ, seg_pos={0 0}, upload=145969]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q4Dxtk6oL8TPfvVxUt2YqaL5GWxnDHr98CHvYnzSYqoHZnnYj): protocol: expected piece hash; context canceled; EOF
Feb 24 18:19:05.921203328 (166h2m10.85565747s) [noise=true , address=79.127.205.237:4244 , piece_id=3ZNON65OZXFHEPYHERWQJ73MHAA2EGCVH3LLSJHQ3FNAMAEHFPPQ, seg_pos={0 0}, upload=145969]: Long tail cancellation due to optimal threshold
Feb 24 18:19:05.921438882 (166h2m10.85589302s) [noise=true , address=79.127.205.234:4202 , piece_id=DKICV2P54YZUKREYW5MPAHDAKZADEIDV5WPUYG2JVORRVEX4ULMA, seg_pos={0 0}, upload=145969]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UswtMi3zvTA9vra4WvZnLoqp3J3JpQmazmaviy9nBpYmZXibW): protocol: expected piece hash; context canceled; EOF
Feb 24 18:19:05.921454983 (166h2m10.855909126s) [noise=true , address=79.127.205.234:4202 , piece_id=DKICV2P54YZUKREYW5MPAHDAKZADEIDV5WPUYG2JVORRVEX4ULMA, seg_pos={0 0}, upload=145969]: Long tail cancellation due to optimal threshold
Feb 24 18:19:05.921671880 (166h2m10.856126012s) [seg_pos={0 0}, upload=145969]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 24 18:19:05.921789152 (166h2m10.856243293s) [upload=145969]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 24 18:19:05.921796287 (166h2m10.856250413s) [upload=145969]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:30:04.993016050 (166h13m9.927470194s) [upload=145969]: Done uploading segments...
Feb 24 18:30:04.993270715 (166h13m9.92772486s) [upload=145969]: Upload finished. err: metaclient: context deadline exceeded
Duration: 11m15.002026425s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
298.465662ms remote:
"tcp:185.244.226.3:443" response headers:
X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 18:30:03 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=1897423BFC1A9574 Content-Length=274 Content-Type=application/xml X-Request-Id=FeTxgaQ6KZQ target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/76f3344cd5233a0e
FAIL (2026-02-24 18:30:03 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897423BFC1A9574</RequestId><HostId></HostId></Error>"
Duration: 298.485401ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
24 out of 60 is failed (threshold=3) [....................................XXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.408053083s trace:
https://jaeger.dev.storj.io/trace/caa80b6b16b5fed
FAIL (2026-02-24 18:30:01 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: metaclient: context canceled
Duration: 11.408097825s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
17 out of 60 is failed (threshold=3) [...........................................XXXXXXXXXXXXXXXXX] duration:
1m0.001713879s trace:
https://jaeger.dev.storj.io/trace/72cc81d03f2a1457
FAIL (2026-02-24 18:30:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:29:01.874085781 (166h12m6.80853992s) [upload=146101]: Starting upload Feb 24 18:29:01.874168206 (166h12m6.80862235s) [upload=146101]: Done starting upload Feb 24 18:29:01.874274429 (166h12m6.808728567s) [upload=146101]: Uploading segments... Feb 24 18:29:01.874334157 (166h12m6.808788304s) [upload=146101]: Got next segment. Inline: true Feb 24 18:29:01.874341980 (166h12m6.808796117s) [upload=146101]: Waiting for error group managing segments... Feb 24 18:29:01.874424688 (166h12m6.808878841s) [upload=146101]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:29:01.874431384 (166h12m6.808885525s) [upload=146101]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Feb 24 18:29:01.874435254 (166h12m6.80888939s) [upload=146101]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Feb 24 18:30:01.551482263 (166h13m6.485936408s) [upload=146101]: Done uploading segments... Feb 24 18:30:01.551544069 (166h13m6.485998211s) [upload=146101]: Upload finished. err: metaclient: context deadline exceeded
Duration: 1m0.00173351s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
22 out of 60 is failed (threshold=3) [......................................XXXXXXXXXXXXXXXXXXXXXX] duration:
7.647896344s trace:
https://jaeger.dev.storj.io/trace/44d9d39b59e31608
FAIL (2026-02-24 18:30:01 UTC)
orbiter warning: operation: Commit uplink: metaclient: context canceled
Duration: 7.647937452s
core
uplink
us1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)antiblip:
8 out of 60 is failed (threshold=6) [..................................................XX.XX.XXXX] duration:
19.11474746s remote:
"tcp:185.244.226.4:443" response headers:
Content-Type=text/html; charset=utf-8 Access-Control-Allow-Headers=* Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=Qks1GQqYgq7 Date=Tue, 24 Feb 2026 18:30:01 GMT target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/40710724a4739b6a
FAIL (2026-02-24 18:30:01 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error | Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error | Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=d3025eacdcd1d9d9b45047f6a52f31bac5409a50\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error | Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=d3025eacdcd1d9d9b45047f6a52f31bac5409a50\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4"
Duration: 19.114787197s
edge
linksharing
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.183976ms remote:
"tcp:185.244.226.3:443" response headers:
Server=Storj Vary=Origin X-Request-Id=7heQ3yGDiU4 Date=Tue, 24 Feb 2026 18:29:59 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=1897423AF78473C3 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/7d94b033d01b9d2f
FAIL (2026-02-24 18:29:59 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897423AF78473C3</RequestId><HostId></HostId></Error>"
Duration: 12.213618ms
edge
gateway
vhost
bgp
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
23 out of 60 is failed (threshold=3) [.....................................XXXXXXXXXXXXXXXXXXXXXXX] duration:
30.001157368s trace:
https://jaeger.dev.storj.io/trace/4ca1918662be7a26
FAIL (2026-02-24 18:29:52 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001171957s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.210815ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Request-Id=6mTKTs6rnoL X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 18:29:51 GMT Accept-Ranges=bytes Content-Type=application/xml X-Amz-Request-Id=189742393A95DDD4 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/681f7dc41349cc37
FAIL (2026-02-24 18:29:51 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189742393A95DDD4</RequestId><HostId></HostId></Error>"
Duration: 8.235041ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
23 out of 60 is failed (threshold=3) [.....................................XXXXXXXXXXXXXXXXXXXXXXX] duration:
30.001329638s trace:
https://jaeger.dev.storj.io/trace/6fadb41ed25131d5
FAIL (2026-02-24 18:29:50 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 30.001353975s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
23 out of 60 is failed (threshold=3) [.....................................XXXXXXXXXXXXXXXXXXXXXXX] duration:
30.003322256s trace:
https://jaeger.dev.storj.io/trace/5f3a103ed22dbd82
FAIL (2026-02-24 18:29:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:29:18.553181918 (166h12m23.487636041s) [upload=146105]: Starting upload Feb 24 18:29:18.553260400 (166h12m23.487714521s) [upload=146105]: Done starting upload Feb 24 18:29:18.553451507 (166h12m23.487905628s) [upload=146105]: Uploading segments... Feb 24 18:29:18.553505062 (166h12m23.487959204s) [upload=146105]: Got next segment. Inline: true Feb 24 18:29:18.553510674 (166h12m23.487964807s) [upload=146105]: Waiting for error group managing segments... Feb 24 18:29:18.553568830 (166h12m23.488022963s) [upload=146105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:29:18.553575032 (166h12m23.488029164s) [upload=146105]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Feb 24 18:29:18.553578836 (166h12m23.488032969s) [upload=146105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Feb 24 18:29:48.267273589 (166h12m53.201727734s) [upload=146105]: Done uploading segments... Feb 24 18:29:48.267339631 (166h12m53.201793774s) [upload=146105]: Upload finished. err: metaclient: context deadline exceeded
Duration: 30.003338778s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)antiblip:
7 out of 60 is failed (threshold=6) [...................................................XX.XX.XXX] duration:
2m0.001206322s remote:
"tcp:185.244.226.4:443" target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/71b2bea478b00594
FAIL (2026-02-24 18:29:42 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 2m0.001226002s
edge
linksharing
bgp
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
20 out of 60 is failed (threshold=3) [........................................XXXXXXXXXXXXXXXXXXXX] duration:
30.001623505s trace:
https://jaeger.dev.storj.io/trace/1f04d1e3732aea36
FAIL (2026-02-24 18:29:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001655968s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
7 out of 60 is failed (threshold=6) [..................X.........X....X..XX..X.................X.] duration:
1.635659834s trace:
https://jaeger.dev.storj.io/trace/380544f293be9233
FAIL (2026-02-24 18:29:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.635693486s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
16 out of 60 is failed (threshold=3) [............................................XXXXXXXXXXXXXXXX] duration:
1m0.001067447s trace:
https://jaeger.dev.storj.io/trace/a63df54404f47af
FAIL (2026-02-24 18:29:36 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.001084337s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
283.283459ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Type=application/xml X-Request-Id=Kn9Dtbmaaef X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 18:29:35 GMT Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=189742355979744A target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/76821b637a5e8af8
FAIL (2026-02-24 18:29:35 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189742355979744A</RequestId><HostId></HostId></Error>"
Duration: 283.305511ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
22 out of 60 is failed (threshold=3) [......................................XXXXXXXXXXXXXXXXXXXXXX] duration:
30.000689471s trace:
https://jaeger.dev.storj.io/trace/4f53ec49d8ae6826
FAIL (2026-02-24 18:29:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.000720529s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.559794ms remote:
"tcp:185.244.226.3:443" response headers:
X-Amz-Request-Id=18974231AF2F5135 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=31e4f1fcT56 Date=Tue, 24 Feb 2026 18:29:19 GMT Content-Type=application/xml Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/21ae9a3d137881cf
FAIL (2026-02-24 18:29:19 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18974231AF2F5135</RequestId><HostId></HostId></Error>"
Duration: 8.650156ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
22 out of 60 is failed (threshold=3) [......................................XXXXXXXXXXXXXXXXXXXXXX] duration:
30.001513402s trace:
https://jaeger.dev.storj.io/trace/630574a11c829b85
FAIL (2026-02-24 18:29:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:28:48.405940980 (166h11m53.340395119s) [upload=146100]: Starting upload Feb 24 18:28:48.406035175 (166h11m53.340489319s) [upload=146100]: Done starting upload Feb 24 18:28:48.406126178 (166h11m53.340580301s) [upload=146100]: Uploading segments... Feb 24 18:28:48.406184783 (166h11m53.340638921s) [upload=146100]: Got next segment. Inline: true Feb 24 18:28:48.406190608 (166h11m53.34064474s) [upload=146100]: Waiting for error group managing segments... Feb 24 18:28:48.406249141 (166h11m53.340703274s) [upload=146100]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:28:48.406254496 (166h11m53.340708629s) [upload=146100]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Feb 24 18:28:48.406258336 (166h11m53.340712467s) [upload=146100]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Feb 24 18:29:18.117753912 (166h12m23.052208057s) [upload=146100]: Done uploading segments... Feb 24 18:29:18.117806026 (166h12m23.052260259s) [upload=146100]: Upload finished. err: metaclient: context deadline exceeded
Duration: 30.001532392s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.94189ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18974231570A727E X-Request-Id=2pRyYHYAybR Date=Tue, 24 Feb 2026 18:29:18 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/113af65d13550d7c
FAIL (2026-02-24 18:29:18 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18974231570A727E</RequestId><HostId></HostId></Error>"
Duration: 9.970122ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
21 out of 60 is failed (threshold=3) [.......................................XXXXXXXXXXXXXXXXXXXXX] duration:
30.00114374s trace:
https://jaeger.dev.storj.io/trace/760a664782dad364
FAIL (2026-02-24 18:29:17 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 30.001238615s
core
uplink
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
7 out of 60 is failed (threshold=6) [...................X.........X....X..XX..X.................X] duration:
5.004038075s trace:
https://jaeger.dev.storj.io/trace/380544f293be9233
FAIL (2026-02-24 18:29:13 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.00406015s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
22 out of 60 is failed (threshold=3) [......................................XXXXXXXXXXXXXXXXXXXXXX] duration:
30.018039756s trace:
https://jaeger.dev.storj.io/trace/2d1c0991f311dee8
FAIL (2026-02-24 18:29:12 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 30.018089064s
core
uplink
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.690489ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=1897422FFD99D62B X-Request-Id=TxC7gKDN35A X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 18:29:12 GMT Content-Type=application/xml Server=Storj Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/45346828b3723efb
FAIL (2026-02-24 18:29:12 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897422FFD99D62B</RequestId><HostId></HostId></Error>"
Duration: 12.720483ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
16 out of 60 is failed (threshold=3) [............................................XXXXXXXXXXXXXXXX] duration:
1m0.001152912s trace:
https://jaeger.dev.storj.io/trace/327a22e64232b26a
FAIL (2026-02-24 18:29:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:28:01.722980197 (166h11m6.657434321s) [upload=146089]: Starting upload Feb 24 18:28:01.723068609 (166h11m6.657522732s) [upload=146089]: Done starting upload Feb 24 18:28:01.723240102 (166h11m6.657694229s) [upload=146089]: Uploading segments... Feb 24 18:28:01.723359621 (166h11m6.657813761s) [upload=146089]: Got next segment. Inline: true Feb 24 18:28:01.723366372 (166h11m6.657820506s) [upload=146089]: Waiting for error group managing segments... Feb 24 18:28:01.723469299 (166h11m6.657923433s) [upload=146089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:28:01.723479234 (166h11m6.657933373s) [upload=146089]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Feb 24 18:28:01.723483583 (166h11m6.657937719s) [upload=146089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Feb 24 18:29:01.400221695 (166h12m6.334675841s) [upload=146089]: Done uploading segments... Feb 24 18:29:01.400286463 (166h12m6.334740609s) [upload=146089]: Upload finished. err: metaclient: context deadline exceeded
Duration: 1m0.001169622s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
18 out of 60 is failed (threshold=3) [..........................................XXXXXXXXXXXXXXXXXX] duration:
30.001528347s trace:
https://jaeger.dev.storj.io/trace/ff2edcf03a1c34a
FAIL (2026-02-24 18:29:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Feb 24 18:28:30.451780451 (166h11m35.386234597s) [upload=146093]: Starting upload Feb 24 18:28:30.451875337 (166h11m35.386329484s) [upload=146093]: Done starting upload Feb 24 18:28:30.452126389 (166h11m35.386580527s) [upload=146093]: Uploading segments... Feb 24 18:28:30.452893407 (166h11m35.387347542s) [upload=146093]: Got next segment. Inline: false Feb 24 18:28:30.452989600 (166h11m35.387443738s) [upload=146093]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:28:30.452996310 (166h11m35.387450445s) [upload=146093]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Feb 24 18:29:00.155545672 (166h12m5.089999806s) [upload=146093]: Next segment err: context deadline exceeded Feb 24 18:29:00.155566578 (166h12m5.090020701s) [upload=146093]: Done uploading segments... Feb 24 18:29:00.155705085 (166h12m5.090159219s) [upload=146093]: Upload finished. err: context deadline exceeded
Duration: 30.001573509s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
291.077121ms remote:
"tcp:45.38.24.2:443" response headers:
Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Content-Length=284 X-Amz-Request-Id=1897422BB3162B24 X-Request-Id=XjSZSNb1G5D Date=Tue, 24 Feb 2026 18:28:53 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/1d53062b9787182c
FAIL (2026-02-24 18:28:53 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897422BB3162B24</RequestId><HostId></HostId></Error>"
Duration: 291.109965ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
19 out of 60 is failed (threshold=3) [.........................................XXXXXXXXXXXXXXXXXXX] duration:
30.000761631s trace:
https://jaeger.dev.storj.io/trace/3d7732deb91c7f2e
FAIL (2026-02-24 18:28:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.000783871s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
21 out of 60 is failed (threshold=3) [.......................................XXXXXXXXXXXXXXXXXXXXX] duration:
30.001773437s trace:
https://jaeger.dev.storj.io/trace/281a7b0236638242
FAIL (2026-02-24 18:28:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:28:18.258381652 (166h11m23.192835785s) [upload=146092]: Starting upload Feb 24 18:28:18.258535265 (166h11m23.192989394s) [upload=146092]: Done starting upload Feb 24 18:28:18.258642061 (166h11m23.193096194s) [upload=146092]: Uploading segments... Feb 24 18:28:18.258749940 (166h11m23.193204085s) [upload=146092]: Got next segment. Inline: true Feb 24 18:28:18.258760042 (166h11m23.193214183s) [upload=146092]: Waiting for error group managing segments... Feb 24 18:28:18.258847993 (166h11m23.193302134s) [upload=146092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:28:18.258855555 (166h11m23.193309694s) [upload=146092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Feb 24 18:28:18.258859935 (166h11m23.193314076s) [upload=146092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Feb 24 18:28:47.966122380 (166h11m52.900576525s) [upload=146092]: Done uploading segments... Feb 24 18:28:47.966179893 (166h11m52.900634038s) [upload=146092]: Upload finished. err: metaclient: context deadline exceeded
Duration: 30.001789079s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
21 out of 60 is failed (threshold=3) [.......................................XXXXXXXXXXXXXXXXXXXXX] duration:
30.001363948s trace:
https://jaeger.dev.storj.io/trace/3821abf43f9e0212
FAIL (2026-02-24 18:28:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001380415s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
15 out of 60 is failed (threshold=3) [.............................................XXXXXXXXXXXXXXX] duration:
1m0.001439626s trace:
https://jaeger.dev.storj.io/trace/3539b60ef1a0b165
FAIL (2026-02-24 18:28:36 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.0014586s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
6 out of 60 is failed (threshold=6) [....................X.........X....X..XX..X.................] duration:
1.917807092s trace:
https://jaeger.dev.storj.io/trace/29fd521ea039f01a
FAIL (2026-02-24 18:28:34 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.917838613s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
16.822998ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=GqU24fsEHpi X-Xss-Protection=1; mode=block Content-Length=274 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=189742269495D499 Date=Tue, 24 Feb 2026 18:28:31 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/526777cd44ec8797
FAIL (2026-02-24 18:28:31 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189742269495D499</RequestId><HostId></HostId></Error>"
Duration: 16.851878ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.388241ms remote:
"tcp:185.244.226.3:443" response headers:
Date=Tue, 24 Feb 2026 18:28:20 GMT Server=Storj Vary=Origin Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=18974223DFFBBE39 X-Request-Id=GQ2rsZpiUzG X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/b764cc077f52f34
FAIL (2026-02-24 18:28:20 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18974223DFFBBE39</RequestId><HostId></HostId></Error>"
Duration: 11.414468ms
edge
gateway
vhost
bgp
ap1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
18 out of 60 is failed (threshold=3) [..........................................XXXXXXXXXXXXXXXXXX] duration:
30.000493248s trace:
https://jaeger.dev.storj.io/trace/621800a0665e7a46
FAIL (2026-02-24 18:28:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.00052208s
edge
gateway
us-select-1
|