Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.499416752s trace:
https://jaeger.dev.storj.io/trace/11507cad06aa5223
FAIL (2026-02-23 17:43:26 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.499441864s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.416412778s trace:
https://jaeger.dev.storj.io/trace/36e97d8015f22124
FAIL (2026-02-23 17:43:24 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Feb 23 17:41:56.004070144 (141h25m0.938524289s) [upload=124341]: Starting upload
Feb 23 17:41:56.004173173 (141h25m0.938627315s) [upload=124341]: Done starting upload
Feb 23 17:41:56.004286224 (141h25m0.93874038s) [upload=124341]: Uploading segments...
Feb 23 17:41:56.004613148 (141h25m0.93906727s) [upload=124341]: Got next segment. Inline: false
Feb 23 17:41:56.004773516 (141h25m0.93922766s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 23 17:41:56.004782051 (141h25m0.939236194s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 23 17:41:56.963639957 (141h25m1.898094089s) [seg_pos={0 0}, upload=124341]: Begin upload segment...
Feb 23 17:41:56.963724470 (141h25m1.898178608s) [noise=true , address=145.79.227.22:4514 , piece_id=T4FFTDMKBIVD4WW3UHDR7OO2THKQ6BTBKMZBHDULYCRIV3QPTMOQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.964806857 (141h25m1.89926098s) [seg_pos={0 0}, upload=124341]: Done begin upload segment.
Feb 23 17:41:56.964962744 (141h25m1.899416883s) [noise=true , address=145.79.227.51:4412 , piece_id=FAAGEOKHTBN4OAK7KVXQOLE2PJQBSUTV6IJMCG656CJ4WEFJU3FA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.964990880 (141h25m1.899445024s) [noise=true , address=45.91.116.5:4332 , piece_id=P72RVOC2U4PF5AIBRYY3DSFHCEAX5BHCNT3THRQBHN3LHNFMSANA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965451429 (141h25m1.899905571s) [noise=true , address=145.79.227.30:4767 , piece_id=EKJYGN57EEWKERPPZLNFSNCVXRE2H2L3DEKWQFHTFOSILW7EX7WQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965586288 (141h25m1.900040427s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965847678 (141h25m1.900301813s) [noise=true , address=145.79.227.6:4260 , piece_id=OFZI7KHTDXJVJPTTGF326U5WAKR372DMNSJLBHKLQ5KTOAOSB2XA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966118833 (141h25m1.900572974s) [noise=true , address=145.79.227.7:4297 , piece_id=HKWBOAM226AL6OM5DQF4CNUPPOKY6XC2DGN6IUVBFOWQEROGHUVQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966384902 (141h25m1.900839041s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966580263 (141h25m1.901034401s) [noise=true , address=145.79.227.47:4270 , piece_id=DJ3U7UBWMHND2GEPACZHOMOTJIZAHGAYLSVBGMCBV5PJSMHSNJCQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.967025032 (141h25m1.901479185s) [noise=true , address=145.79.227.31:4803 , piece_id=MB42IHUXM523TWBQIYTDTKEGHWXZIWCGLU6GMLQQZ7EKMOR2DYJA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.967646573 (141h25m1.902100717s) [noise=true , address=145.79.227.29:4943 , piece_id=PY7GYW5IS5MEDLHF4KBUZNTGUPKO55SOGTNBELEGJNLP3N7I3DVA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.968168297 (141h25m1.902622435s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.968721971 (141h25m1.903176112s) [noise=true , address=45.91.116.11:4120 , piece_id=AVDTFMT42T6NW3XAHV7SC4IRVN24PVW54MUJXJZ5QETMS22WKQEQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.970081793 (141h25m1.904535931s) [noise=true , address=145.79.227.28:4731 , piece_id=NP2Q53QFHVSCHCAVEP3PUDYTZDAMNIUGEZSIK3LQZ4H7A3ZNZX6Q, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.970615369 (141h25m1.905069508s) [noise=true , address=145.79.227.33:4872 , piece_id=LUNVRFWVAXHKKSPK4OZTOVDBY6F7AWND4KNALLUJL642QGPXBYKA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.971157004 (141h25m1.905611143s) [noise=true , address=145.79.227.4:4186 , piece_id=47WUSFKH2DW5FSFIX5L6O3CXZNT3A6XXIZ5FRQLWLPRNIHZXQ2MA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:57.608094655 (141h25m2.542548778s) [upload=124341]: Next returned nil segment
Feb 23 17:41:57.608112892 (141h25m2.542567029s) [upload=124341]: Waiting for error group managing segments...
Feb 23 17:41:57.742822687 (141h25m2.67727682s) [noise=true , address=145.79.227.33:4872 , piece_id=LUNVRFWVAXHKKSPK4OZTOVDBY6F7AWND4KNALLUJL642QGPXBYKA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.749456751 (141h25m2.683910874s) [noise=true , address=145.79.227.51:4412 , piece_id=FAAGEOKHTBN4OAK7KVXQOLE2PJQBSUTV6IJMCG656CJ4WEFJU3FA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.750137124 (141h25m2.684591248s) [noise=true , address=145.79.227.6:4260 , piece_id=OFZI7KHTDXJVJPTTGF326U5WAKR372DMNSJLBHKLQ5KTOAOSB2XA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.750500993 (141h25m2.68495512s) [noise=true , address=145.79.227.4:4186 , piece_id=47WUSFKH2DW5FSFIX5L6O3CXZNT3A6XXIZ5FRQLWLPRNIHZXQ2MA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.752008284 (141h25m2.686462405s) [noise=true , address=145.79.227.29:4943 , piece_id=PY7GYW5IS5MEDLHF4KBUZNTGUPKO55SOGTNBELEGJNLP3N7I3DVA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.752538019 (141h25m2.686992152s) [noise=true , address=45.91.116.11:4120 , piece_id=AVDTFMT42T6NW3XAHV7SC4IRVN24PVW54MUJXJZ5QETMS22WKQEQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.754819111 (141h25m2.689273243s) [noise=true , address=145.79.227.30:4767 , piece_id=EKJYGN57EEWKERPPZLNFSNCVXRE2H2L3DEKWQFHTFOSILW7EX7WQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.759963442 (141h25m2.694417584s) [noise=true , address=45.91.116.5:4332 , piece_id=P72RVOC2U4PF5AIBRYY3DSFHCEAX5BHCNT3THRQBHN3LHNFMSANA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.760607237 (141h25m2.695061369s) [noise=true , address=145.79.227.31:4803 , piece_id=MB42IHUXM523TWBQIYTDTKEGHWXZIWCGLU6GMLQQZ7EKMOR2DYJA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.761853193 (141h25m2.696307335s) [noise=true , address=145.79.227.7:4297 , piece_id=HKWBOAM226AL6OM5DQF4CNUPPOKY6XC2DGN6IUVBFOWQEROGHUVQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.763535570 (141h25m2.697989712s) [noise=true , address=145.79.227.22:4514 , piece_id=T4FFTDMKBIVD4WW3UHDR7OO2THKQ6BTBKMZBHDULYCRIV3QPTMOQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.764161527 (141h25m2.698615666s) [noise=true , address=145.79.227.28:4731 , piece_id=NP2Q53QFHVSCHCAVEP3PUDYTZDAMNIUGEZSIK3LQZ4H7A3ZNZX6Q, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.778254265 (141h25m2.712708402s) [noise=true , address=145.79.227.47:4270 , piece_id=DJ3U7UBWMHND2GEPACZHOMOTJIZAHGAYLSVBGMCBV5PJSMHSNJCQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.778285949 (141h25m2.712740091s) [seg_pos={0 0}, upload=124341]: Satisfied cohort requirements after 13 pieces
Feb 23 17:41:57.778570838 (141h25m2.713024981s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.778582859 (141h25m2.713036996s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.778762950 (141h25m2.713217096s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.778779349 (141h25m2.713233492s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.779144382 (141h25m2.713598526s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pvLo4F5ieDtepopg8Wi8jw6PKNeDCDvtH5iVNQXBUQwSXYxuD): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.779157428 (141h25m2.713611571s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.779216837 (141h25m2.713670959s) [seg_pos={0 0}, upload=124341]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 23 17:41:57.779392538 (141h25m2.713846681s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 23 17:41:57.779400435 (141h25m2.713854577s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 23 17:42:01.523450339 (141h25m6.457904485s) [upload=124341]: Done uploading segments...
Feb 23 17:42:01.523492869 (141h25m6.457947008s) [upload=124341]: Upload finished. err: <nil>
Duration: 2.416455476s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.706781ms remote:
"tcp:185.244.226.3:443" response headers:
X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=1896F11A6AFFD8AF X-Request-Id=X7uHyumu9Vf Date=Mon, 23 Feb 2026 17:43:19 GMT Content-Type=application/xml Server=Storj Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/6af19acad3b7a120
FAIL (2026-02-23 17:43:19 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F11A6AFFD8AF</RequestId><HostId></HostId></Error>"
Duration: 11.730207ms
edge
gateway
vhost
bgp
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
9 out of 60 is failed (threshold=6) [........................X......................XXX.XXX...XX.] duration:
2.195754115s trace:
https://jaeger.dev.storj.io/trace/26293704e7d2b39a
FAIL (2026-02-23 17:43:12 UTC)
orbiter warning: context deadline exceeded
Duration: 2.195779262s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.554887ms remote:
"tcp:185.244.226.3:443" response headers:
X-Amz-Request-Id=1896F116CF49B29D X-Xss-Protection=1; mode=block Content-Length=274 Server=Storj Vary=Origin X-Request-Id=HfdEEjHioM1 Date=Mon, 23 Feb 2026 17:43:03 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/201e86ffbb35e497
FAIL (2026-02-23 17:43:03 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F116CF49B29D</RequestId><HostId></HostId></Error>"
Duration: 9.606776ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
330.613348ms remote:
"tcp:45.38.24.2:443" response headers:
X-Amz-Request-Id=1896F1167122A62B X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:43:02 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Request-Id=M6SAxktvQJ2 Content-Length=284 Vary=Origin target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/521f6d1dfc5d3491
FAIL (2026-02-23 17:43:02 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F1167122A62B</RequestId><HostId></HostId></Error>"
Duration: 330.642369ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.371457689s trace:
https://jaeger.dev.storj.io/trace/36e97d8015f22124
FAIL (2026-02-23 17:42:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Feb 23 17:41:56.004070144 (141h25m0.938524289s) [upload=124341]: Starting upload
Feb 23 17:41:56.004173173 (141h25m0.938627315s) [upload=124341]: Done starting upload
Feb 23 17:41:56.004286224 (141h25m0.93874038s) [upload=124341]: Uploading segments...
Feb 23 17:41:56.004613148 (141h25m0.93906727s) [upload=124341]: Got next segment. Inline: false
Feb 23 17:41:56.004773516 (141h25m0.93922766s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 23 17:41:56.004782051 (141h25m0.939236194s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 23 17:41:56.963639957 (141h25m1.898094089s) [seg_pos={0 0}, upload=124341]: Begin upload segment...
Feb 23 17:41:56.963724470 (141h25m1.898178608s) [noise=true , address=145.79.227.22:4514 , piece_id=T4FFTDMKBIVD4WW3UHDR7OO2THKQ6BTBKMZBHDULYCRIV3QPTMOQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.964806857 (141h25m1.89926098s) [seg_pos={0 0}, upload=124341]: Done begin upload segment.
Feb 23 17:41:56.964962744 (141h25m1.899416883s) [noise=true , address=145.79.227.51:4412 , piece_id=FAAGEOKHTBN4OAK7KVXQOLE2PJQBSUTV6IJMCG656CJ4WEFJU3FA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.964990880 (141h25m1.899445024s) [noise=true , address=45.91.116.5:4332 , piece_id=P72RVOC2U4PF5AIBRYY3DSFHCEAX5BHCNT3THRQBHN3LHNFMSANA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965451429 (141h25m1.899905571s) [noise=true , address=145.79.227.30:4767 , piece_id=EKJYGN57EEWKERPPZLNFSNCVXRE2H2L3DEKWQFHTFOSILW7EX7WQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965586288 (141h25m1.900040427s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965847678 (141h25m1.900301813s) [noise=true , address=145.79.227.6:4260 , piece_id=OFZI7KHTDXJVJPTTGF326U5WAKR372DMNSJLBHKLQ5KTOAOSB2XA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966118833 (141h25m1.900572974s) [noise=true , address=145.79.227.7:4297 , piece_id=HKWBOAM226AL6OM5DQF4CNUPPOKY6XC2DGN6IUVBFOWQEROGHUVQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966384902 (141h25m1.900839041s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966580263 (141h25m1.901034401s) [noise=true , address=145.79.227.47:4270 , piece_id=DJ3U7UBWMHND2GEPACZHOMOTJIZAHGAYLSVBGMCBV5PJSMHSNJCQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.967025032 (141h25m1.901479185s) [noise=true , address=145.79.227.31:4803 , piece_id=MB42IHUXM523TWBQIYTDTKEGHWXZIWCGLU6GMLQQZ7EKMOR2DYJA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.967646573 (141h25m1.902100717s) [noise=true , address=145.79.227.29:4943 , piece_id=PY7GYW5IS5MEDLHF4KBUZNTGUPKO55SOGTNBELEGJNLP3N7I3DVA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.968168297 (141h25m1.902622435s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.968721971 (141h25m1.903176112s) [noise=true , address=45.91.116.11:4120 , piece_id=AVDTFMT42T6NW3XAHV7SC4IRVN24PVW54MUJXJZ5QETMS22WKQEQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.970081793 (141h25m1.904535931s) [noise=true , address=145.79.227.28:4731 , piece_id=NP2Q53QFHVSCHCAVEP3PUDYTZDAMNIUGEZSIK3LQZ4H7A3ZNZX6Q, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.970615369 (141h25m1.905069508s) [noise=true , address=145.79.227.33:4872 , piece_id=LUNVRFWVAXHKKSPK4OZTOVDBY6F7AWND4KNALLUJL642QGPXBYKA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.971157004 (141h25m1.905611143s) [noise=true , address=145.79.227.4:4186 , piece_id=47WUSFKH2DW5FSFIX5L6O3CXZNT3A6XXIZ5FRQLWLPRNIHZXQ2MA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:57.608094655 (141h25m2.542548778s) [upload=124341]: Next returned nil segment
Feb 23 17:41:57.608112892 (141h25m2.542567029s) [upload=124341]: Waiting for error group managing segments...
Feb 23 17:41:57.742822687 (141h25m2.67727682s) [noise=true , address=145.79.227.33:4872 , piece_id=LUNVRFWVAXHKKSPK4OZTOVDBY6F7AWND4KNALLUJL642QGPXBYKA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.749456751 (141h25m2.683910874s) [noise=true , address=145.79.227.51:4412 , piece_id=FAAGEOKHTBN4OAK7KVXQOLE2PJQBSUTV6IJMCG656CJ4WEFJU3FA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.750137124 (141h25m2.684591248s) [noise=true , address=145.79.227.6:4260 , piece_id=OFZI7KHTDXJVJPTTGF326U5WAKR372DMNSJLBHKLQ5KTOAOSB2XA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.750500993 (141h25m2.68495512s) [noise=true , address=145.79.227.4:4186 , piece_id=47WUSFKH2DW5FSFIX5L6O3CXZNT3A6XXIZ5FRQLWLPRNIHZXQ2MA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.752008284 (141h25m2.686462405s) [noise=true , address=145.79.227.29:4943 , piece_id=PY7GYW5IS5MEDLHF4KBUZNTGUPKO55SOGTNBELEGJNLP3N7I3DVA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.752538019 (141h25m2.686992152s) [noise=true , address=45.91.116.11:4120 , piece_id=AVDTFMT42T6NW3XAHV7SC4IRVN24PVW54MUJXJZ5QETMS22WKQEQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.754819111 (141h25m2.689273243s) [noise=true , address=145.79.227.30:4767 , piece_id=EKJYGN57EEWKERPPZLNFSNCVXRE2H2L3DEKWQFHTFOSILW7EX7WQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.759963442 (141h25m2.694417584s) [noise=true , address=45.91.116.5:4332 , piece_id=P72RVOC2U4PF5AIBRYY3DSFHCEAX5BHCNT3THRQBHN3LHNFMSANA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.760607237 (141h25m2.695061369s) [noise=true , address=145.79.227.31:4803 , piece_id=MB42IHUXM523TWBQIYTDTKEGHWXZIWCGLU6GMLQQZ7EKMOR2DYJA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.761853193 (141h25m2.696307335s) [noise=true , address=145.79.227.7:4297 , piece_id=HKWBOAM226AL6OM5DQF4CNUPPOKY6XC2DGN6IUVBFOWQEROGHUVQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.763535570 (141h25m2.697989712s) [noise=true , address=145.79.227.22:4514 , piece_id=T4FFTDMKBIVD4WW3UHDR7OO2THKQ6BTBKMZBHDULYCRIV3QPTMOQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.764161527 (141h25m2.698615666s) [noise=true , address=145.79.227.28:4731 , piece_id=NP2Q53QFHVSCHCAVEP3PUDYTZDAMNIUGEZSIK3LQZ4H7A3ZNZX6Q, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.778254265 (141h25m2.712708402s) [noise=true , address=145.79.227.47:4270 , piece_id=DJ3U7UBWMHND2GEPACZHOMOTJIZAHGAYLSVBGMCBV5PJSMHSNJCQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.778285949 (141h25m2.712740091s) [seg_pos={0 0}, upload=124341]: Satisfied cohort requirements after 13 pieces
Feb 23 17:41:57.778570838 (141h25m2.713024981s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.778582859 (141h25m2.713036996s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.778762950 (141h25m2.713217096s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.778779349 (141h25m2.713233492s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.779144382 (141h25m2.713598526s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pvLo4F5ieDtepopg8Wi8jw6PKNeDCDvtH5iVNQXBUQwSXYxuD): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.779157428 (141h25m2.713611571s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.779216837 (141h25m2.713670959s) [seg_pos={0 0}, upload=124341]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 23 17:41:57.779392538 (141h25m2.713846681s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 23 17:41:57.779400435 (141h25m2.713854577s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 23 17:42:01.523450339 (141h25m6.457904485s) [upload=124341]: Done uploading segments...
Feb 23 17:42:01.523492869 (141h25m6.457947008s) [upload=124341]: Upload finished. err: <nil>
Duration: 2.371481403s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
9 out of 60 is failed (threshold=6) [.........................X......................XXX.XXX...XX] duration:
5.001710225s trace:
https://jaeger.dev.storj.io/trace/26293704e7d2b39a
FAIL (2026-02-23 17:42:49 UTC)
orbiter warning: context deadline exceeded
Duration: 5.00179409s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
14.834352075s trace:
https://jaeger.dev.storj.io/trace/36e97d8015f22124
FAIL (2026-02-23 17:42:47 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Feb 23 17:41:56.004070144 (141h25m0.938524289s) [upload=124341]: Starting upload
Feb 23 17:41:56.004173173 (141h25m0.938627315s) [upload=124341]: Done starting upload
Feb 23 17:41:56.004286224 (141h25m0.93874038s) [upload=124341]: Uploading segments...
Feb 23 17:41:56.004613148 (141h25m0.93906727s) [upload=124341]: Got next segment. Inline: false
Feb 23 17:41:56.004773516 (141h25m0.93922766s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 23 17:41:56.004782051 (141h25m0.939236194s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 23 17:41:56.963639957 (141h25m1.898094089s) [seg_pos={0 0}, upload=124341]: Begin upload segment...
Feb 23 17:41:56.963724470 (141h25m1.898178608s) [noise=true , address=145.79.227.22:4514 , piece_id=T4FFTDMKBIVD4WW3UHDR7OO2THKQ6BTBKMZBHDULYCRIV3QPTMOQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.964806857 (141h25m1.89926098s) [seg_pos={0 0}, upload=124341]: Done begin upload segment.
Feb 23 17:41:56.964962744 (141h25m1.899416883s) [noise=true , address=145.79.227.51:4412 , piece_id=FAAGEOKHTBN4OAK7KVXQOLE2PJQBSUTV6IJMCG656CJ4WEFJU3FA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.964990880 (141h25m1.899445024s) [noise=true , address=45.91.116.5:4332 , piece_id=P72RVOC2U4PF5AIBRYY3DSFHCEAX5BHCNT3THRQBHN3LHNFMSANA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965451429 (141h25m1.899905571s) [noise=true , address=145.79.227.30:4767 , piece_id=EKJYGN57EEWKERPPZLNFSNCVXRE2H2L3DEKWQFHTFOSILW7EX7WQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965586288 (141h25m1.900040427s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965847678 (141h25m1.900301813s) [noise=true , address=145.79.227.6:4260 , piece_id=OFZI7KHTDXJVJPTTGF326U5WAKR372DMNSJLBHKLQ5KTOAOSB2XA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966118833 (141h25m1.900572974s) [noise=true , address=145.79.227.7:4297 , piece_id=HKWBOAM226AL6OM5DQF4CNUPPOKY6XC2DGN6IUVBFOWQEROGHUVQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966384902 (141h25m1.900839041s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966580263 (141h25m1.901034401s) [noise=true , address=145.79.227.47:4270 , piece_id=DJ3U7UBWMHND2GEPACZHOMOTJIZAHGAYLSVBGMCBV5PJSMHSNJCQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.967025032 (141h25m1.901479185s) [noise=true , address=145.79.227.31:4803 , piece_id=MB42IHUXM523TWBQIYTDTKEGHWXZIWCGLU6GMLQQZ7EKMOR2DYJA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.967646573 (141h25m1.902100717s) [noise=true , address=145.79.227.29:4943 , piece_id=PY7GYW5IS5MEDLHF4KBUZNTGUPKO55SOGTNBELEGJNLP3N7I3DVA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.968168297 (141h25m1.902622435s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.968721971 (141h25m1.903176112s) [noise=true , address=45.91.116.11:4120 , piece_id=AVDTFMT42T6NW3XAHV7SC4IRVN24PVW54MUJXJZ5QETMS22WKQEQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.970081793 (141h25m1.904535931s) [noise=true , address=145.79.227.28:4731 , piece_id=NP2Q53QFHVSCHCAVEP3PUDYTZDAMNIUGEZSIK3LQZ4H7A3ZNZX6Q, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.970615369 (141h25m1.905069508s) [noise=true , address=145.79.227.33:4872 , piece_id=LUNVRFWVAXHKKSPK4OZTOVDBY6F7AWND4KNALLUJL642QGPXBYKA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.971157004 (141h25m1.905611143s) [noise=true , address=145.79.227.4:4186 , piece_id=47WUSFKH2DW5FSFIX5L6O3CXZNT3A6XXIZ5FRQLWLPRNIHZXQ2MA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:57.608094655 (141h25m2.542548778s) [upload=124341]: Next returned nil segment
Feb 23 17:41:57.608112892 (141h25m2.542567029s) [upload=124341]: Waiting for error group managing segments...
Feb 23 17:41:57.742822687 (141h25m2.67727682s) [noise=true , address=145.79.227.33:4872 , piece_id=LUNVRFWVAXHKKSPK4OZTOVDBY6F7AWND4KNALLUJL642QGPXBYKA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.749456751 (141h25m2.683910874s) [noise=true , address=145.79.227.51:4412 , piece_id=FAAGEOKHTBN4OAK7KVXQOLE2PJQBSUTV6IJMCG656CJ4WEFJU3FA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.750137124 (141h25m2.684591248s) [noise=true , address=145.79.227.6:4260 , piece_id=OFZI7KHTDXJVJPTTGF326U5WAKR372DMNSJLBHKLQ5KTOAOSB2XA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.750500993 (141h25m2.68495512s) [noise=true , address=145.79.227.4:4186 , piece_id=47WUSFKH2DW5FSFIX5L6O3CXZNT3A6XXIZ5FRQLWLPRNIHZXQ2MA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.752008284 (141h25m2.686462405s) [noise=true , address=145.79.227.29:4943 , piece_id=PY7GYW5IS5MEDLHF4KBUZNTGUPKO55SOGTNBELEGJNLP3N7I3DVA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.752538019 (141h25m2.686992152s) [noise=true , address=45.91.116.11:4120 , piece_id=AVDTFMT42T6NW3XAHV7SC4IRVN24PVW54MUJXJZ5QETMS22WKQEQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.754819111 (141h25m2.689273243s) [noise=true , address=145.79.227.30:4767 , piece_id=EKJYGN57EEWKERPPZLNFSNCVXRE2H2L3DEKWQFHTFOSILW7EX7WQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.759963442 (141h25m2.694417584s) [noise=true , address=45.91.116.5:4332 , piece_id=P72RVOC2U4PF5AIBRYY3DSFHCEAX5BHCNT3THRQBHN3LHNFMSANA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.760607237 (141h25m2.695061369s) [noise=true , address=145.79.227.31:4803 , piece_id=MB42IHUXM523TWBQIYTDTKEGHWXZIWCGLU6GMLQQZ7EKMOR2DYJA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.761853193 (141h25m2.696307335s) [noise=true , address=145.79.227.7:4297 , piece_id=HKWBOAM226AL6OM5DQF4CNUPPOKY6XC2DGN6IUVBFOWQEROGHUVQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.763535570 (141h25m2.697989712s) [noise=true , address=145.79.227.22:4514 , piece_id=T4FFTDMKBIVD4WW3UHDR7OO2THKQ6BTBKMZBHDULYCRIV3QPTMOQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.764161527 (141h25m2.698615666s) [noise=true , address=145.79.227.28:4731 , piece_id=NP2Q53QFHVSCHCAVEP3PUDYTZDAMNIUGEZSIK3LQZ4H7A3ZNZX6Q, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.778254265 (141h25m2.712708402s) [noise=true , address=145.79.227.47:4270 , piece_id=DJ3U7UBWMHND2GEPACZHOMOTJIZAHGAYLSVBGMCBV5PJSMHSNJCQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.778285949 (141h25m2.712740091s) [seg_pos={0 0}, upload=124341]: Satisfied cohort requirements after 13 pieces
Feb 23 17:41:57.778570838 (141h25m2.713024981s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.778582859 (141h25m2.713036996s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.778762950 (141h25m2.713217096s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.778779349 (141h25m2.713233492s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.779144382 (141h25m2.713598526s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pvLo4F5ieDtepopg8Wi8jw6PKNeDCDvtH5iVNQXBUQwSXYxuD): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.779157428 (141h25m2.713611571s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.779216837 (141h25m2.713670959s) [seg_pos={0 0}, upload=124341]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 23 17:41:57.779392538 (141h25m2.713846681s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 23 17:41:57.779400435 (141h25m2.713854577s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 23 17:42:01.523450339 (141h25m6.457904485s) [upload=124341]: Done uploading segments...
Feb 23 17:42:01.523492869 (141h25m6.457947008s) [upload=124341]: Upload finished. err: <nil>
Duration: 14.834379112s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
305.052745ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=1896F110D309FE00 X-Request-Id=eDV32r3Ucs9 X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:42:37 GMT Accept-Ranges=bytes Server=Storj Vary=Origin target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/69b02e6f60c35f6b
FAIL (2026-02-23 17:42:38 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F110D309FE00</RequestId><HostId></HostId></Error>"
Duration: 305.082973ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.710413ms remote:
"tcp:185.244.226.3:443" response headers:
Date=Mon, 23 Feb 2026 17:42:36 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1896F1106F4AF8DF Accept-Ranges=bytes Content-Length=274 Vary=Origin X-Request-Id=XPeT4YRKbbS X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/4db1faabe311ff5f
FAIL (2026-02-23 17:42:36 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F1106F4AF8DF</RequestId><HostId></HostId></Error>"
Duration: 9.745821ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.650176ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1896F10FE8B5E3A1 X-Request-Id=L751ZQZUmeA Content-Length=274 X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:42:34 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/4c331a51b4832358
FAIL (2026-02-23 17:42:34 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F10FE8B5E3A1</RequestId><HostId></HostId></Error>"
Duration: 8.677776ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.145001ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Type=application/xml Server=Storj X-Amz-Request-Id=1896F10F7C3F325E X-Request-Id=EUCXi4PNYao Date=Mon, 23 Feb 2026 17:42:32 GMT Accept-Ranges=bytes Content-Length=274 Vary=Origin X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/5c3a4b43bdbda328
FAIL (2026-02-23 17:42:32 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F10F7C3F325E</RequestId><HostId></HostId></Error>"
Duration: 11.171364ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.002425379s trace:
https://jaeger.dev.storj.io/trace/36e97d8015f22124
FAIL (2026-02-23 17:42:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Feb 23 17:41:56.004070144 (141h25m0.938524289s) [upload=124341]: Starting upload
Feb 23 17:41:56.004173173 (141h25m0.938627315s) [upload=124341]: Done starting upload
Feb 23 17:41:56.004286224 (141h25m0.93874038s) [upload=124341]: Uploading segments...
Feb 23 17:41:56.004613148 (141h25m0.93906727s) [upload=124341]: Got next segment. Inline: false
Feb 23 17:41:56.004773516 (141h25m0.93922766s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 23 17:41:56.004782051 (141h25m0.939236194s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 23 17:41:56.963639957 (141h25m1.898094089s) [seg_pos={0 0}, upload=124341]: Begin upload segment...
Feb 23 17:41:56.963724470 (141h25m1.898178608s) [noise=true , address=145.79.227.22:4514 , piece_id=T4FFTDMKBIVD4WW3UHDR7OO2THKQ6BTBKMZBHDULYCRIV3QPTMOQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.964806857 (141h25m1.89926098s) [seg_pos={0 0}, upload=124341]: Done begin upload segment.
Feb 23 17:41:56.964962744 (141h25m1.899416883s) [noise=true , address=145.79.227.51:4412 , piece_id=FAAGEOKHTBN4OAK7KVXQOLE2PJQBSUTV6IJMCG656CJ4WEFJU3FA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.964990880 (141h25m1.899445024s) [noise=true , address=45.91.116.5:4332 , piece_id=P72RVOC2U4PF5AIBRYY3DSFHCEAX5BHCNT3THRQBHN3LHNFMSANA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965451429 (141h25m1.899905571s) [noise=true , address=145.79.227.30:4767 , piece_id=EKJYGN57EEWKERPPZLNFSNCVXRE2H2L3DEKWQFHTFOSILW7EX7WQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965586288 (141h25m1.900040427s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965847678 (141h25m1.900301813s) [noise=true , address=145.79.227.6:4260 , piece_id=OFZI7KHTDXJVJPTTGF326U5WAKR372DMNSJLBHKLQ5KTOAOSB2XA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966118833 (141h25m1.900572974s) [noise=true , address=145.79.227.7:4297 , piece_id=HKWBOAM226AL6OM5DQF4CNUPPOKY6XC2DGN6IUVBFOWQEROGHUVQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966384902 (141h25m1.900839041s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966580263 (141h25m1.901034401s) [noise=true , address=145.79.227.47:4270 , piece_id=DJ3U7UBWMHND2GEPACZHOMOTJIZAHGAYLSVBGMCBV5PJSMHSNJCQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.967025032 (141h25m1.901479185s) [noise=true , address=145.79.227.31:4803 , piece_id=MB42IHUXM523TWBQIYTDTKEGHWXZIWCGLU6GMLQQZ7EKMOR2DYJA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.967646573 (141h25m1.902100717s) [noise=true , address=145.79.227.29:4943 , piece_id=PY7GYW5IS5MEDLHF4KBUZNTGUPKO55SOGTNBELEGJNLP3N7I3DVA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.968168297 (141h25m1.902622435s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.968721971 (141h25m1.903176112s) [noise=true , address=45.91.116.11:4120 , piece_id=AVDTFMT42T6NW3XAHV7SC4IRVN24PVW54MUJXJZ5QETMS22WKQEQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.970081793 (141h25m1.904535931s) [noise=true , address=145.79.227.28:4731 , piece_id=NP2Q53QFHVSCHCAVEP3PUDYTZDAMNIUGEZSIK3LQZ4H7A3ZNZX6Q, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.970615369 (141h25m1.905069508s) [noise=true , address=145.79.227.33:4872 , piece_id=LUNVRFWVAXHKKSPK4OZTOVDBY6F7AWND4KNALLUJL642QGPXBYKA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.971157004 (141h25m1.905611143s) [noise=true , address=145.79.227.4:4186 , piece_id=47WUSFKH2DW5FSFIX5L6O3CXZNT3A6XXIZ5FRQLWLPRNIHZXQ2MA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:57.608094655 (141h25m2.542548778s) [upload=124341]: Next returned nil segment
Feb 23 17:41:57.608112892 (141h25m2.542567029s) [upload=124341]: Waiting for error group managing segments...
Feb 23 17:41:57.742822687 (141h25m2.67727682s) [noise=true , address=145.79.227.33:4872 , piece_id=LUNVRFWVAXHKKSPK4OZTOVDBY6F7AWND4KNALLUJL642QGPXBYKA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.749456751 (141h25m2.683910874s) [noise=true , address=145.79.227.51:4412 , piece_id=FAAGEOKHTBN4OAK7KVXQOLE2PJQBSUTV6IJMCG656CJ4WEFJU3FA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.750137124 (141h25m2.684591248s) [noise=true , address=145.79.227.6:4260 , piece_id=OFZI7KHTDXJVJPTTGF326U5WAKR372DMNSJLBHKLQ5KTOAOSB2XA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.750500993 (141h25m2.68495512s) [noise=true , address=145.79.227.4:4186 , piece_id=47WUSFKH2DW5FSFIX5L6O3CXZNT3A6XXIZ5FRQLWLPRNIHZXQ2MA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.752008284 (141h25m2.686462405s) [noise=true , address=145.79.227.29:4943 , piece_id=PY7GYW5IS5MEDLHF4KBUZNTGUPKO55SOGTNBELEGJNLP3N7I3DVA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.752538019 (141h25m2.686992152s) [noise=true , address=45.91.116.11:4120 , piece_id=AVDTFMT42T6NW3XAHV7SC4IRVN24PVW54MUJXJZ5QETMS22WKQEQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.754819111 (141h25m2.689273243s) [noise=true , address=145.79.227.30:4767 , piece_id=EKJYGN57EEWKERPPZLNFSNCVXRE2H2L3DEKWQFHTFOSILW7EX7WQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.759963442 (141h25m2.694417584s) [noise=true , address=45.91.116.5:4332 , piece_id=P72RVOC2U4PF5AIBRYY3DSFHCEAX5BHCNT3THRQBHN3LHNFMSANA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.760607237 (141h25m2.695061369s) [noise=true , address=145.79.227.31:4803 , piece_id=MB42IHUXM523TWBQIYTDTKEGHWXZIWCGLU6GMLQQZ7EKMOR2DYJA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.761853193 (141h25m2.696307335s) [noise=true , address=145.79.227.7:4297 , piece_id=HKWBOAM226AL6OM5DQF4CNUPPOKY6XC2DGN6IUVBFOWQEROGHUVQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.763535570 (141h25m2.697989712s) [noise=true , address=145.79.227.22:4514 , piece_id=T4FFTDMKBIVD4WW3UHDR7OO2THKQ6BTBKMZBHDULYCRIV3QPTMOQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.764161527 (141h25m2.698615666s) [noise=true , address=145.79.227.28:4731 , piece_id=NP2Q53QFHVSCHCAVEP3PUDYTZDAMNIUGEZSIK3LQZ4H7A3ZNZX6Q, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.778254265 (141h25m2.712708402s) [noise=true , address=145.79.227.47:4270 , piece_id=DJ3U7UBWMHND2GEPACZHOMOTJIZAHGAYLSVBGMCBV5PJSMHSNJCQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.778285949 (141h25m2.712740091s) [seg_pos={0 0}, upload=124341]: Satisfied cohort requirements after 13 pieces
Feb 23 17:41:57.778570838 (141h25m2.713024981s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.778582859 (141h25m2.713036996s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.778762950 (141h25m2.713217096s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.778779349 (141h25m2.713233492s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.779144382 (141h25m2.713598526s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pvLo4F5ieDtepopg8Wi8jw6PKNeDCDvtH5iVNQXBUQwSXYxuD): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.779157428 (141h25m2.713611571s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.779216837 (141h25m2.713670959s) [seg_pos={0 0}, upload=124341]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 23 17:41:57.779392538 (141h25m2.713846681s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 23 17:41:57.779400435 (141h25m2.713854577s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 23 17:42:01.523450339 (141h25m6.457904485s) [upload=124341]: Done uploading segments...
Feb 23 17:42:01.523492869 (141h25m6.457947008s) [upload=124341]: Upload finished. err: <nil>
Duration: 30.002449893s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
293.716571ms remote:
"tcp:45.38.24.2:443" response headers:
X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:42:18 GMT Content-Length=284 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=1896F10C3C58E2B0 X-Request-Id=3xhkSgxhQrY Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/4a49bd40c7eea0b7
FAIL (2026-02-23 17:42:18 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F10C3C58E2B0</RequestId><HostId></HostId></Error>"
Duration: 293.739482ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
924.452495ms trace:
https://jaeger.dev.storj.io/trace/11507cad06aa5223
FAIL (2026-02-23 17:42:15 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 924.470316ms
core
uplink
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
8 out of 60 is failed (threshold=6) [..........................X......................XXX.XXX...X] duration:
5.001115696s trace:
https://jaeger.dev.storj.io/trace/704a5496cce79b4d
FAIL (2026-02-23 17:42:02 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 5.001143556s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
922.630563ms trace:
https://jaeger.dev.storj.io/trace/11507cad06aa5223
FAIL (2026-02-23 17:41:46 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 922.665635ms
core
uplink
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
303.635442ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1896F102A5CD9526 Content-Length=284 Vary=Origin X-Request-Id=f2HKjjz4Zk1 X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:41:37 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/27aff03bf9eec747
FAIL (2026-02-23 17:41:37 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F102A5CD9526</RequestId><HostId></HostId></Error>"
Duration: 303.659365ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.022746ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml X-Amz-Request-Id=1896F102C88818A0 X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:41:37 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Request-Id=AbGZtZj48y4 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/98ce1a00cf19831
FAIL (2026-02-23 17:41:37 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F102C88818A0</RequestId><HostId></HostId></Error>"
Duration: 7.047863ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.903682ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=YE4L2fSSw73 X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:41:29 GMT Content-Type=application/xml Server=Storj X-Amz-Request-Id=1896F100EA85C4BC target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/3717c2e25f2b5c92
FAIL (2026-02-23 17:41:29 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F100EA85C4BC</RequestId><HostId></HostId></Error>"
Duration: 11.928427ms
edge
gateway
vhost
bgp
ap1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
7 out of 60 is failed (threshold=6) [...........................X......................XXX.XXX...] duration:
1.590427516s trace:
https://jaeger.dev.storj.io/trace/2a50efbc273dfa20
FAIL (2026-02-23 17:41:29 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.590453933s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.099296ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:41:24 GMT Content-Length=274 Content-Type=application/xml X-Amz-Request-Id=1896F0FFD455BAEF X-Request-Id=A1cia29LGT5 Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/7dcac0637e72fbe1
FAIL (2026-02-23 17:41:24 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F0FFD455BAEF</RequestId><HostId></HostId></Error>"
Duration: 9.124241ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
290.484117ms remote:
"tcp:45.38.24.2:443" response headers:
Server=Storj Vary=Origin X-Amz-Request-Id=1896F0FF0AC638B7 X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:41:21 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Request-Id=iQAyxR36bVy Content-Length=284 Content-Type=application/xml target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/26d26464a84123ae
FAIL (2026-02-23 17:41:21 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F0FF0AC638B7</RequestId><HostId></HostId></Error>"
Duration: 290.509726ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.423014ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:41:19 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=1896F0FEA184E920 X-Request-Id=CALFagjDkQF target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/58d34a82e96873a8
FAIL (2026-02-23 17:41:19 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F0FEA184E920</RequestId><HostId></HostId></Error>"
Duration: 11.513806ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
8.809075446s trace:
https://jaeger.dev.storj.io/trace/11507cad06aa5223
FAIL (2026-02-23 17:41:07 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 8.809127716s
core
uplink
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
7 out of 60 is failed (threshold=6) [............................X......................XXX.XXX..] duration:
2.081143155s trace:
https://jaeger.dev.storj.io/trace/2a50efbc273dfa20
FAIL (2026-02-23 17:40:38 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 2.081173244s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
917.024148ms trace:
https://jaeger.dev.storj.io/trace/11507cad06aa5223
FAIL (2026-02-23 17:40:31 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 917.073002ms
core
uplink
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.973151ms remote:
"tcp:185.244.226.3:443" response headers:
Server=Storj Vary=Origin X-Request-Id=9DJVecm5Prz X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:40:31 GMT Accept-Ranges=bytes X-Amz-Request-Id=1896F0F347FDD819 Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/1385f93bcc81bd93
FAIL (2026-02-23 17:40:31 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F0F347FDD819</RequestId><HostId></HostId></Error>"
Duration: 9.043224ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.266565ms remote:
"tcp:185.244.226.3:443" response headers:
Date=Mon, 23 Feb 2026 17:40:27 GMT Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=1896F0F27D3F96C4 X-Request-Id=L9MrGqnF63r target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/6b244fb8e37088c9
FAIL (2026-02-23 17:40:27 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F0F27D3F96C4</RequestId><HostId></HostId></Error>"
Duration: 8.292845ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
305.635706ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=1896F0F1C2475215 X-Request-Id=XKAa3rg9Avg X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=284 Server=Storj Vary=Origin Date=Mon, 23 Feb 2026 17:40:24 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/2672704ef8c12166
FAIL (2026-02-23 17:40:24 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F0F1C2475215</RequestId><HostId></HostId></Error>"
Duration: 305.661526ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.343892ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Length=274 Server=Storj X-Amz-Request-Id=1896F0F1044403D6 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Request-Id=BZYTWLfV4cQ X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:40:21 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/5d301b3eac280c74
FAIL (2026-02-23 17:40:21 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F0F1044403D6</RequestId><HostId></HostId></Error>"
Duration: 10.37293ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
317.693858ms remote:
"tcp:45.38.24.2:443" response headers:
Date=Mon, 23 Feb 2026 17:40:03 GMT Content-Length=284 Vary=Origin X-Amz-Request-Id=1896F0ECCB0F29ED X-Request-Id=DW6K8R9JrKj X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/28ad15f6772d57d2
FAIL (2026-02-23 17:40:03 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F0ECCB0F29ED</RequestId><HostId></HostId></Error>"
Duration: 317.720177ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.128893ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Request-Id=9ZU3NxqSKC5 X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:39:56 GMT Content-Length=274 Content-Type=application/xml X-Amz-Request-Id=1896F0EB23A698BC target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/4ef71d062a70ce8d
FAIL (2026-02-23 17:39:56 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F0EB23A698BC</RequestId><HostId></HostId></Error>"
Duration: 9.172973ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.313129ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1896F0EB10852C87 Date=Mon, 23 Feb 2026 17:39:55 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=PACQcuiRiVe X-Xss-Protection=1; mode=block Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/32f8e942acbf6e81
FAIL (2026-02-23 17:39:55 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F0EB10852C87</RequestId><HostId></HostId></Error>"
Duration: 8.337322ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
970.083229ms trace:
https://jaeger.dev.storj.io/trace/11507cad06aa5223
FAIL (2026-02-23 17:39:53 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 970.195628ms
core
uplink
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
57.855787ms remote:
"tcp:185.244.226.3:443" response headers:
X-Request-Id=ZQPtuA3bZZJ Date=Mon, 23 Feb 2026 17:39:51 GMT Content-Length=274 Server=Storj X-Amz-Request-Id=1896F0EA0E362304 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/106d0e300a52c4cd
FAIL (2026-02-23 17:39:51 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F0EA0E362304</RequestId><HostId></HostId></Error>"
Duration: 57.88097ms
edge
gateway
vhost
bgp
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
7 out of 60 is failed (threshold=6) [.............................X......................XXX.XXX.] duration:
2.277149514s trace:
https://jaeger.dev.storj.io/trace/2a50efbc273dfa20
FAIL (2026-02-23 17:39:49 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 2.277174611s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.16074ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=1896F0E5A273A791 X-Request-Id=78uWtRQGCRw X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:39:32 GMT Content-Length=274 Content-Type=application/xml Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/4fe5cdb127631ef4
FAIL (2026-02-23 17:39:32 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F0E5A273A791</RequestId><HostId></HostId></Error>"
Duration: 11.184386ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001924937s trace:
https://jaeger.dev.storj.io/trace/11507cad06aa5223
FAIL (2026-02-23 17:39:24 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 30.001967413s
core
uplink
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
309.048451ms remote:
"tcp:45.38.24.2:443" response headers:
Server=Storj Vary=Origin X-Request-Id=ghqg4nNDgAJ X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=1896F0DF93BB135E Date=Mon, 23 Feb 2026 17:39:06 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/5bfddd7fab9529a4
FAIL (2026-02-23 17:39:06 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F0DF93BB135E</RequestId><HostId></HostId></Error>"
Duration: 309.073642ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.793949ms remote:
"tcp:185.244.226.3:443" response headers:
Server=Storj X-Request-Id=BLwqZx98A8g X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:38:58 GMT Content-Length=274 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1896F0DDC08451A7 Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/195d045659f477d2
FAIL (2026-02-23 17:38:58 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F0DDC08451A7</RequestId><HostId></HostId></Error>"
Duration: 7.982633ms
edge
gateway
vhost
bgp
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
7 out of 60 is failed (threshold=6) [..............................X......................XXX.XXX] duration:
5.000589515s trace:
https://jaeger.dev.storj.io/trace/2a50efbc273dfa20
FAIL (2026-02-23 17:38:58 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 5.000611338s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.298579ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=1896F0DA6DCC98AD X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Request-Id=RDTYVkQbkMs Date=Mon, 23 Feb 2026 17:38:44 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/761fec977630180a
FAIL (2026-02-23 17:38:44 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F0DA6DCC98AD</RequestId><HostId></HostId></Error>"
Duration: 9.339216ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.274734ms remote:
"tcp:185.244.226.3:443" response headers:
X-Amz-Request-Id=1896F0DA2AABE232 X-Request-Id=LkShxZwxhb1 Date=Mon, 23 Feb 2026 17:38:43 GMT Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/21f90221ecc60a61
FAIL (2026-02-23 17:38:43 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F0DA2AABE232</RequestId><HostId></HostId></Error>"
Duration: 11.300394ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
288.725037ms remote:
"tcp:45.38.24.2:443" response headers:
X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:38:28 GMT Accept-Ranges=bytes Content-Type=application/xml Server=Storj Content-Length=284 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=1896F0D6B940B28B X-Request-Id=FhjAhALQQLM target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/19c8bdb75ec84d94
FAIL (2026-02-23 17:38:28 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F0D6B940B28B</RequestId><HostId></HostId></Error>"
Duration: 288.74948ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.443577ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1896F0D5DFACB1F6 X-Request-Id=KYbdMS2fKW2 Content-Length=274 Server=Storj X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:38:24 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/2367fa52b6de68c3
FAIL (2026-02-23 17:38:24 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F0D5DFACB1F6</RequestId><HostId></HostId></Error>"
Duration: 7.466351ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
325.823856ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Vary=Origin X-Amz-Request-Id=1896F0D21D0ABDA5 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Request-Id=S5rxGLCGgkW Date=Mon, 23 Feb 2026 17:38:08 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/6b26c90d710ce71a
FAIL (2026-02-23 17:38:08 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F0D21D0ABDA5</RequestId><HostId></HostId></Error>"
Duration: 325.848731ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.619119ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Vary=Origin X-Amz-Request-Id=1896F0D162D65C01 X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:38:05 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Request-Id=iFGCRqcEhBV target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/127ca156bf373cdd
FAIL (2026-02-23 17:38:05 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F0D162D65C01</RequestId><HostId></HostId></Error>"
Duration: 7.640396ms
edge
gateway
vhost
bgp
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
6 out of 60 is failed (threshold=6) [...............................X......................XXX.XX] duration:
5.000626904s trace:
https://jaeger.dev.storj.io/trace/9835f39a7de14b0
FAIL (2026-02-23 17:38:03 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 5.000650089s
core
uplink
us-select-1
us1-placement-20
|