Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
12 out of 60 is failed (threshold=6) [...............X......................XXX.XXX...XX....XX.X..] duration:
2.638022346s trace:
https://jaeger.dev.storj.io/trace/41620cd69692420b
FAIL (2026-02-23 17:49:58 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.63804682s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
306.587277ms remote:
"tcp:45.38.24.2:443" response headers:
Vary=Origin X-Amz-Request-Id=1896F175A5FF852D X-Request-Id=4aeqPm6AS3m Date=Mon, 23 Feb 2026 17:49:51 GMT Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block Accept-Ranges=bytes target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/70bb57420dab56af
FAIL (2026-02-23 17:49:51 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F175A5FF852D</RequestId><HostId></HostId></Error>"
Duration: 306.610168ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.712452ms remote:
"tcp:185.244.226.3:443" response headers:
Server=Storj X-Request-Id=BQNNbn5at9c X-Xss-Protection=1; mode=block Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1896F17123671162 Date=Mon, 23 Feb 2026 17:49:31 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/6382e815264034bf
FAIL (2026-02-23 17:49:31 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F17123671162</RequestId><HostId></HostId></Error>"
Duration: 8.737169ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.270337837s trace:
https://jaeger.dev.storj.io/trace/36e97d8015f22124
FAIL (2026-02-23 17:49:22 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Feb 23 17:41:56.004070144 (141h25m0.938524289s) [upload=124341]: Starting upload
Feb 23 17:41:56.004173173 (141h25m0.938627315s) [upload=124341]: Done starting upload
Feb 23 17:41:56.004286224 (141h25m0.93874038s) [upload=124341]: Uploading segments...
Feb 23 17:41:56.004613148 (141h25m0.93906727s) [upload=124341]: Got next segment. Inline: false
Feb 23 17:41:56.004773516 (141h25m0.93922766s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 23 17:41:56.004782051 (141h25m0.939236194s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 23 17:41:56.963639957 (141h25m1.898094089s) [seg_pos={0 0}, upload=124341]: Begin upload segment...
Feb 23 17:41:56.963724470 (141h25m1.898178608s) [noise=true , address=145.79.227.22:4514 , piece_id=T4FFTDMKBIVD4WW3UHDR7OO2THKQ6BTBKMZBHDULYCRIV3QPTMOQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.964806857 (141h25m1.89926098s) [seg_pos={0 0}, upload=124341]: Done begin upload segment.
Feb 23 17:41:56.964962744 (141h25m1.899416883s) [noise=true , address=145.79.227.51:4412 , piece_id=FAAGEOKHTBN4OAK7KVXQOLE2PJQBSUTV6IJMCG656CJ4WEFJU3FA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.964990880 (141h25m1.899445024s) [noise=true , address=45.91.116.5:4332 , piece_id=P72RVOC2U4PF5AIBRYY3DSFHCEAX5BHCNT3THRQBHN3LHNFMSANA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965451429 (141h25m1.899905571s) [noise=true , address=145.79.227.30:4767 , piece_id=EKJYGN57EEWKERPPZLNFSNCVXRE2H2L3DEKWQFHTFOSILW7EX7WQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965586288 (141h25m1.900040427s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965847678 (141h25m1.900301813s) [noise=true , address=145.79.227.6:4260 , piece_id=OFZI7KHTDXJVJPTTGF326U5WAKR372DMNSJLBHKLQ5KTOAOSB2XA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966118833 (141h25m1.900572974s) [noise=true , address=145.79.227.7:4297 , piece_id=HKWBOAM226AL6OM5DQF4CNUPPOKY6XC2DGN6IUVBFOWQEROGHUVQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966384902 (141h25m1.900839041s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966580263 (141h25m1.901034401s) [noise=true , address=145.79.227.47:4270 , piece_id=DJ3U7UBWMHND2GEPACZHOMOTJIZAHGAYLSVBGMCBV5PJSMHSNJCQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.967025032 (141h25m1.901479185s) [noise=true , address=145.79.227.31:4803 , piece_id=MB42IHUXM523TWBQIYTDTKEGHWXZIWCGLU6GMLQQZ7EKMOR2DYJA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.967646573 (141h25m1.902100717s) [noise=true , address=145.79.227.29:4943 , piece_id=PY7GYW5IS5MEDLHF4KBUZNTGUPKO55SOGTNBELEGJNLP3N7I3DVA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.968168297 (141h25m1.902622435s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.968721971 (141h25m1.903176112s) [noise=true , address=45.91.116.11:4120 , piece_id=AVDTFMT42T6NW3XAHV7SC4IRVN24PVW54MUJXJZ5QETMS22WKQEQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.970081793 (141h25m1.904535931s) [noise=true , address=145.79.227.28:4731 , piece_id=NP2Q53QFHVSCHCAVEP3PUDYTZDAMNIUGEZSIK3LQZ4H7A3ZNZX6Q, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.970615369 (141h25m1.905069508s) [noise=true , address=145.79.227.33:4872 , piece_id=LUNVRFWVAXHKKSPK4OZTOVDBY6F7AWND4KNALLUJL642QGPXBYKA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.971157004 (141h25m1.905611143s) [noise=true , address=145.79.227.4:4186 , piece_id=47WUSFKH2DW5FSFIX5L6O3CXZNT3A6XXIZ5FRQLWLPRNIHZXQ2MA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:57.608094655 (141h25m2.542548778s) [upload=124341]: Next returned nil segment
Feb 23 17:41:57.608112892 (141h25m2.542567029s) [upload=124341]: Waiting for error group managing segments...
Feb 23 17:41:57.742822687 (141h25m2.67727682s) [noise=true , address=145.79.227.33:4872 , piece_id=LUNVRFWVAXHKKSPK4OZTOVDBY6F7AWND4KNALLUJL642QGPXBYKA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.749456751 (141h25m2.683910874s) [noise=true , address=145.79.227.51:4412 , piece_id=FAAGEOKHTBN4OAK7KVXQOLE2PJQBSUTV6IJMCG656CJ4WEFJU3FA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.750137124 (141h25m2.684591248s) [noise=true , address=145.79.227.6:4260 , piece_id=OFZI7KHTDXJVJPTTGF326U5WAKR372DMNSJLBHKLQ5KTOAOSB2XA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.750500993 (141h25m2.68495512s) [noise=true , address=145.79.227.4:4186 , piece_id=47WUSFKH2DW5FSFIX5L6O3CXZNT3A6XXIZ5FRQLWLPRNIHZXQ2MA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.752008284 (141h25m2.686462405s) [noise=true , address=145.79.227.29:4943 , piece_id=PY7GYW5IS5MEDLHF4KBUZNTGUPKO55SOGTNBELEGJNLP3N7I3DVA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.752538019 (141h25m2.686992152s) [noise=true , address=45.91.116.11:4120 , piece_id=AVDTFMT42T6NW3XAHV7SC4IRVN24PVW54MUJXJZ5QETMS22WKQEQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.754819111 (141h25m2.689273243s) [noise=true , address=145.79.227.30:4767 , piece_id=EKJYGN57EEWKERPPZLNFSNCVXRE2H2L3DEKWQFHTFOSILW7EX7WQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.759963442 (141h25m2.694417584s) [noise=true , address=45.91.116.5:4332 , piece_id=P72RVOC2U4PF5AIBRYY3DSFHCEAX5BHCNT3THRQBHN3LHNFMSANA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.760607237 (141h25m2.695061369s) [noise=true , address=145.79.227.31:4803 , piece_id=MB42IHUXM523TWBQIYTDTKEGHWXZIWCGLU6GMLQQZ7EKMOR2DYJA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.761853193 (141h25m2.696307335s) [noise=true , address=145.79.227.7:4297 , piece_id=HKWBOAM226AL6OM5DQF4CNUPPOKY6XC2DGN6IUVBFOWQEROGHUVQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.763535570 (141h25m2.697989712s) [noise=true , address=145.79.227.22:4514 , piece_id=T4FFTDMKBIVD4WW3UHDR7OO2THKQ6BTBKMZBHDULYCRIV3QPTMOQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.764161527 (141h25m2.698615666s) [noise=true , address=145.79.227.28:4731 , piece_id=NP2Q53QFHVSCHCAVEP3PUDYTZDAMNIUGEZSIK3LQZ4H7A3ZNZX6Q, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.778254265 (141h25m2.712708402s) [noise=true , address=145.79.227.47:4270 , piece_id=DJ3U7UBWMHND2GEPACZHOMOTJIZAHGAYLSVBGMCBV5PJSMHSNJCQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.778285949 (141h25m2.712740091s) [seg_pos={0 0}, upload=124341]: Satisfied cohort requirements after 13 pieces
Feb 23 17:41:57.778570838 (141h25m2.713024981s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.778582859 (141h25m2.713036996s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.778762950 (141h25m2.713217096s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.778779349 (141h25m2.713233492s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.779144382 (141h25m2.713598526s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pvLo4F5ieDtepopg8Wi8jw6PKNeDCDvtH5iVNQXBUQwSXYxuD): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.779157428 (141h25m2.713611571s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.779216837 (141h25m2.713670959s) [seg_pos={0 0}, upload=124341]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 23 17:41:57.779392538 (141h25m2.713846681s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 23 17:41:57.779400435 (141h25m2.713854577s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 23 17:42:01.523450339 (141h25m6.457904485s) [upload=124341]: Done uploading segments...
Feb 23 17:42:01.523492869 (141h25m6.457947008s) [upload=124341]: Upload finished. err: <nil>
Duration: 2.270365078s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
838.679024ms trace:
https://jaeger.dev.storj.io/trace/11507cad06aa5223
FAIL (2026-02-23 17:49:18 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 838.705501ms
core
uplink
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.451522ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Length=274 Server=Storj Vary=Origin X-Amz-Request-Id=1896F16C75E62A7A X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:49:11 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=jNzEeNdbDo8 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/3ac204097fc41c6d
FAIL (2026-02-23 17:49:11 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F16C75E62A7A</RequestId><HostId></HostId></Error>"
Duration: 8.502012ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.709269ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1896F16ADA0BC581 X-Request-Id=N5ASHK1SbJx X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:49:04 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2ce1a4271eb8b990
FAIL (2026-02-23 17:49:04 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F16ADA0BC581</RequestId><HostId></HostId></Error>"
Duration: 8.740589ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
896.292056ms trace:
https://jaeger.dev.storj.io/trace/11507cad06aa5223
FAIL (2026-02-23 17:49:01 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 896.339946ms
core
uplink
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
12 out of 60 is failed (threshold=6) [................X......................XXX.XXX...XX....XX.X.] duration:
1.681220516s trace:
https://jaeger.dev.storj.io/trace/41620cd69692420b
FAIL (2026-02-23 17:48:50 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.681263335s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.775001ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Server=Storj Vary=Origin X-Amz-Request-Id=1896F16748116A28 X-Request-Id=EjN7YEaVkai X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:48:49 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/37cecbf6312c08ae
FAIL (2026-02-23 17:48:49 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F16748116A28</RequestId><HostId></HostId></Error>"
Duration: 7.795625ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
319.898885ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=1896F16706C410F0 X-Request-Id=P7LVgyyb639 X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:48:48 GMT Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Vary=Origin target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/4f505eab2330d4a4
FAIL (2026-02-23 17:48:48 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F16706C410F0</RequestId><HostId></HostId></Error>"
Duration: 319.923904ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.326272453s trace:
https://jaeger.dev.storj.io/trace/36e97d8015f22124
FAIL (2026-02-23 17:48:47 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Feb 23 17:41:56.004070144 (141h25m0.938524289s) [upload=124341]: Starting upload
Feb 23 17:41:56.004173173 (141h25m0.938627315s) [upload=124341]: Done starting upload
Feb 23 17:41:56.004286224 (141h25m0.93874038s) [upload=124341]: Uploading segments...
Feb 23 17:41:56.004613148 (141h25m0.93906727s) [upload=124341]: Got next segment. Inline: false
Feb 23 17:41:56.004773516 (141h25m0.93922766s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 23 17:41:56.004782051 (141h25m0.939236194s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 23 17:41:56.963639957 (141h25m1.898094089s) [seg_pos={0 0}, upload=124341]: Begin upload segment...
Feb 23 17:41:56.963724470 (141h25m1.898178608s) [noise=true , address=145.79.227.22:4514 , piece_id=T4FFTDMKBIVD4WW3UHDR7OO2THKQ6BTBKMZBHDULYCRIV3QPTMOQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.964806857 (141h25m1.89926098s) [seg_pos={0 0}, upload=124341]: Done begin upload segment.
Feb 23 17:41:56.964962744 (141h25m1.899416883s) [noise=true , address=145.79.227.51:4412 , piece_id=FAAGEOKHTBN4OAK7KVXQOLE2PJQBSUTV6IJMCG656CJ4WEFJU3FA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.964990880 (141h25m1.899445024s) [noise=true , address=45.91.116.5:4332 , piece_id=P72RVOC2U4PF5AIBRYY3DSFHCEAX5BHCNT3THRQBHN3LHNFMSANA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965451429 (141h25m1.899905571s) [noise=true , address=145.79.227.30:4767 , piece_id=EKJYGN57EEWKERPPZLNFSNCVXRE2H2L3DEKWQFHTFOSILW7EX7WQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965586288 (141h25m1.900040427s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965847678 (141h25m1.900301813s) [noise=true , address=145.79.227.6:4260 , piece_id=OFZI7KHTDXJVJPTTGF326U5WAKR372DMNSJLBHKLQ5KTOAOSB2XA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966118833 (141h25m1.900572974s) [noise=true , address=145.79.227.7:4297 , piece_id=HKWBOAM226AL6OM5DQF4CNUPPOKY6XC2DGN6IUVBFOWQEROGHUVQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966384902 (141h25m1.900839041s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966580263 (141h25m1.901034401s) [noise=true , address=145.79.227.47:4270 , piece_id=DJ3U7UBWMHND2GEPACZHOMOTJIZAHGAYLSVBGMCBV5PJSMHSNJCQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.967025032 (141h25m1.901479185s) [noise=true , address=145.79.227.31:4803 , piece_id=MB42IHUXM523TWBQIYTDTKEGHWXZIWCGLU6GMLQQZ7EKMOR2DYJA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.967646573 (141h25m1.902100717s) [noise=true , address=145.79.227.29:4943 , piece_id=PY7GYW5IS5MEDLHF4KBUZNTGUPKO55SOGTNBELEGJNLP3N7I3DVA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.968168297 (141h25m1.902622435s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.968721971 (141h25m1.903176112s) [noise=true , address=45.91.116.11:4120 , piece_id=AVDTFMT42T6NW3XAHV7SC4IRVN24PVW54MUJXJZ5QETMS22WKQEQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.970081793 (141h25m1.904535931s) [noise=true , address=145.79.227.28:4731 , piece_id=NP2Q53QFHVSCHCAVEP3PUDYTZDAMNIUGEZSIK3LQZ4H7A3ZNZX6Q, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.970615369 (141h25m1.905069508s) [noise=true , address=145.79.227.33:4872 , piece_id=LUNVRFWVAXHKKSPK4OZTOVDBY6F7AWND4KNALLUJL642QGPXBYKA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.971157004 (141h25m1.905611143s) [noise=true , address=145.79.227.4:4186 , piece_id=47WUSFKH2DW5FSFIX5L6O3CXZNT3A6XXIZ5FRQLWLPRNIHZXQ2MA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:57.608094655 (141h25m2.542548778s) [upload=124341]: Next returned nil segment
Feb 23 17:41:57.608112892 (141h25m2.542567029s) [upload=124341]: Waiting for error group managing segments...
Feb 23 17:41:57.742822687 (141h25m2.67727682s) [noise=true , address=145.79.227.33:4872 , piece_id=LUNVRFWVAXHKKSPK4OZTOVDBY6F7AWND4KNALLUJL642QGPXBYKA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.749456751 (141h25m2.683910874s) [noise=true , address=145.79.227.51:4412 , piece_id=FAAGEOKHTBN4OAK7KVXQOLE2PJQBSUTV6IJMCG656CJ4WEFJU3FA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.750137124 (141h25m2.684591248s) [noise=true , address=145.79.227.6:4260 , piece_id=OFZI7KHTDXJVJPTTGF326U5WAKR372DMNSJLBHKLQ5KTOAOSB2XA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.750500993 (141h25m2.68495512s) [noise=true , address=145.79.227.4:4186 , piece_id=47WUSFKH2DW5FSFIX5L6O3CXZNT3A6XXIZ5FRQLWLPRNIHZXQ2MA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.752008284 (141h25m2.686462405s) [noise=true , address=145.79.227.29:4943 , piece_id=PY7GYW5IS5MEDLHF4KBUZNTGUPKO55SOGTNBELEGJNLP3N7I3DVA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.752538019 (141h25m2.686992152s) [noise=true , address=45.91.116.11:4120 , piece_id=AVDTFMT42T6NW3XAHV7SC4IRVN24PVW54MUJXJZ5QETMS22WKQEQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.754819111 (141h25m2.689273243s) [noise=true , address=145.79.227.30:4767 , piece_id=EKJYGN57EEWKERPPZLNFSNCVXRE2H2L3DEKWQFHTFOSILW7EX7WQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.759963442 (141h25m2.694417584s) [noise=true , address=45.91.116.5:4332 , piece_id=P72RVOC2U4PF5AIBRYY3DSFHCEAX5BHCNT3THRQBHN3LHNFMSANA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.760607237 (141h25m2.695061369s) [noise=true , address=145.79.227.31:4803 , piece_id=MB42IHUXM523TWBQIYTDTKEGHWXZIWCGLU6GMLQQZ7EKMOR2DYJA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.761853193 (141h25m2.696307335s) [noise=true , address=145.79.227.7:4297 , piece_id=HKWBOAM226AL6OM5DQF4CNUPPOKY6XC2DGN6IUVBFOWQEROGHUVQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.763535570 (141h25m2.697989712s) [noise=true , address=145.79.227.22:4514 , piece_id=T4FFTDMKBIVD4WW3UHDR7OO2THKQ6BTBKMZBHDULYCRIV3QPTMOQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.764161527 (141h25m2.698615666s) [noise=true , address=145.79.227.28:4731 , piece_id=NP2Q53QFHVSCHCAVEP3PUDYTZDAMNIUGEZSIK3LQZ4H7A3ZNZX6Q, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.778254265 (141h25m2.712708402s) [noise=true , address=145.79.227.47:4270 , piece_id=DJ3U7UBWMHND2GEPACZHOMOTJIZAHGAYLSVBGMCBV5PJSMHSNJCQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.778285949 (141h25m2.712740091s) [seg_pos={0 0}, upload=124341]: Satisfied cohort requirements after 13 pieces
Feb 23 17:41:57.778570838 (141h25m2.713024981s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.778582859 (141h25m2.713036996s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.778762950 (141h25m2.713217096s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.778779349 (141h25m2.713233492s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.779144382 (141h25m2.713598526s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pvLo4F5ieDtepopg8Wi8jw6PKNeDCDvtH5iVNQXBUQwSXYxuD): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.779157428 (141h25m2.713611571s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.779216837 (141h25m2.713670959s) [seg_pos={0 0}, upload=124341]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 23 17:41:57.779392538 (141h25m2.713846681s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 23 17:41:57.779400435 (141h25m2.713854577s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 23 17:42:01.523450339 (141h25m6.457904485s) [upload=124341]: Done uploading segments...
Feb 23 17:42:01.523492869 (141h25m6.457947008s) [upload=124341]: Upload finished. err: <nil>
Duration: 2.326310953s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.105189ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=1896F166E5F85DAF X-Request-Id=52cJaguaem4 X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:48:47 GMT Content-Type=application/xml Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/3c84f49506ac9b45
FAIL (2026-02-23 17:48:47 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F166E5F85DAF</RequestId><HostId></HostId></Error>"
Duration: 14.118027ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
892.950597ms trace:
https://jaeger.dev.storj.io/trace/11507cad06aa5223
FAIL (2026-02-23 17:48:40 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 892.982178ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
11.942144806s trace:
https://jaeger.dev.storj.io/trace/36e97d8015f22124
FAIL (2026-02-23 17:48:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Feb 23 17:41:56.004070144 (141h25m0.938524289s) [upload=124341]: Starting upload
Feb 23 17:41:56.004173173 (141h25m0.938627315s) [upload=124341]: Done starting upload
Feb 23 17:41:56.004286224 (141h25m0.93874038s) [upload=124341]: Uploading segments...
Feb 23 17:41:56.004613148 (141h25m0.93906727s) [upload=124341]: Got next segment. Inline: false
Feb 23 17:41:56.004773516 (141h25m0.93922766s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 23 17:41:56.004782051 (141h25m0.939236194s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 23 17:41:56.963639957 (141h25m1.898094089s) [seg_pos={0 0}, upload=124341]: Begin upload segment...
Feb 23 17:41:56.963724470 (141h25m1.898178608s) [noise=true , address=145.79.227.22:4514 , piece_id=T4FFTDMKBIVD4WW3UHDR7OO2THKQ6BTBKMZBHDULYCRIV3QPTMOQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.964806857 (141h25m1.89926098s) [seg_pos={0 0}, upload=124341]: Done begin upload segment.
Feb 23 17:41:56.964962744 (141h25m1.899416883s) [noise=true , address=145.79.227.51:4412 , piece_id=FAAGEOKHTBN4OAK7KVXQOLE2PJQBSUTV6IJMCG656CJ4WEFJU3FA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.964990880 (141h25m1.899445024s) [noise=true , address=45.91.116.5:4332 , piece_id=P72RVOC2U4PF5AIBRYY3DSFHCEAX5BHCNT3THRQBHN3LHNFMSANA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965451429 (141h25m1.899905571s) [noise=true , address=145.79.227.30:4767 , piece_id=EKJYGN57EEWKERPPZLNFSNCVXRE2H2L3DEKWQFHTFOSILW7EX7WQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965586288 (141h25m1.900040427s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965847678 (141h25m1.900301813s) [noise=true , address=145.79.227.6:4260 , piece_id=OFZI7KHTDXJVJPTTGF326U5WAKR372DMNSJLBHKLQ5KTOAOSB2XA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966118833 (141h25m1.900572974s) [noise=true , address=145.79.227.7:4297 , piece_id=HKWBOAM226AL6OM5DQF4CNUPPOKY6XC2DGN6IUVBFOWQEROGHUVQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966384902 (141h25m1.900839041s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966580263 (141h25m1.901034401s) [noise=true , address=145.79.227.47:4270 , piece_id=DJ3U7UBWMHND2GEPACZHOMOTJIZAHGAYLSVBGMCBV5PJSMHSNJCQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.967025032 (141h25m1.901479185s) [noise=true , address=145.79.227.31:4803 , piece_id=MB42IHUXM523TWBQIYTDTKEGHWXZIWCGLU6GMLQQZ7EKMOR2DYJA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.967646573 (141h25m1.902100717s) [noise=true , address=145.79.227.29:4943 , piece_id=PY7GYW5IS5MEDLHF4KBUZNTGUPKO55SOGTNBELEGJNLP3N7I3DVA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.968168297 (141h25m1.902622435s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.968721971 (141h25m1.903176112s) [noise=true , address=45.91.116.11:4120 , piece_id=AVDTFMT42T6NW3XAHV7SC4IRVN24PVW54MUJXJZ5QETMS22WKQEQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.970081793 (141h25m1.904535931s) [noise=true , address=145.79.227.28:4731 , piece_id=NP2Q53QFHVSCHCAVEP3PUDYTZDAMNIUGEZSIK3LQZ4H7A3ZNZX6Q, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.970615369 (141h25m1.905069508s) [noise=true , address=145.79.227.33:4872 , piece_id=LUNVRFWVAXHKKSPK4OZTOVDBY6F7AWND4KNALLUJL642QGPXBYKA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.971157004 (141h25m1.905611143s) [noise=true , address=145.79.227.4:4186 , piece_id=47WUSFKH2DW5FSFIX5L6O3CXZNT3A6XXIZ5FRQLWLPRNIHZXQ2MA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:57.608094655 (141h25m2.542548778s) [upload=124341]: Next returned nil segment
Feb 23 17:41:57.608112892 (141h25m2.542567029s) [upload=124341]: Waiting for error group managing segments...
Feb 23 17:41:57.742822687 (141h25m2.67727682s) [noise=true , address=145.79.227.33:4872 , piece_id=LUNVRFWVAXHKKSPK4OZTOVDBY6F7AWND4KNALLUJL642QGPXBYKA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.749456751 (141h25m2.683910874s) [noise=true , address=145.79.227.51:4412 , piece_id=FAAGEOKHTBN4OAK7KVXQOLE2PJQBSUTV6IJMCG656CJ4WEFJU3FA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.750137124 (141h25m2.684591248s) [noise=true , address=145.79.227.6:4260 , piece_id=OFZI7KHTDXJVJPTTGF326U5WAKR372DMNSJLBHKLQ5KTOAOSB2XA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.750500993 (141h25m2.68495512s) [noise=true , address=145.79.227.4:4186 , piece_id=47WUSFKH2DW5FSFIX5L6O3CXZNT3A6XXIZ5FRQLWLPRNIHZXQ2MA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.752008284 (141h25m2.686462405s) [noise=true , address=145.79.227.29:4943 , piece_id=PY7GYW5IS5MEDLHF4KBUZNTGUPKO55SOGTNBELEGJNLP3N7I3DVA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.752538019 (141h25m2.686992152s) [noise=true , address=45.91.116.11:4120 , piece_id=AVDTFMT42T6NW3XAHV7SC4IRVN24PVW54MUJXJZ5QETMS22WKQEQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.754819111 (141h25m2.689273243s) [noise=true , address=145.79.227.30:4767 , piece_id=EKJYGN57EEWKERPPZLNFSNCVXRE2H2L3DEKWQFHTFOSILW7EX7WQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.759963442 (141h25m2.694417584s) [noise=true , address=45.91.116.5:4332 , piece_id=P72RVOC2U4PF5AIBRYY3DSFHCEAX5BHCNT3THRQBHN3LHNFMSANA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.760607237 (141h25m2.695061369s) [noise=true , address=145.79.227.31:4803 , piece_id=MB42IHUXM523TWBQIYTDTKEGHWXZIWCGLU6GMLQQZ7EKMOR2DYJA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.761853193 (141h25m2.696307335s) [noise=true , address=145.79.227.7:4297 , piece_id=HKWBOAM226AL6OM5DQF4CNUPPOKY6XC2DGN6IUVBFOWQEROGHUVQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.763535570 (141h25m2.697989712s) [noise=true , address=145.79.227.22:4514 , piece_id=T4FFTDMKBIVD4WW3UHDR7OO2THKQ6BTBKMZBHDULYCRIV3QPTMOQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.764161527 (141h25m2.698615666s) [noise=true , address=145.79.227.28:4731 , piece_id=NP2Q53QFHVSCHCAVEP3PUDYTZDAMNIUGEZSIK3LQZ4H7A3ZNZX6Q, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.778254265 (141h25m2.712708402s) [noise=true , address=145.79.227.47:4270 , piece_id=DJ3U7UBWMHND2GEPACZHOMOTJIZAHGAYLSVBGMCBV5PJSMHSNJCQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.778285949 (141h25m2.712740091s) [seg_pos={0 0}, upload=124341]: Satisfied cohort requirements after 13 pieces
Feb 23 17:41:57.778570838 (141h25m2.713024981s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.778582859 (141h25m2.713036996s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.778762950 (141h25m2.713217096s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.778779349 (141h25m2.713233492s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.779144382 (141h25m2.713598526s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pvLo4F5ieDtepopg8Wi8jw6PKNeDCDvtH5iVNQXBUQwSXYxuD): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.779157428 (141h25m2.713611571s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.779216837 (141h25m2.713670959s) [seg_pos={0 0}, upload=124341]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 23 17:41:57.779392538 (141h25m2.713846681s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 23 17:41:57.779400435 (141h25m2.713854577s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 23 17:42:01.523450339 (141h25m6.457904485s) [upload=124341]: Done uploading segments...
Feb 23 17:42:01.523492869 (141h25m6.457947008s) [upload=124341]: Upload finished. err: <nil>
Duration: 11.942169779s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.717637ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=9VW9hCS2P9L Date=Mon, 23 Feb 2026 17:48:19 GMT Accept-Ranges=bytes Content-Length=274 Server=Storj Vary=Origin X-Amz-Request-Id=1896F160691C9C4C X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/5fcc94f4f8f69f5d
FAIL (2026-02-23 17:48:19 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F160691C9C4C</RequestId><HostId></HostId></Error>"
Duration: 7.737889ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.337367ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1896F1607237ABBD Server=Storj X-Request-Id=3eYQSKt7dNn X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:48:19 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2dcbaed6b7cf4f63
FAIL (2026-02-23 17:48:19 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F1607237ABBD</RequestId><HostId></HostId></Error>"
Duration: 8.360881ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
302.201464ms remote:
"tcp:45.38.24.2:443" response headers:
X-Amz-Request-Id=1896F15F843EDF6D X-Xss-Protection=1; mode=block Content-Type=application/xml X-Request-Id=BnJvYL8Dvf6 Date=Mon, 23 Feb 2026 17:48:15 GMT Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/57f994dbef80782e
FAIL (2026-02-23 17:48:16 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F15F843EDF6D</RequestId><HostId></HostId></Error>"
Duration: 302.229724ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
915.932264ms trace:
https://jaeger.dev.storj.io/trace/11507cad06aa5223
FAIL (2026-02-23 17:48:00 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 915.959873ms
core
uplink
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
12 out of 60 is failed (threshold=6) [.................X......................XXX.XXX...XX....XX.X] duration:
5.001509986s trace:
https://jaeger.dev.storj.io/trace/41620cd69692420b
FAIL (2026-02-23 17:47:51 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001535043s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.438144ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1896F159A52BC2ED Content-Length=274 Server=Storj X-Request-Id=YEqsqhm2C82 X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:47:50 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/6506f1880d63dbc2
FAIL (2026-02-23 17:47:50 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F159A52BC2ED</RequestId><HostId></HostId></Error>"
Duration: 10.462828ms
edge
gateway
vhost
bgp
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
11 out of 60 is failed (threshold=6) [..................X......................XXX.XXX...XX....XX.] duration:
1.648009544s trace:
https://jaeger.dev.storj.io/trace/277ac1f95c99814d
FAIL (2026-02-23 17:47:28 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.648032303s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
287.672003ms remote:
"tcp:45.38.24.2:443" response headers:
Vary=Origin Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=1896F153AD2FB748 X-Request-Id=RXfwJUMEYe4 X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:47:25 GMT Server=Storj target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3182851439d1f52c
FAIL (2026-02-23 17:47:25 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F153AD2FB748</RequestId><HostId></HostId></Error>"
Duration: 287.711545ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.313547ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Length=274 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1896F152FEE68536 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=21G58PgvcgQ Date=Mon, 23 Feb 2026 17:47:22 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/17afc85bc82b6ca8
FAIL (2026-02-23 17:47:22 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F152FEE68536</RequestId><HostId></HostId></Error>"
Duration: 8.363557ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.364073915s trace:
https://jaeger.dev.storj.io/trace/36e97d8015f22124
FAIL (2026-02-23 17:47:12 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Feb 23 17:41:56.004070144 (141h25m0.938524289s) [upload=124341]: Starting upload
Feb 23 17:41:56.004173173 (141h25m0.938627315s) [upload=124341]: Done starting upload
Feb 23 17:41:56.004286224 (141h25m0.93874038s) [upload=124341]: Uploading segments...
Feb 23 17:41:56.004613148 (141h25m0.93906727s) [upload=124341]: Got next segment. Inline: false
Feb 23 17:41:56.004773516 (141h25m0.93922766s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 23 17:41:56.004782051 (141h25m0.939236194s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 23 17:41:56.963639957 (141h25m1.898094089s) [seg_pos={0 0}, upload=124341]: Begin upload segment...
Feb 23 17:41:56.963724470 (141h25m1.898178608s) [noise=true , address=145.79.227.22:4514 , piece_id=T4FFTDMKBIVD4WW3UHDR7OO2THKQ6BTBKMZBHDULYCRIV3QPTMOQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.964806857 (141h25m1.89926098s) [seg_pos={0 0}, upload=124341]: Done begin upload segment.
Feb 23 17:41:56.964962744 (141h25m1.899416883s) [noise=true , address=145.79.227.51:4412 , piece_id=FAAGEOKHTBN4OAK7KVXQOLE2PJQBSUTV6IJMCG656CJ4WEFJU3FA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.964990880 (141h25m1.899445024s) [noise=true , address=45.91.116.5:4332 , piece_id=P72RVOC2U4PF5AIBRYY3DSFHCEAX5BHCNT3THRQBHN3LHNFMSANA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965451429 (141h25m1.899905571s) [noise=true , address=145.79.227.30:4767 , piece_id=EKJYGN57EEWKERPPZLNFSNCVXRE2H2L3DEKWQFHTFOSILW7EX7WQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965586288 (141h25m1.900040427s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965847678 (141h25m1.900301813s) [noise=true , address=145.79.227.6:4260 , piece_id=OFZI7KHTDXJVJPTTGF326U5WAKR372DMNSJLBHKLQ5KTOAOSB2XA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966118833 (141h25m1.900572974s) [noise=true , address=145.79.227.7:4297 , piece_id=HKWBOAM226AL6OM5DQF4CNUPPOKY6XC2DGN6IUVBFOWQEROGHUVQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966384902 (141h25m1.900839041s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966580263 (141h25m1.901034401s) [noise=true , address=145.79.227.47:4270 , piece_id=DJ3U7UBWMHND2GEPACZHOMOTJIZAHGAYLSVBGMCBV5PJSMHSNJCQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.967025032 (141h25m1.901479185s) [noise=true , address=145.79.227.31:4803 , piece_id=MB42IHUXM523TWBQIYTDTKEGHWXZIWCGLU6GMLQQZ7EKMOR2DYJA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.967646573 (141h25m1.902100717s) [noise=true , address=145.79.227.29:4943 , piece_id=PY7GYW5IS5MEDLHF4KBUZNTGUPKO55SOGTNBELEGJNLP3N7I3DVA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.968168297 (141h25m1.902622435s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.968721971 (141h25m1.903176112s) [noise=true , address=45.91.116.11:4120 , piece_id=AVDTFMT42T6NW3XAHV7SC4IRVN24PVW54MUJXJZ5QETMS22WKQEQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.970081793 (141h25m1.904535931s) [noise=true , address=145.79.227.28:4731 , piece_id=NP2Q53QFHVSCHCAVEP3PUDYTZDAMNIUGEZSIK3LQZ4H7A3ZNZX6Q, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.970615369 (141h25m1.905069508s) [noise=true , address=145.79.227.33:4872 , piece_id=LUNVRFWVAXHKKSPK4OZTOVDBY6F7AWND4KNALLUJL642QGPXBYKA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.971157004 (141h25m1.905611143s) [noise=true , address=145.79.227.4:4186 , piece_id=47WUSFKH2DW5FSFIX5L6O3CXZNT3A6XXIZ5FRQLWLPRNIHZXQ2MA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:57.608094655 (141h25m2.542548778s) [upload=124341]: Next returned nil segment
Feb 23 17:41:57.608112892 (141h25m2.542567029s) [upload=124341]: Waiting for error group managing segments...
Feb 23 17:41:57.742822687 (141h25m2.67727682s) [noise=true , address=145.79.227.33:4872 , piece_id=LUNVRFWVAXHKKSPK4OZTOVDBY6F7AWND4KNALLUJL642QGPXBYKA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.749456751 (141h25m2.683910874s) [noise=true , address=145.79.227.51:4412 , piece_id=FAAGEOKHTBN4OAK7KVXQOLE2PJQBSUTV6IJMCG656CJ4WEFJU3FA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.750137124 (141h25m2.684591248s) [noise=true , address=145.79.227.6:4260 , piece_id=OFZI7KHTDXJVJPTTGF326U5WAKR372DMNSJLBHKLQ5KTOAOSB2XA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.750500993 (141h25m2.68495512s) [noise=true , address=145.79.227.4:4186 , piece_id=47WUSFKH2DW5FSFIX5L6O3CXZNT3A6XXIZ5FRQLWLPRNIHZXQ2MA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.752008284 (141h25m2.686462405s) [noise=true , address=145.79.227.29:4943 , piece_id=PY7GYW5IS5MEDLHF4KBUZNTGUPKO55SOGTNBELEGJNLP3N7I3DVA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.752538019 (141h25m2.686992152s) [noise=true , address=45.91.116.11:4120 , piece_id=AVDTFMT42T6NW3XAHV7SC4IRVN24PVW54MUJXJZ5QETMS22WKQEQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.754819111 (141h25m2.689273243s) [noise=true , address=145.79.227.30:4767 , piece_id=EKJYGN57EEWKERPPZLNFSNCVXRE2H2L3DEKWQFHTFOSILW7EX7WQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.759963442 (141h25m2.694417584s) [noise=true , address=45.91.116.5:4332 , piece_id=P72RVOC2U4PF5AIBRYY3DSFHCEAX5BHCNT3THRQBHN3LHNFMSANA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.760607237 (141h25m2.695061369s) [noise=true , address=145.79.227.31:4803 , piece_id=MB42IHUXM523TWBQIYTDTKEGHWXZIWCGLU6GMLQQZ7EKMOR2DYJA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.761853193 (141h25m2.696307335s) [noise=true , address=145.79.227.7:4297 , piece_id=HKWBOAM226AL6OM5DQF4CNUPPOKY6XC2DGN6IUVBFOWQEROGHUVQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.763535570 (141h25m2.697989712s) [noise=true , address=145.79.227.22:4514 , piece_id=T4FFTDMKBIVD4WW3UHDR7OO2THKQ6BTBKMZBHDULYCRIV3QPTMOQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.764161527 (141h25m2.698615666s) [noise=true , address=145.79.227.28:4731 , piece_id=NP2Q53QFHVSCHCAVEP3PUDYTZDAMNIUGEZSIK3LQZ4H7A3ZNZX6Q, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.778254265 (141h25m2.712708402s) [noise=true , address=145.79.227.47:4270 , piece_id=DJ3U7UBWMHND2GEPACZHOMOTJIZAHGAYLSVBGMCBV5PJSMHSNJCQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.778285949 (141h25m2.712740091s) [seg_pos={0 0}, upload=124341]: Satisfied cohort requirements after 13 pieces
Feb 23 17:41:57.778570838 (141h25m2.713024981s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.778582859 (141h25m2.713036996s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.778762950 (141h25m2.713217096s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.778779349 (141h25m2.713233492s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.779144382 (141h25m2.713598526s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pvLo4F5ieDtepopg8Wi8jw6PKNeDCDvtH5iVNQXBUQwSXYxuD): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.779157428 (141h25m2.713611571s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.779216837 (141h25m2.713670959s) [seg_pos={0 0}, upload=124341]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 23 17:41:57.779392538 (141h25m2.713846681s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 23 17:41:57.779400435 (141h25m2.713854577s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 23 17:42:01.523450339 (141h25m6.457904485s) [upload=124341]: Done uploading segments...
Feb 23 17:42:01.523492869 (141h25m6.457947008s) [upload=124341]: Upload finished. err: <nil>
Duration: 2.364117441s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.07654ms remote:
"tcp:185.244.226.3:443" response headers:
X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=1896F14F1AF89D8E Date=Mon, 23 Feb 2026 17:47:05 GMT Content-Length=274 Content-Type=application/xml X-Request-Id=4Bd1pjX7LtN target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/3395818c0bc3f8a7
FAIL (2026-02-23 17:47:05 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F14F1AF89D8E</RequestId><HostId></HostId></Error>"
Duration: 11.092863ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.060321ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=1896F14EDF10EB09 X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:47:04 GMT Accept-Ranges=bytes Content-Type=application/xml Vary=Origin X-Request-Id=af7B6fzckUR target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/39a5f8063109b2d
FAIL (2026-02-23 17:47:04 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F14EDF10EB09</RequestId><HostId></HostId></Error>"
Duration: 12.089667ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
1.034744325s trace:
https://jaeger.dev.storj.io/trace/11507cad06aa5223
FAIL (2026-02-23 17:47:03 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 1.034848758s
core
uplink
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
11 out of 60 is failed (threshold=6) [...................X......................XXX.XXX...XX....XX] duration:
5.000789676s trace:
https://jaeger.dev.storj.io/trace/277ac1f95c99814d
FAIL (2026-02-23 17:46:53 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 5.000814869s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
289.272975ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Request-Id=2xaPmXuEYH6 Vary=Origin X-Amz-Request-Id=1896F14BF9303A1B X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:46:52 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/11780f9e9923915f
FAIL (2026-02-23 17:46:52 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F14BF9303A1B</RequestId><HostId></HostId></Error>"
Duration: 289.293255ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.972019ms remote:
"tcp:185.244.226.3:443" response headers:
X-Request-Id=J18oeSGKfhk X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:46:37 GMT Accept-Ranges=bytes Content-Length=274 Server=Storj Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1896F148AE870701 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/1437a2c74891905a
FAIL (2026-02-23 17:46:37 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F148AE870701</RequestId><HostId></HostId></Error>"
Duration: 9.986793ms
edge
gateway
vhost
bgp
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
10 out of 60 is failed (threshold=6) [....................X......................XXX.XXX...XX....X] duration:
5.000472652s trace:
https://jaeger.dev.storj.io/trace/3811690da55b6dfd
FAIL (2026-02-23 17:46:34 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 5.000510732s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.229823ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin Date=Mon, 23 Feb 2026 17:46:26 GMT Accept-Ranges=bytes Content-Type=application/xml X-Amz-Request-Id=1896F14613C3C6FD X-Request-Id=PqXrnErnvd1 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/6a124f2be682bdf7
FAIL (2026-02-23 17:46:26 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F14613C3C6FD</RequestId><HostId></HostId></Error>"
Duration: 7.254445ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
4.625940364s trace:
https://jaeger.dev.storj.io/trace/36e97d8015f22124
FAIL (2026-02-23 17:46:15 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Feb 23 17:41:56.004070144 (141h25m0.938524289s) [upload=124341]: Starting upload
Feb 23 17:41:56.004173173 (141h25m0.938627315s) [upload=124341]: Done starting upload
Feb 23 17:41:56.004286224 (141h25m0.93874038s) [upload=124341]: Uploading segments...
Feb 23 17:41:56.004613148 (141h25m0.93906727s) [upload=124341]: Got next segment. Inline: false
Feb 23 17:41:56.004773516 (141h25m0.93922766s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 23 17:41:56.004782051 (141h25m0.939236194s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 23 17:41:56.963639957 (141h25m1.898094089s) [seg_pos={0 0}, upload=124341]: Begin upload segment...
Feb 23 17:41:56.963724470 (141h25m1.898178608s) [noise=true , address=145.79.227.22:4514 , piece_id=T4FFTDMKBIVD4WW3UHDR7OO2THKQ6BTBKMZBHDULYCRIV3QPTMOQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.964806857 (141h25m1.89926098s) [seg_pos={0 0}, upload=124341]: Done begin upload segment.
Feb 23 17:41:56.964962744 (141h25m1.899416883s) [noise=true , address=145.79.227.51:4412 , piece_id=FAAGEOKHTBN4OAK7KVXQOLE2PJQBSUTV6IJMCG656CJ4WEFJU3FA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.964990880 (141h25m1.899445024s) [noise=true , address=45.91.116.5:4332 , piece_id=P72RVOC2U4PF5AIBRYY3DSFHCEAX5BHCNT3THRQBHN3LHNFMSANA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965451429 (141h25m1.899905571s) [noise=true , address=145.79.227.30:4767 , piece_id=EKJYGN57EEWKERPPZLNFSNCVXRE2H2L3DEKWQFHTFOSILW7EX7WQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965586288 (141h25m1.900040427s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965847678 (141h25m1.900301813s) [noise=true , address=145.79.227.6:4260 , piece_id=OFZI7KHTDXJVJPTTGF326U5WAKR372DMNSJLBHKLQ5KTOAOSB2XA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966118833 (141h25m1.900572974s) [noise=true , address=145.79.227.7:4297 , piece_id=HKWBOAM226AL6OM5DQF4CNUPPOKY6XC2DGN6IUVBFOWQEROGHUVQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966384902 (141h25m1.900839041s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966580263 (141h25m1.901034401s) [noise=true , address=145.79.227.47:4270 , piece_id=DJ3U7UBWMHND2GEPACZHOMOTJIZAHGAYLSVBGMCBV5PJSMHSNJCQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.967025032 (141h25m1.901479185s) [noise=true , address=145.79.227.31:4803 , piece_id=MB42IHUXM523TWBQIYTDTKEGHWXZIWCGLU6GMLQQZ7EKMOR2DYJA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.967646573 (141h25m1.902100717s) [noise=true , address=145.79.227.29:4943 , piece_id=PY7GYW5IS5MEDLHF4KBUZNTGUPKO55SOGTNBELEGJNLP3N7I3DVA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.968168297 (141h25m1.902622435s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.968721971 (141h25m1.903176112s) [noise=true , address=45.91.116.11:4120 , piece_id=AVDTFMT42T6NW3XAHV7SC4IRVN24PVW54MUJXJZ5QETMS22WKQEQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.970081793 (141h25m1.904535931s) [noise=true , address=145.79.227.28:4731 , piece_id=NP2Q53QFHVSCHCAVEP3PUDYTZDAMNIUGEZSIK3LQZ4H7A3ZNZX6Q, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.970615369 (141h25m1.905069508s) [noise=true , address=145.79.227.33:4872 , piece_id=LUNVRFWVAXHKKSPK4OZTOVDBY6F7AWND4KNALLUJL642QGPXBYKA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.971157004 (141h25m1.905611143s) [noise=true , address=145.79.227.4:4186 , piece_id=47WUSFKH2DW5FSFIX5L6O3CXZNT3A6XXIZ5FRQLWLPRNIHZXQ2MA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:57.608094655 (141h25m2.542548778s) [upload=124341]: Next returned nil segment
Feb 23 17:41:57.608112892 (141h25m2.542567029s) [upload=124341]: Waiting for error group managing segments...
Feb 23 17:41:57.742822687 (141h25m2.67727682s) [noise=true , address=145.79.227.33:4872 , piece_id=LUNVRFWVAXHKKSPK4OZTOVDBY6F7AWND4KNALLUJL642QGPXBYKA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.749456751 (141h25m2.683910874s) [noise=true , address=145.79.227.51:4412 , piece_id=FAAGEOKHTBN4OAK7KVXQOLE2PJQBSUTV6IJMCG656CJ4WEFJU3FA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.750137124 (141h25m2.684591248s) [noise=true , address=145.79.227.6:4260 , piece_id=OFZI7KHTDXJVJPTTGF326U5WAKR372DMNSJLBHKLQ5KTOAOSB2XA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.750500993 (141h25m2.68495512s) [noise=true , address=145.79.227.4:4186 , piece_id=47WUSFKH2DW5FSFIX5L6O3CXZNT3A6XXIZ5FRQLWLPRNIHZXQ2MA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.752008284 (141h25m2.686462405s) [noise=true , address=145.79.227.29:4943 , piece_id=PY7GYW5IS5MEDLHF4KBUZNTGUPKO55SOGTNBELEGJNLP3N7I3DVA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.752538019 (141h25m2.686992152s) [noise=true , address=45.91.116.11:4120 , piece_id=AVDTFMT42T6NW3XAHV7SC4IRVN24PVW54MUJXJZ5QETMS22WKQEQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.754819111 (141h25m2.689273243s) [noise=true , address=145.79.227.30:4767 , piece_id=EKJYGN57EEWKERPPZLNFSNCVXRE2H2L3DEKWQFHTFOSILW7EX7WQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.759963442 (141h25m2.694417584s) [noise=true , address=45.91.116.5:4332 , piece_id=P72RVOC2U4PF5AIBRYY3DSFHCEAX5BHCNT3THRQBHN3LHNFMSANA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.760607237 (141h25m2.695061369s) [noise=true , address=145.79.227.31:4803 , piece_id=MB42IHUXM523TWBQIYTDTKEGHWXZIWCGLU6GMLQQZ7EKMOR2DYJA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.761853193 (141h25m2.696307335s) [noise=true , address=145.79.227.7:4297 , piece_id=HKWBOAM226AL6OM5DQF4CNUPPOKY6XC2DGN6IUVBFOWQEROGHUVQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.763535570 (141h25m2.697989712s) [noise=true , address=145.79.227.22:4514 , piece_id=T4FFTDMKBIVD4WW3UHDR7OO2THKQ6BTBKMZBHDULYCRIV3QPTMOQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.764161527 (141h25m2.698615666s) [noise=true , address=145.79.227.28:4731 , piece_id=NP2Q53QFHVSCHCAVEP3PUDYTZDAMNIUGEZSIK3LQZ4H7A3ZNZX6Q, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.778254265 (141h25m2.712708402s) [noise=true , address=145.79.227.47:4270 , piece_id=DJ3U7UBWMHND2GEPACZHOMOTJIZAHGAYLSVBGMCBV5PJSMHSNJCQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.778285949 (141h25m2.712740091s) [seg_pos={0 0}, upload=124341]: Satisfied cohort requirements after 13 pieces
Feb 23 17:41:57.778570838 (141h25m2.713024981s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.778582859 (141h25m2.713036996s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.778762950 (141h25m2.713217096s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.778779349 (141h25m2.713233492s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.779144382 (141h25m2.713598526s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pvLo4F5ieDtepopg8Wi8jw6PKNeDCDvtH5iVNQXBUQwSXYxuD): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.779157428 (141h25m2.713611571s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.779216837 (141h25m2.713670959s) [seg_pos={0 0}, upload=124341]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 23 17:41:57.779392538 (141h25m2.713846681s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 23 17:41:57.779400435 (141h25m2.713854577s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 23 17:42:01.523450339 (141h25m6.457904485s) [upload=124341]: Done uploading segments...
Feb 23 17:42:01.523492869 (141h25m6.457947008s) [upload=124341]: Upload finished. err: <nil>
Duration: 4.625978769s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.836635ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Date=Mon, 23 Feb 2026 17:46:08 GMT Accept-Ranges=bytes Vary=Origin X-Amz-Request-Id=1896F141DAC3ED97 X-Request-Id=VwnnciXBhZD X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/7f49540ff5a4d5db
FAIL (2026-02-23 17:46:08 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F141DAC3ED97</RequestId><HostId></HostId></Error>"
Duration: 11.932059ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
3.0435956s trace:
https://jaeger.dev.storj.io/trace/11507cad06aa5223
FAIL (2026-02-23 17:46:07 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.043618325s
core
uplink
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
350.945135ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Vary=Origin X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1896F140D3B7796D X-Request-Id=RPfLuYuKe4q Date=Mon, 23 Feb 2026 17:46:04 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/4c835cad9ce8b654
FAIL (2026-02-23 17:46:04 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F140D3B7796D</RequestId><HostId></HostId></Error>"
Duration: 350.966226ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
9 out of 60 is failed (threshold=6) [.....................X......................XXX.XXX...XX....] duration:
1.55690455s trace:
https://jaeger.dev.storj.io/trace/26293704e7d2b39a
FAIL (2026-02-23 17:45:50 UTC)
orbiter warning: context deadline exceeded
Duration: 1.556932893s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.875597ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Type=application/xml Accept-Ranges=bytes Server=Storj Vary=Origin X-Amz-Request-Id=1896F13D56645862 X-Request-Id=QaDqmzhbQPP X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:45:49 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/20f7a34b4663dbf6
FAIL (2026-02-23 17:45:49 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F13D56645862</RequestId><HostId></HostId></Error>"
Duration: 8.012241ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.421899344s trace:
https://jaeger.dev.storj.io/trace/36e97d8015f22124
FAIL (2026-02-23 17:45:47 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Feb 23 17:41:56.004070144 (141h25m0.938524289s) [upload=124341]: Starting upload
Feb 23 17:41:56.004173173 (141h25m0.938627315s) [upload=124341]: Done starting upload
Feb 23 17:41:56.004286224 (141h25m0.93874038s) [upload=124341]: Uploading segments...
Feb 23 17:41:56.004613148 (141h25m0.93906727s) [upload=124341]: Got next segment. Inline: false
Feb 23 17:41:56.004773516 (141h25m0.93922766s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 23 17:41:56.004782051 (141h25m0.939236194s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 23 17:41:56.963639957 (141h25m1.898094089s) [seg_pos={0 0}, upload=124341]: Begin upload segment...
Feb 23 17:41:56.963724470 (141h25m1.898178608s) [noise=true , address=145.79.227.22:4514 , piece_id=T4FFTDMKBIVD4WW3UHDR7OO2THKQ6BTBKMZBHDULYCRIV3QPTMOQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.964806857 (141h25m1.89926098s) [seg_pos={0 0}, upload=124341]: Done begin upload segment.
Feb 23 17:41:56.964962744 (141h25m1.899416883s) [noise=true , address=145.79.227.51:4412 , piece_id=FAAGEOKHTBN4OAK7KVXQOLE2PJQBSUTV6IJMCG656CJ4WEFJU3FA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.964990880 (141h25m1.899445024s) [noise=true , address=45.91.116.5:4332 , piece_id=P72RVOC2U4PF5AIBRYY3DSFHCEAX5BHCNT3THRQBHN3LHNFMSANA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965451429 (141h25m1.899905571s) [noise=true , address=145.79.227.30:4767 , piece_id=EKJYGN57EEWKERPPZLNFSNCVXRE2H2L3DEKWQFHTFOSILW7EX7WQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965586288 (141h25m1.900040427s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965847678 (141h25m1.900301813s) [noise=true , address=145.79.227.6:4260 , piece_id=OFZI7KHTDXJVJPTTGF326U5WAKR372DMNSJLBHKLQ5KTOAOSB2XA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966118833 (141h25m1.900572974s) [noise=true , address=145.79.227.7:4297 , piece_id=HKWBOAM226AL6OM5DQF4CNUPPOKY6XC2DGN6IUVBFOWQEROGHUVQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966384902 (141h25m1.900839041s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966580263 (141h25m1.901034401s) [noise=true , address=145.79.227.47:4270 , piece_id=DJ3U7UBWMHND2GEPACZHOMOTJIZAHGAYLSVBGMCBV5PJSMHSNJCQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.967025032 (141h25m1.901479185s) [noise=true , address=145.79.227.31:4803 , piece_id=MB42IHUXM523TWBQIYTDTKEGHWXZIWCGLU6GMLQQZ7EKMOR2DYJA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.967646573 (141h25m1.902100717s) [noise=true , address=145.79.227.29:4943 , piece_id=PY7GYW5IS5MEDLHF4KBUZNTGUPKO55SOGTNBELEGJNLP3N7I3DVA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.968168297 (141h25m1.902622435s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.968721971 (141h25m1.903176112s) [noise=true , address=45.91.116.11:4120 , piece_id=AVDTFMT42T6NW3XAHV7SC4IRVN24PVW54MUJXJZ5QETMS22WKQEQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.970081793 (141h25m1.904535931s) [noise=true , address=145.79.227.28:4731 , piece_id=NP2Q53QFHVSCHCAVEP3PUDYTZDAMNIUGEZSIK3LQZ4H7A3ZNZX6Q, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.970615369 (141h25m1.905069508s) [noise=true , address=145.79.227.33:4872 , piece_id=LUNVRFWVAXHKKSPK4OZTOVDBY6F7AWND4KNALLUJL642QGPXBYKA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.971157004 (141h25m1.905611143s) [noise=true , address=145.79.227.4:4186 , piece_id=47WUSFKH2DW5FSFIX5L6O3CXZNT3A6XXIZ5FRQLWLPRNIHZXQ2MA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:57.608094655 (141h25m2.542548778s) [upload=124341]: Next returned nil segment
Feb 23 17:41:57.608112892 (141h25m2.542567029s) [upload=124341]: Waiting for error group managing segments...
Feb 23 17:41:57.742822687 (141h25m2.67727682s) [noise=true , address=145.79.227.33:4872 , piece_id=LUNVRFWVAXHKKSPK4OZTOVDBY6F7AWND4KNALLUJL642QGPXBYKA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.749456751 (141h25m2.683910874s) [noise=true , address=145.79.227.51:4412 , piece_id=FAAGEOKHTBN4OAK7KVXQOLE2PJQBSUTV6IJMCG656CJ4WEFJU3FA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.750137124 (141h25m2.684591248s) [noise=true , address=145.79.227.6:4260 , piece_id=OFZI7KHTDXJVJPTTGF326U5WAKR372DMNSJLBHKLQ5KTOAOSB2XA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.750500993 (141h25m2.68495512s) [noise=true , address=145.79.227.4:4186 , piece_id=47WUSFKH2DW5FSFIX5L6O3CXZNT3A6XXIZ5FRQLWLPRNIHZXQ2MA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.752008284 (141h25m2.686462405s) [noise=true , address=145.79.227.29:4943 , piece_id=PY7GYW5IS5MEDLHF4KBUZNTGUPKO55SOGTNBELEGJNLP3N7I3DVA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.752538019 (141h25m2.686992152s) [noise=true , address=45.91.116.11:4120 , piece_id=AVDTFMT42T6NW3XAHV7SC4IRVN24PVW54MUJXJZ5QETMS22WKQEQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.754819111 (141h25m2.689273243s) [noise=true , address=145.79.227.30:4767 , piece_id=EKJYGN57EEWKERPPZLNFSNCVXRE2H2L3DEKWQFHTFOSILW7EX7WQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.759963442 (141h25m2.694417584s) [noise=true , address=45.91.116.5:4332 , piece_id=P72RVOC2U4PF5AIBRYY3DSFHCEAX5BHCNT3THRQBHN3LHNFMSANA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.760607237 (141h25m2.695061369s) [noise=true , address=145.79.227.31:4803 , piece_id=MB42IHUXM523TWBQIYTDTKEGHWXZIWCGLU6GMLQQZ7EKMOR2DYJA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.761853193 (141h25m2.696307335s) [noise=true , address=145.79.227.7:4297 , piece_id=HKWBOAM226AL6OM5DQF4CNUPPOKY6XC2DGN6IUVBFOWQEROGHUVQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.763535570 (141h25m2.697989712s) [noise=true , address=145.79.227.22:4514 , piece_id=T4FFTDMKBIVD4WW3UHDR7OO2THKQ6BTBKMZBHDULYCRIV3QPTMOQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.764161527 (141h25m2.698615666s) [noise=true , address=145.79.227.28:4731 , piece_id=NP2Q53QFHVSCHCAVEP3PUDYTZDAMNIUGEZSIK3LQZ4H7A3ZNZX6Q, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.778254265 (141h25m2.712708402s) [noise=true , address=145.79.227.47:4270 , piece_id=DJ3U7UBWMHND2GEPACZHOMOTJIZAHGAYLSVBGMCBV5PJSMHSNJCQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.778285949 (141h25m2.712740091s) [seg_pos={0 0}, upload=124341]: Satisfied cohort requirements after 13 pieces
Feb 23 17:41:57.778570838 (141h25m2.713024981s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.778582859 (141h25m2.713036996s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.778762950 (141h25m2.713217096s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.778779349 (141h25m2.713233492s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.779144382 (141h25m2.713598526s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pvLo4F5ieDtepopg8Wi8jw6PKNeDCDvtH5iVNQXBUQwSXYxuD): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.779157428 (141h25m2.713611571s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.779216837 (141h25m2.713670959s) [seg_pos={0 0}, upload=124341]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 23 17:41:57.779392538 (141h25m2.713846681s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 23 17:41:57.779400435 (141h25m2.713854577s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 23 17:42:01.523450339 (141h25m6.457904485s) [upload=124341]: Done uploading segments...
Feb 23 17:42:01.523492869 (141h25m6.457947008s) [upload=124341]: Upload finished. err: <nil>
Duration: 2.421928615s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.756453ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Server=Storj X-Amz-Request-Id=1896F139ED10F03D Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Request-Id=frjPzfdpBaw X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:45:34 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/3b19b26310feca5c
FAIL (2026-02-23 17:45:34 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F139ED10F03D</RequestId><HostId></HostId></Error>"
Duration: 8.853114ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.883044ms remote:
"tcp:185.244.226.3:443" response headers:
X-Amz-Request-Id=1896F13887BFD3FB X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:45:28 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=YNWH55VzH3v Content-Length=274 Content-Type=application/xml Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/68318484cf9091bd
FAIL (2026-02-23 17:45:28 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F13887BFD3FB</RequestId><HostId></HostId></Error>"
Duration: 7.906432ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.353222707s trace:
https://jaeger.dev.storj.io/trace/36e97d8015f22124
FAIL (2026-02-23 17:45:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Feb 23 17:41:56.004070144 (141h25m0.938524289s) [upload=124341]: Starting upload
Feb 23 17:41:56.004173173 (141h25m0.938627315s) [upload=124341]: Done starting upload
Feb 23 17:41:56.004286224 (141h25m0.93874038s) [upload=124341]: Uploading segments...
Feb 23 17:41:56.004613148 (141h25m0.93906727s) [upload=124341]: Got next segment. Inline: false
Feb 23 17:41:56.004773516 (141h25m0.93922766s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 23 17:41:56.004782051 (141h25m0.939236194s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 23 17:41:56.963639957 (141h25m1.898094089s) [seg_pos={0 0}, upload=124341]: Begin upload segment...
Feb 23 17:41:56.963724470 (141h25m1.898178608s) [noise=true , address=145.79.227.22:4514 , piece_id=T4FFTDMKBIVD4WW3UHDR7OO2THKQ6BTBKMZBHDULYCRIV3QPTMOQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.964806857 (141h25m1.89926098s) [seg_pos={0 0}, upload=124341]: Done begin upload segment.
Feb 23 17:41:56.964962744 (141h25m1.899416883s) [noise=true , address=145.79.227.51:4412 , piece_id=FAAGEOKHTBN4OAK7KVXQOLE2PJQBSUTV6IJMCG656CJ4WEFJU3FA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.964990880 (141h25m1.899445024s) [noise=true , address=45.91.116.5:4332 , piece_id=P72RVOC2U4PF5AIBRYY3DSFHCEAX5BHCNT3THRQBHN3LHNFMSANA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965451429 (141h25m1.899905571s) [noise=true , address=145.79.227.30:4767 , piece_id=EKJYGN57EEWKERPPZLNFSNCVXRE2H2L3DEKWQFHTFOSILW7EX7WQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965586288 (141h25m1.900040427s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965847678 (141h25m1.900301813s) [noise=true , address=145.79.227.6:4260 , piece_id=OFZI7KHTDXJVJPTTGF326U5WAKR372DMNSJLBHKLQ5KTOAOSB2XA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966118833 (141h25m1.900572974s) [noise=true , address=145.79.227.7:4297 , piece_id=HKWBOAM226AL6OM5DQF4CNUPPOKY6XC2DGN6IUVBFOWQEROGHUVQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966384902 (141h25m1.900839041s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966580263 (141h25m1.901034401s) [noise=true , address=145.79.227.47:4270 , piece_id=DJ3U7UBWMHND2GEPACZHOMOTJIZAHGAYLSVBGMCBV5PJSMHSNJCQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.967025032 (141h25m1.901479185s) [noise=true , address=145.79.227.31:4803 , piece_id=MB42IHUXM523TWBQIYTDTKEGHWXZIWCGLU6GMLQQZ7EKMOR2DYJA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.967646573 (141h25m1.902100717s) [noise=true , address=145.79.227.29:4943 , piece_id=PY7GYW5IS5MEDLHF4KBUZNTGUPKO55SOGTNBELEGJNLP3N7I3DVA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.968168297 (141h25m1.902622435s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.968721971 (141h25m1.903176112s) [noise=true , address=45.91.116.11:4120 , piece_id=AVDTFMT42T6NW3XAHV7SC4IRVN24PVW54MUJXJZ5QETMS22WKQEQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.970081793 (141h25m1.904535931s) [noise=true , address=145.79.227.28:4731 , piece_id=NP2Q53QFHVSCHCAVEP3PUDYTZDAMNIUGEZSIK3LQZ4H7A3ZNZX6Q, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.970615369 (141h25m1.905069508s) [noise=true , address=145.79.227.33:4872 , piece_id=LUNVRFWVAXHKKSPK4OZTOVDBY6F7AWND4KNALLUJL642QGPXBYKA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.971157004 (141h25m1.905611143s) [noise=true , address=145.79.227.4:4186 , piece_id=47WUSFKH2DW5FSFIX5L6O3CXZNT3A6XXIZ5FRQLWLPRNIHZXQ2MA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:57.608094655 (141h25m2.542548778s) [upload=124341]: Next returned nil segment
Feb 23 17:41:57.608112892 (141h25m2.542567029s) [upload=124341]: Waiting for error group managing segments...
Feb 23 17:41:57.742822687 (141h25m2.67727682s) [noise=true , address=145.79.227.33:4872 , piece_id=LUNVRFWVAXHKKSPK4OZTOVDBY6F7AWND4KNALLUJL642QGPXBYKA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.749456751 (141h25m2.683910874s) [noise=true , address=145.79.227.51:4412 , piece_id=FAAGEOKHTBN4OAK7KVXQOLE2PJQBSUTV6IJMCG656CJ4WEFJU3FA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.750137124 (141h25m2.684591248s) [noise=true , address=145.79.227.6:4260 , piece_id=OFZI7KHTDXJVJPTTGF326U5WAKR372DMNSJLBHKLQ5KTOAOSB2XA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.750500993 (141h25m2.68495512s) [noise=true , address=145.79.227.4:4186 , piece_id=47WUSFKH2DW5FSFIX5L6O3CXZNT3A6XXIZ5FRQLWLPRNIHZXQ2MA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.752008284 (141h25m2.686462405s) [noise=true , address=145.79.227.29:4943 , piece_id=PY7GYW5IS5MEDLHF4KBUZNTGUPKO55SOGTNBELEGJNLP3N7I3DVA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.752538019 (141h25m2.686992152s) [noise=true , address=45.91.116.11:4120 , piece_id=AVDTFMT42T6NW3XAHV7SC4IRVN24PVW54MUJXJZ5QETMS22WKQEQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.754819111 (141h25m2.689273243s) [noise=true , address=145.79.227.30:4767 , piece_id=EKJYGN57EEWKERPPZLNFSNCVXRE2H2L3DEKWQFHTFOSILW7EX7WQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.759963442 (141h25m2.694417584s) [noise=true , address=45.91.116.5:4332 , piece_id=P72RVOC2U4PF5AIBRYY3DSFHCEAX5BHCNT3THRQBHN3LHNFMSANA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.760607237 (141h25m2.695061369s) [noise=true , address=145.79.227.31:4803 , piece_id=MB42IHUXM523TWBQIYTDTKEGHWXZIWCGLU6GMLQQZ7EKMOR2DYJA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.761853193 (141h25m2.696307335s) [noise=true , address=145.79.227.7:4297 , piece_id=HKWBOAM226AL6OM5DQF4CNUPPOKY6XC2DGN6IUVBFOWQEROGHUVQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.763535570 (141h25m2.697989712s) [noise=true , address=145.79.227.22:4514 , piece_id=T4FFTDMKBIVD4WW3UHDR7OO2THKQ6BTBKMZBHDULYCRIV3QPTMOQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.764161527 (141h25m2.698615666s) [noise=true , address=145.79.227.28:4731 , piece_id=NP2Q53QFHVSCHCAVEP3PUDYTZDAMNIUGEZSIK3LQZ4H7A3ZNZX6Q, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.778254265 (141h25m2.712708402s) [noise=true , address=145.79.227.47:4270 , piece_id=DJ3U7UBWMHND2GEPACZHOMOTJIZAHGAYLSVBGMCBV5PJSMHSNJCQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.778285949 (141h25m2.712740091s) [seg_pos={0 0}, upload=124341]: Satisfied cohort requirements after 13 pieces
Feb 23 17:41:57.778570838 (141h25m2.713024981s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.778582859 (141h25m2.713036996s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.778762950 (141h25m2.713217096s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.778779349 (141h25m2.713233492s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.779144382 (141h25m2.713598526s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pvLo4F5ieDtepopg8Wi8jw6PKNeDCDvtH5iVNQXBUQwSXYxuD): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.779157428 (141h25m2.713611571s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.779216837 (141h25m2.713670959s) [seg_pos={0 0}, upload=124341]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 23 17:41:57.779392538 (141h25m2.713846681s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 23 17:41:57.779400435 (141h25m2.713854577s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 23 17:42:01.523450339 (141h25m6.457904485s) [upload=124341]: Done uploading segments...
Feb 23 17:42:01.523492869 (141h25m6.457947008s) [upload=124341]: Upload finished. err: <nil>
Duration: 2.353245675s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
307.819365ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1896F13597480E3F X-Xss-Protection=1; mode=block Accept-Ranges=bytes Server=Storj X-Request-Id=MpYqDEwYKaC Date=Mon, 23 Feb 2026 17:45:15 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/7d30f80fcdc1f90b
FAIL (2026-02-23 17:45:15 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F13597480E3F</RequestId><HostId></HostId></Error>"
Duration: 307.841118ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
9 out of 60 is failed (threshold=6) [......................X......................XXX.XXX...XX...] duration:
3.603112882s trace:
https://jaeger.dev.storj.io/trace/26293704e7d2b39a
FAIL (2026-02-23 17:45:14 UTC)
orbiter warning: context deadline exceeded
Duration: 3.603189755s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.127825ms remote:
"tcp:185.244.226.3:443" response headers:
Date=Mon, 23 Feb 2026 17:45:07 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Request-Id=TE8UUYs2HrE X-Xss-Protection=1; mode=block Content-Length=274 Vary=Origin X-Amz-Request-Id=1896F133BB9DE4CF target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/7816eeecd6fac859
FAIL (2026-02-23 17:45:07 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F133BB9DE4CF</RequestId><HostId></HostId></Error>"
Duration: 11.154813ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
902.043834ms trace:
https://jaeger.dev.storj.io/trace/11507cad06aa5223
FAIL (2026-02-23 17:44:52 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 902.07029ms
core
uplink
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.655655ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Type=application/xml Content-Length=274 Server=Storj Vary=Origin X-Amz-Request-Id=1896F12DD22C689D X-Request-Id=aFUpc7xeT7C X-Xss-Protection=1; mode=block Date=Mon, 23 Feb 2026 17:44:42 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/3378e41ac2887a6e
FAIL (2026-02-23 17:44:42 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F12DD22C689D</RequestId><HostId></HostId></Error>"
Duration: 7.679099ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.424758375s trace:
https://jaeger.dev.storj.io/trace/36e97d8015f22124
FAIL (2026-02-23 17:44:40 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
Feb 23 17:41:56.004070144 (141h25m0.938524289s) [upload=124341]: Starting upload
Feb 23 17:41:56.004173173 (141h25m0.938627315s) [upload=124341]: Done starting upload
Feb 23 17:41:56.004286224 (141h25m0.93874038s) [upload=124341]: Uploading segments...
Feb 23 17:41:56.004613148 (141h25m0.93906727s) [upload=124341]: Got next segment. Inline: false
Feb 23 17:41:56.004773516 (141h25m0.93922766s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 23 17:41:56.004782051 (141h25m0.939236194s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 23 17:41:56.963639957 (141h25m1.898094089s) [seg_pos={0 0}, upload=124341]: Begin upload segment...
Feb 23 17:41:56.963724470 (141h25m1.898178608s) [noise=true , address=145.79.227.22:4514 , piece_id=T4FFTDMKBIVD4WW3UHDR7OO2THKQ6BTBKMZBHDULYCRIV3QPTMOQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.964806857 (141h25m1.89926098s) [seg_pos={0 0}, upload=124341]: Done begin upload segment.
Feb 23 17:41:56.964962744 (141h25m1.899416883s) [noise=true , address=145.79.227.51:4412 , piece_id=FAAGEOKHTBN4OAK7KVXQOLE2PJQBSUTV6IJMCG656CJ4WEFJU3FA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.964990880 (141h25m1.899445024s) [noise=true , address=45.91.116.5:4332 , piece_id=P72RVOC2U4PF5AIBRYY3DSFHCEAX5BHCNT3THRQBHN3LHNFMSANA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965451429 (141h25m1.899905571s) [noise=true , address=145.79.227.30:4767 , piece_id=EKJYGN57EEWKERPPZLNFSNCVXRE2H2L3DEKWQFHTFOSILW7EX7WQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965586288 (141h25m1.900040427s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.965847678 (141h25m1.900301813s) [noise=true , address=145.79.227.6:4260 , piece_id=OFZI7KHTDXJVJPTTGF326U5WAKR372DMNSJLBHKLQ5KTOAOSB2XA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966118833 (141h25m1.900572974s) [noise=true , address=145.79.227.7:4297 , piece_id=HKWBOAM226AL6OM5DQF4CNUPPOKY6XC2DGN6IUVBFOWQEROGHUVQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966384902 (141h25m1.900839041s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.966580263 (141h25m1.901034401s) [noise=true , address=145.79.227.47:4270 , piece_id=DJ3U7UBWMHND2GEPACZHOMOTJIZAHGAYLSVBGMCBV5PJSMHSNJCQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.967025032 (141h25m1.901479185s) [noise=true , address=145.79.227.31:4803 , piece_id=MB42IHUXM523TWBQIYTDTKEGHWXZIWCGLU6GMLQQZ7EKMOR2DYJA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.967646573 (141h25m1.902100717s) [noise=true , address=145.79.227.29:4943 , piece_id=PY7GYW5IS5MEDLHF4KBUZNTGUPKO55SOGTNBELEGJNLP3N7I3DVA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.968168297 (141h25m1.902622435s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.968721971 (141h25m1.903176112s) [noise=true , address=45.91.116.11:4120 , piece_id=AVDTFMT42T6NW3XAHV7SC4IRVN24PVW54MUJXJZ5QETMS22WKQEQ, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.970081793 (141h25m1.904535931s) [noise=true , address=145.79.227.28:4731 , piece_id=NP2Q53QFHVSCHCAVEP3PUDYTZDAMNIUGEZSIK3LQZ4H7A3ZNZX6Q, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.970615369 (141h25m1.905069508s) [noise=true , address=145.79.227.33:4872 , piece_id=LUNVRFWVAXHKKSPK4OZTOVDBY6F7AWND4KNALLUJL642QGPXBYKA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:56.971157004 (141h25m1.905611143s) [noise=true , address=145.79.227.4:4186 , piece_id=47WUSFKH2DW5FSFIX5L6O3CXZNT3A6XXIZ5FRQLWLPRNIHZXQ2MA, seg_pos={0 0}, upload=124341]: Uploading piece...
Feb 23 17:41:57.608094655 (141h25m2.542548778s) [upload=124341]: Next returned nil segment
Feb 23 17:41:57.608112892 (141h25m2.542567029s) [upload=124341]: Waiting for error group managing segments...
Feb 23 17:41:57.742822687 (141h25m2.67727682s) [noise=true , address=145.79.227.33:4872 , piece_id=LUNVRFWVAXHKKSPK4OZTOVDBY6F7AWND4KNALLUJL642QGPXBYKA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.749456751 (141h25m2.683910874s) [noise=true , address=145.79.227.51:4412 , piece_id=FAAGEOKHTBN4OAK7KVXQOLE2PJQBSUTV6IJMCG656CJ4WEFJU3FA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.750137124 (141h25m2.684591248s) [noise=true , address=145.79.227.6:4260 , piece_id=OFZI7KHTDXJVJPTTGF326U5WAKR372DMNSJLBHKLQ5KTOAOSB2XA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.750500993 (141h25m2.68495512s) [noise=true , address=145.79.227.4:4186 , piece_id=47WUSFKH2DW5FSFIX5L6O3CXZNT3A6XXIZ5FRQLWLPRNIHZXQ2MA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.752008284 (141h25m2.686462405s) [noise=true , address=145.79.227.29:4943 , piece_id=PY7GYW5IS5MEDLHF4KBUZNTGUPKO55SOGTNBELEGJNLP3N7I3DVA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.752538019 (141h25m2.686992152s) [noise=true , address=45.91.116.11:4120 , piece_id=AVDTFMT42T6NW3XAHV7SC4IRVN24PVW54MUJXJZ5QETMS22WKQEQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.754819111 (141h25m2.689273243s) [noise=true , address=145.79.227.30:4767 , piece_id=EKJYGN57EEWKERPPZLNFSNCVXRE2H2L3DEKWQFHTFOSILW7EX7WQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.759963442 (141h25m2.694417584s) [noise=true , address=45.91.116.5:4332 , piece_id=P72RVOC2U4PF5AIBRYY3DSFHCEAX5BHCNT3THRQBHN3LHNFMSANA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.760607237 (141h25m2.695061369s) [noise=true , address=145.79.227.31:4803 , piece_id=MB42IHUXM523TWBQIYTDTKEGHWXZIWCGLU6GMLQQZ7EKMOR2DYJA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.761853193 (141h25m2.696307335s) [noise=true , address=145.79.227.7:4297 , piece_id=HKWBOAM226AL6OM5DQF4CNUPPOKY6XC2DGN6IUVBFOWQEROGHUVQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.763535570 (141h25m2.697989712s) [noise=true , address=145.79.227.22:4514 , piece_id=T4FFTDMKBIVD4WW3UHDR7OO2THKQ6BTBKMZBHDULYCRIV3QPTMOQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.764161527 (141h25m2.698615666s) [noise=true , address=145.79.227.28:4731 , piece_id=NP2Q53QFHVSCHCAVEP3PUDYTZDAMNIUGEZSIK3LQZ4H7A3ZNZX6Q, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.778254265 (141h25m2.712708402s) [noise=true , address=145.79.227.47:4270 , piece_id=DJ3U7UBWMHND2GEPACZHOMOTJIZAHGAYLSVBGMCBV5PJSMHSNJCQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: <nil>
Feb 23 17:41:57.778285949 (141h25m2.712740091s) [seg_pos={0 0}, upload=124341]: Satisfied cohort requirements after 13 pieces
Feb 23 17:41:57.778570838 (141h25m2.713024981s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.778582859 (141h25m2.713036996s) [noise=true , address=77.90.31.18:4808 , piece_id=RMEGCBZU2FWR7YBLS4DHGWYGKTDIVR53D6XKCLMXLJQKPMD3ZKEA, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.778762950 (141h25m2.713217096s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.778779349 (141h25m2.713233492s) [noise=true , address=145.79.227.42:4121 , piece_id=CDZ3T627OOQ2TLXABKEWGZ7DPRAXXB4IVOBLH3PMRXKQIJ737VEQ, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.779144382 (141h25m2.713598526s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pvLo4F5ieDtepopg8Wi8jw6PKNeDCDvtH5iVNQXBUQwSXYxuD): protocol: expected piece hash; context canceled; EOF
Feb 23 17:41:57.779157428 (141h25m2.713611571s) [noise=true , address=79.127.219.41:4928 , piece_id=HEIAL4K5IQG6VY7KTXGN6A2PU66HY3KZT5Z44U3IE67R6AJK56RA, seg_pos={0 0}, upload=124341]: Long tail cancellation due to optimal threshold
Feb 23 17:41:57.779216837 (141h25m2.713670959s) [seg_pos={0 0}, upload=124341]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 23 17:41:57.779392538 (141h25m2.713846681s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 23 17:41:57.779400435 (141h25m2.713854577s) [upload=124341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 23 17:42:01.523450339 (141h25m6.457904485s) [upload=124341]: Done uploading segments...
Feb 23 17:42:01.523492869 (141h25m6.457947008s) [upload=124341]: Upload finished. err: <nil>
Duration: 2.424786613s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.405645ms remote:
"tcp:185.244.226.3:443" response headers:
X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin Date=Mon, 23 Feb 2026 17:44:32 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml X-Amz-Request-Id=1896F12B70A1C6AB X-Request-Id=KmdA4AseGQN target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/62b0eb198c8a5645
FAIL (2026-02-23 17:44:32 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896F12B70A1C6AB</RequestId><HostId></HostId></Error>"
Duration: 9.505399ms
edge
gateway
vhost
bgp
eu1
|