Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.488594ms remote:
"tcp:185.244.226.3:443" response headers:
X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 06:23:05 GMT Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Request-Id=PgyfnnY6oj6 Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18976924E6DEE1AE target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/27df93aa78439d35
FAIL (2026-02-25 06:23:05 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18976924E6DEE1AE</RequestId><HostId></HostId></Error>"
Duration: 8.578477ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.700326ms remote:
"tcp:185.244.226.3:443" response headers:
Vary=Origin X-Amz-Request-Id=189769229946B54E X-Request-Id=D6EC82NxED Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 06:22:55 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/13e94194ea00a845
FAIL (2026-02-25 06:22:55 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189769229946B54E</RequestId><HostId></HostId></Error>"
Duration: 8.728513ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
307.214987ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Content-Security-Policy=block-all-mixed-content Date=Wed, 25 Feb 2026 06:22:43 GMT Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1897691FB00C9AB8 X-Request-Id=iqsMbS4F2nY X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/d35e74d51ae7995
FAIL (2026-02-25 06:22:43 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897691FB00C9AB8</RequestId><HostId></HostId></Error>"
Duration: 307.234981ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.337695611s trace:
https://jaeger.dev.storj.io/trace/6ba9cdd284c47f35
FAIL (2026-02-25 06:22:42 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Feb 25 05:42:48.492442491 (177h25m53.426896628s) [upload=155983]: Starting upload
Feb 25 05:42:48.492518689 (177h25m53.426972832s) [upload=155983]: Done starting upload
Feb 25 05:42:48.492850092 (177h25m53.427304211s) [upload=155983]: Uploading segments...
Feb 25 05:42:48.492982003 (177h25m53.427436149s) [upload=155983]: Got next segment. Inline: false
Feb 25 05:42:48.493030398 (177h25m53.427484531s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 25 05:42:48.493036271 (177h25m53.427490407s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 25 05:42:48.609378120 (177h25m53.543832252s) [seg_pos={0 0}, upload=155983]: Begin upload segment...
Feb 25 05:42:48.609500106 (177h25m53.543954282s) [noise=true , address=145.79.227.8:4330 , piece_id=5G3NFIJXYPK2BRZCO34FXIIUFQISLNZMF5GE6LYHXPOOTKVK7P4A, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.610216204 (177h25m53.544670348s) [noise=true , address=145.79.227.5:4224 , piece_id=SW7UZB267DX7PPJUSFD2OQERUDEQZSZJAHMLO3LDWZVNK4IF6KXQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.610682046 (177h25m53.545136182s) [noise=true , address=145.79.227.6:4260 , piece_id=KJ4JM2DPHDFAWJDW5QZGSYOGYOWFSJUDXYWPUZKZWEV3QIOIKEVQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611116131 (177h25m53.54557027s) [noise=true , address=145.79.227.50:4375 , piece_id=5HSR37ZLO3NTMTKBLOWC2ABNQHKE25VMS6HLZ2CMUUPE5QIGZQGA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611447353 (177h25m53.545901491s) [noise=true , address=145.79.227.20:4441 , piece_id=2BQMK2SV7WRW6CHOWQP3TTFDF2WMAWLLRE2JLRK23GGICXIFWPWQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611732463 (177h25m53.546186603s) [noise=true , address=145.79.227.35:4484 , piece_id=2KD6WZKUY6FRKRVSMZAQZPVNEX2IQUWORJP5JDFEDEGBTR57VHRQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.612359029 (177h25m53.546813169s) [seg_pos={0 0}, upload=155983]: Done begin upload segment.
Feb 25 05:42:48.612421514 (177h25m53.546875657s) [noise=true , address=45.91.116.12:4227 , piece_id=Z3CRDHRB6JI5UORE5SK67DUOFHS7XMMH6BI3BCFW2NPZ5LQH6NPA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613054414 (177h25m53.547508553s) [noise=true , address=45.91.116.9:4265 , piece_id=5X4OLVB2N2KF2FGLZDKITYNOTQJNZL6FOTIAXSQHDH6LBYLFXTZQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613355998 (177h25m53.547810141s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613532091 (177h25m53.547986232s) [noise=true , address=145.79.227.18:4006 , piece_id=DS5EW7KKKU5CU5O7VYQRRDXCEWGI4Y3Y2Z25QN4HHAVBQYOCKOZQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613794842 (177h25m53.54824898s) [noise=true , address=45.91.116.10:4081 , piece_id=3WSJADPR2XXP4CVQETVEN5YHFLLNW6YUID7LNXUZ2XBABSVHHIAA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613829958 (177h25m53.548284096s) [noise=true , address=145.79.227.27:4693 , piece_id=PN7EPCO4RNEAS3NJSUBCZO2J6V7M4NGC4SPM2GPLMRU47V3WUURA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614174057 (177h25m53.548628196s) [noise=true , address=145.79.227.9:4369 , piece_id=PMJ4E2UO7Q5GWSKOYS2GVNH5OS2TIUHQ5VLDHNSETJMZJTUOKWGA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614745799 (177h25m53.549199935s) [noise=true , address=145.79.227.47:4269 , piece_id=E4MZNWLH5OKXYWRSOPRVXIIIENKTJUZS7OMAF7EHA4X66AZ6MAIQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614781600 (177h25m53.549235737s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.615598548 (177h25m53.55005269s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:49.219849344 (177h25m54.154303478s) [upload=155983]: Next returned nil segment
Feb 25 05:42:49.219863932 (177h25m54.154318065s) [upload=155983]: Waiting for error group managing segments...
Feb 25 05:42:49.355130909 (177h25m54.289585042s) [noise=true , address=45.91.116.9:4265 , piece_id=5X4OLVB2N2KF2FGLZDKITYNOTQJNZL6FOTIAXSQHDH6LBYLFXTZQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.355538432 (177h25m54.289992565s) [noise=true , address=45.91.116.12:4227 , piece_id=Z3CRDHRB6JI5UORE5SK67DUOFHS7XMMH6BI3BCFW2NPZ5LQH6NPA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.356496709 (177h25m54.290950841s) [noise=true , address=145.79.227.8:4330 , piece_id=5G3NFIJXYPK2BRZCO34FXIIUFQISLNZMF5GE6LYHXPOOTKVK7P4A, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.357623689 (177h25m54.29207782s) [noise=true , address=145.79.227.9:4369 , piece_id=PMJ4E2UO7Q5GWSKOYS2GVNH5OS2TIUHQ5VLDHNSETJMZJTUOKWGA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.358496015 (177h25m54.292950148s) [noise=true , address=145.79.227.47:4269 , piece_id=E4MZNWLH5OKXYWRSOPRVXIIIENKTJUZS7OMAF7EHA4X66AZ6MAIQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.359168638 (177h25m54.293622769s) [noise=true , address=145.79.227.27:4693 , piece_id=PN7EPCO4RNEAS3NJSUBCZO2J6V7M4NGC4SPM2GPLMRU47V3WUURA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.360018880 (177h25m54.294473013s) [noise=true , address=145.79.227.35:4484 , piece_id=2KD6WZKUY6FRKRVSMZAQZPVNEX2IQUWORJP5JDFEDEGBTR57VHRQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.362336397 (177h25m54.296790529s) [noise=true , address=145.79.227.20:4441 , piece_id=2BQMK2SV7WRW6CHOWQP3TTFDF2WMAWLLRE2JLRK23GGICXIFWPWQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.367837052 (177h25m54.302291185s) [noise=true , address=145.79.227.18:4006 , piece_id=DS5EW7KKKU5CU5O7VYQRRDXCEWGI4Y3Y2Z25QN4HHAVBQYOCKOZQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370090577 (177h25m54.304544716s) [noise=true , address=45.91.116.10:4081 , piece_id=3WSJADPR2XXP4CVQETVEN5YHFLLNW6YUID7LNXUZ2XBABSVHHIAA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370196164 (177h25m54.304650305s) [noise=true , address=145.79.227.5:4224 , piece_id=SW7UZB267DX7PPJUSFD2OQERUDEQZSZJAHMLO3LDWZVNK4IF6KXQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370933003 (177h25m54.305387143s) [noise=true , address=145.79.227.6:4260 , piece_id=KJ4JM2DPHDFAWJDW5QZGSYOGYOWFSJUDXYWPUZKZWEV3QIOIKEVQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.376133367 (177h25m54.310587499s) [noise=true , address=145.79.227.50:4375 , piece_id=5HSR37ZLO3NTMTKBLOWC2ABNQHKE25VMS6HLZ2CMUUPE5QIGZQGA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.376157312 (177h25m54.310611447s) [seg_pos={0 0}, upload=155983]: Satisfied cohort requirements after 13 pieces
Feb 25 05:42:49.376426106 (177h25m54.310880247s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376438581 (177h25m54.310892718s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376449477 (177h25m54.310903618s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G13M5QwzW2uRcXeNnFWFPkyHj5xSkReGmqrNheT16fUKZwsp3): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376461110 (177h25m54.310915243s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376688720 (177h25m54.311142862s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ULUPKjJwZocjV1R6Dy7vmWSrZ4hKx3YAHLAihgtMKf8Uw2UgA): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376702626 (177h25m54.311156768s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376740965 (177h25m54.3111951s) [seg_pos={0 0}, upload=155983]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 25 05:42:49.376835784 (177h25m54.311289916s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 25 05:42:49.376841584 (177h25m54.311295716s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 25 05:42:49.521783892 (177h25m54.456238024s) [upload=155983]: Done uploading segments...
Feb 25 05:42:49.521820652 (177h25m54.456274791s) [upload=155983]: Upload finished. err: <nil>
Duration: 2.337724295s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.751434ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Amz-Request-Id=1897691D2D6EC608 Date=Wed, 25 Feb 2026 06:22:32 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=F2FJ5cijTzo X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/67cd588361df4246
FAIL (2026-02-25 06:22:32 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897691D2D6EC608</RequestId><HostId></HostId></Error>"
Duration: 11.779076ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.676323ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml X-Amz-Request-Id=1897691D43065045 Date=Wed, 25 Feb 2026 06:22:32 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Request-Id=7R3qH6ihwBB X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/694c38dd906e1e4d
FAIL (2026-02-25 06:22:32 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897691D43065045</RequestId><HostId></HostId></Error>"
Duration: 7.705808ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.931452ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 06:22:10 GMT Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=189769180AEB4576 X-Request-Id=dHVZ6G5Pnue target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/1042d69e212d9089
FAIL (2026-02-25 06:22:10 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189769180AEB4576</RequestId><HostId></HostId></Error>"
Duration: 8.019727ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.417948157s trace:
https://jaeger.dev.storj.io/trace/6ba9cdd284c47f35
FAIL (2026-02-25 06:22:06 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Feb 25 05:42:48.492442491 (177h25m53.426896628s) [upload=155983]: Starting upload
Feb 25 05:42:48.492518689 (177h25m53.426972832s) [upload=155983]: Done starting upload
Feb 25 05:42:48.492850092 (177h25m53.427304211s) [upload=155983]: Uploading segments...
Feb 25 05:42:48.492982003 (177h25m53.427436149s) [upload=155983]: Got next segment. Inline: false
Feb 25 05:42:48.493030398 (177h25m53.427484531s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 25 05:42:48.493036271 (177h25m53.427490407s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 25 05:42:48.609378120 (177h25m53.543832252s) [seg_pos={0 0}, upload=155983]: Begin upload segment...
Feb 25 05:42:48.609500106 (177h25m53.543954282s) [noise=true , address=145.79.227.8:4330 , piece_id=5G3NFIJXYPK2BRZCO34FXIIUFQISLNZMF5GE6LYHXPOOTKVK7P4A, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.610216204 (177h25m53.544670348s) [noise=true , address=145.79.227.5:4224 , piece_id=SW7UZB267DX7PPJUSFD2OQERUDEQZSZJAHMLO3LDWZVNK4IF6KXQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.610682046 (177h25m53.545136182s) [noise=true , address=145.79.227.6:4260 , piece_id=KJ4JM2DPHDFAWJDW5QZGSYOGYOWFSJUDXYWPUZKZWEV3QIOIKEVQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611116131 (177h25m53.54557027s) [noise=true , address=145.79.227.50:4375 , piece_id=5HSR37ZLO3NTMTKBLOWC2ABNQHKE25VMS6HLZ2CMUUPE5QIGZQGA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611447353 (177h25m53.545901491s) [noise=true , address=145.79.227.20:4441 , piece_id=2BQMK2SV7WRW6CHOWQP3TTFDF2WMAWLLRE2JLRK23GGICXIFWPWQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611732463 (177h25m53.546186603s) [noise=true , address=145.79.227.35:4484 , piece_id=2KD6WZKUY6FRKRVSMZAQZPVNEX2IQUWORJP5JDFEDEGBTR57VHRQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.612359029 (177h25m53.546813169s) [seg_pos={0 0}, upload=155983]: Done begin upload segment.
Feb 25 05:42:48.612421514 (177h25m53.546875657s) [noise=true , address=45.91.116.12:4227 , piece_id=Z3CRDHRB6JI5UORE5SK67DUOFHS7XMMH6BI3BCFW2NPZ5LQH6NPA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613054414 (177h25m53.547508553s) [noise=true , address=45.91.116.9:4265 , piece_id=5X4OLVB2N2KF2FGLZDKITYNOTQJNZL6FOTIAXSQHDH6LBYLFXTZQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613355998 (177h25m53.547810141s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613532091 (177h25m53.547986232s) [noise=true , address=145.79.227.18:4006 , piece_id=DS5EW7KKKU5CU5O7VYQRRDXCEWGI4Y3Y2Z25QN4HHAVBQYOCKOZQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613794842 (177h25m53.54824898s) [noise=true , address=45.91.116.10:4081 , piece_id=3WSJADPR2XXP4CVQETVEN5YHFLLNW6YUID7LNXUZ2XBABSVHHIAA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613829958 (177h25m53.548284096s) [noise=true , address=145.79.227.27:4693 , piece_id=PN7EPCO4RNEAS3NJSUBCZO2J6V7M4NGC4SPM2GPLMRU47V3WUURA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614174057 (177h25m53.548628196s) [noise=true , address=145.79.227.9:4369 , piece_id=PMJ4E2UO7Q5GWSKOYS2GVNH5OS2TIUHQ5VLDHNSETJMZJTUOKWGA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614745799 (177h25m53.549199935s) [noise=true , address=145.79.227.47:4269 , piece_id=E4MZNWLH5OKXYWRSOPRVXIIIENKTJUZS7OMAF7EHA4X66AZ6MAIQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614781600 (177h25m53.549235737s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.615598548 (177h25m53.55005269s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:49.219849344 (177h25m54.154303478s) [upload=155983]: Next returned nil segment
Feb 25 05:42:49.219863932 (177h25m54.154318065s) [upload=155983]: Waiting for error group managing segments...
Feb 25 05:42:49.355130909 (177h25m54.289585042s) [noise=true , address=45.91.116.9:4265 , piece_id=5X4OLVB2N2KF2FGLZDKITYNOTQJNZL6FOTIAXSQHDH6LBYLFXTZQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.355538432 (177h25m54.289992565s) [noise=true , address=45.91.116.12:4227 , piece_id=Z3CRDHRB6JI5UORE5SK67DUOFHS7XMMH6BI3BCFW2NPZ5LQH6NPA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.356496709 (177h25m54.290950841s) [noise=true , address=145.79.227.8:4330 , piece_id=5G3NFIJXYPK2BRZCO34FXIIUFQISLNZMF5GE6LYHXPOOTKVK7P4A, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.357623689 (177h25m54.29207782s) [noise=true , address=145.79.227.9:4369 , piece_id=PMJ4E2UO7Q5GWSKOYS2GVNH5OS2TIUHQ5VLDHNSETJMZJTUOKWGA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.358496015 (177h25m54.292950148s) [noise=true , address=145.79.227.47:4269 , piece_id=E4MZNWLH5OKXYWRSOPRVXIIIENKTJUZS7OMAF7EHA4X66AZ6MAIQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.359168638 (177h25m54.293622769s) [noise=true , address=145.79.227.27:4693 , piece_id=PN7EPCO4RNEAS3NJSUBCZO2J6V7M4NGC4SPM2GPLMRU47V3WUURA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.360018880 (177h25m54.294473013s) [noise=true , address=145.79.227.35:4484 , piece_id=2KD6WZKUY6FRKRVSMZAQZPVNEX2IQUWORJP5JDFEDEGBTR57VHRQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.362336397 (177h25m54.296790529s) [noise=true , address=145.79.227.20:4441 , piece_id=2BQMK2SV7WRW6CHOWQP3TTFDF2WMAWLLRE2JLRK23GGICXIFWPWQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.367837052 (177h25m54.302291185s) [noise=true , address=145.79.227.18:4006 , piece_id=DS5EW7KKKU5CU5O7VYQRRDXCEWGI4Y3Y2Z25QN4HHAVBQYOCKOZQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370090577 (177h25m54.304544716s) [noise=true , address=45.91.116.10:4081 , piece_id=3WSJADPR2XXP4CVQETVEN5YHFLLNW6YUID7LNXUZ2XBABSVHHIAA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370196164 (177h25m54.304650305s) [noise=true , address=145.79.227.5:4224 , piece_id=SW7UZB267DX7PPJUSFD2OQERUDEQZSZJAHMLO3LDWZVNK4IF6KXQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370933003 (177h25m54.305387143s) [noise=true , address=145.79.227.6:4260 , piece_id=KJ4JM2DPHDFAWJDW5QZGSYOGYOWFSJUDXYWPUZKZWEV3QIOIKEVQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.376133367 (177h25m54.310587499s) [noise=true , address=145.79.227.50:4375 , piece_id=5HSR37ZLO3NTMTKBLOWC2ABNQHKE25VMS6HLZ2CMUUPE5QIGZQGA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.376157312 (177h25m54.310611447s) [seg_pos={0 0}, upload=155983]: Satisfied cohort requirements after 13 pieces
Feb 25 05:42:49.376426106 (177h25m54.310880247s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376438581 (177h25m54.310892718s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376449477 (177h25m54.310903618s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G13M5QwzW2uRcXeNnFWFPkyHj5xSkReGmqrNheT16fUKZwsp3): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376461110 (177h25m54.310915243s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376688720 (177h25m54.311142862s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ULUPKjJwZocjV1R6Dy7vmWSrZ4hKx3YAHLAihgtMKf8Uw2UgA): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376702626 (177h25m54.311156768s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376740965 (177h25m54.3111951s) [seg_pos={0 0}, upload=155983]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 25 05:42:49.376835784 (177h25m54.311289916s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 25 05:42:49.376841584 (177h25m54.311295716s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 25 05:42:49.521783892 (177h25m54.456238024s) [upload=155983]: Done uploading segments...
Feb 25 05:42:49.521820652 (177h25m54.456274791s) [upload=155983]: Upload finished. err: <nil>
Duration: 2.417966254s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.044343ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Length=274 Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=189769149C6D08E0 X-Request-Id=YpGE1AcqeE9 Date=Wed, 25 Feb 2026 06:21:55 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/5b38ed9d824dc56e
FAIL (2026-02-25 06:21:55 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189769149C6D08E0</RequestId><HostId></HostId></Error>"
Duration: 10.080962ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
304.132335ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=189769126B003E07 Content-Length=284 Content-Type=application/xml Vary=Origin X-Request-Id=aiudRgMY8Kq X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 06:21:46 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/43f0e278da1cf7f9
FAIL (2026-02-25 06:21:46 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189769126B003E07</RequestId><HostId></HostId></Error>"
Duration: 304.160124ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
128.967351ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj X-Amz-Request-Id=18976911AC386232 X-Request-Id=Ko88oHjky9C Date=Wed, 25 Feb 2026 06:21:43 GMT Content-Security-Policy=block-all-mixed-content Vary=Origin X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/5e3208567b8fc2e9
FAIL (2026-02-25 06:21:43 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18976911AC386232</RequestId><HostId></HostId></Error>"
Duration: 128.986097ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.335282ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Length=274 Server=Storj Vary=Origin X-Amz-Request-Id=1897690F27809C42 X-Request-Id=XoMQ7k3fiqY X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 06:21:32 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/68729974b0871687
FAIL (2026-02-25 06:21:32 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897690F27809C42</RequestId><HostId></HostId></Error>"
Duration: 8.376795ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.409953ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Type=application/xml X-Request-Id=3DyMjnAYtES X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 06:21:27 GMT Content-Length=274 Server=Storj Vary=Origin X-Amz-Request-Id=1897690E07E170C3 Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/307631edb524566f
FAIL (2026-02-25 06:21:27 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897690E07E170C3</RequestId><HostId></HostId></Error>"
Duration: 10.433526ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.369534761s trace:
https://jaeger.dev.storj.io/trace/6ba9cdd284c47f35
FAIL (2026-02-25 06:21:12 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Feb 25 05:42:48.492442491 (177h25m53.426896628s) [upload=155983]: Starting upload
Feb 25 05:42:48.492518689 (177h25m53.426972832s) [upload=155983]: Done starting upload
Feb 25 05:42:48.492850092 (177h25m53.427304211s) [upload=155983]: Uploading segments...
Feb 25 05:42:48.492982003 (177h25m53.427436149s) [upload=155983]: Got next segment. Inline: false
Feb 25 05:42:48.493030398 (177h25m53.427484531s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 25 05:42:48.493036271 (177h25m53.427490407s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 25 05:42:48.609378120 (177h25m53.543832252s) [seg_pos={0 0}, upload=155983]: Begin upload segment...
Feb 25 05:42:48.609500106 (177h25m53.543954282s) [noise=true , address=145.79.227.8:4330 , piece_id=5G3NFIJXYPK2BRZCO34FXIIUFQISLNZMF5GE6LYHXPOOTKVK7P4A, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.610216204 (177h25m53.544670348s) [noise=true , address=145.79.227.5:4224 , piece_id=SW7UZB267DX7PPJUSFD2OQERUDEQZSZJAHMLO3LDWZVNK4IF6KXQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.610682046 (177h25m53.545136182s) [noise=true , address=145.79.227.6:4260 , piece_id=KJ4JM2DPHDFAWJDW5QZGSYOGYOWFSJUDXYWPUZKZWEV3QIOIKEVQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611116131 (177h25m53.54557027s) [noise=true , address=145.79.227.50:4375 , piece_id=5HSR37ZLO3NTMTKBLOWC2ABNQHKE25VMS6HLZ2CMUUPE5QIGZQGA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611447353 (177h25m53.545901491s) [noise=true , address=145.79.227.20:4441 , piece_id=2BQMK2SV7WRW6CHOWQP3TTFDF2WMAWLLRE2JLRK23GGICXIFWPWQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611732463 (177h25m53.546186603s) [noise=true , address=145.79.227.35:4484 , piece_id=2KD6WZKUY6FRKRVSMZAQZPVNEX2IQUWORJP5JDFEDEGBTR57VHRQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.612359029 (177h25m53.546813169s) [seg_pos={0 0}, upload=155983]: Done begin upload segment.
Feb 25 05:42:48.612421514 (177h25m53.546875657s) [noise=true , address=45.91.116.12:4227 , piece_id=Z3CRDHRB6JI5UORE5SK67DUOFHS7XMMH6BI3BCFW2NPZ5LQH6NPA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613054414 (177h25m53.547508553s) [noise=true , address=45.91.116.9:4265 , piece_id=5X4OLVB2N2KF2FGLZDKITYNOTQJNZL6FOTIAXSQHDH6LBYLFXTZQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613355998 (177h25m53.547810141s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613532091 (177h25m53.547986232s) [noise=true , address=145.79.227.18:4006 , piece_id=DS5EW7KKKU5CU5O7VYQRRDXCEWGI4Y3Y2Z25QN4HHAVBQYOCKOZQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613794842 (177h25m53.54824898s) [noise=true , address=45.91.116.10:4081 , piece_id=3WSJADPR2XXP4CVQETVEN5YHFLLNW6YUID7LNXUZ2XBABSVHHIAA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613829958 (177h25m53.548284096s) [noise=true , address=145.79.227.27:4693 , piece_id=PN7EPCO4RNEAS3NJSUBCZO2J6V7M4NGC4SPM2GPLMRU47V3WUURA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614174057 (177h25m53.548628196s) [noise=true , address=145.79.227.9:4369 , piece_id=PMJ4E2UO7Q5GWSKOYS2GVNH5OS2TIUHQ5VLDHNSETJMZJTUOKWGA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614745799 (177h25m53.549199935s) [noise=true , address=145.79.227.47:4269 , piece_id=E4MZNWLH5OKXYWRSOPRVXIIIENKTJUZS7OMAF7EHA4X66AZ6MAIQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614781600 (177h25m53.549235737s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.615598548 (177h25m53.55005269s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:49.219849344 (177h25m54.154303478s) [upload=155983]: Next returned nil segment
Feb 25 05:42:49.219863932 (177h25m54.154318065s) [upload=155983]: Waiting for error group managing segments...
Feb 25 05:42:49.355130909 (177h25m54.289585042s) [noise=true , address=45.91.116.9:4265 , piece_id=5X4OLVB2N2KF2FGLZDKITYNOTQJNZL6FOTIAXSQHDH6LBYLFXTZQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.355538432 (177h25m54.289992565s) [noise=true , address=45.91.116.12:4227 , piece_id=Z3CRDHRB6JI5UORE5SK67DUOFHS7XMMH6BI3BCFW2NPZ5LQH6NPA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.356496709 (177h25m54.290950841s) [noise=true , address=145.79.227.8:4330 , piece_id=5G3NFIJXYPK2BRZCO34FXIIUFQISLNZMF5GE6LYHXPOOTKVK7P4A, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.357623689 (177h25m54.29207782s) [noise=true , address=145.79.227.9:4369 , piece_id=PMJ4E2UO7Q5GWSKOYS2GVNH5OS2TIUHQ5VLDHNSETJMZJTUOKWGA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.358496015 (177h25m54.292950148s) [noise=true , address=145.79.227.47:4269 , piece_id=E4MZNWLH5OKXYWRSOPRVXIIIENKTJUZS7OMAF7EHA4X66AZ6MAIQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.359168638 (177h25m54.293622769s) [noise=true , address=145.79.227.27:4693 , piece_id=PN7EPCO4RNEAS3NJSUBCZO2J6V7M4NGC4SPM2GPLMRU47V3WUURA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.360018880 (177h25m54.294473013s) [noise=true , address=145.79.227.35:4484 , piece_id=2KD6WZKUY6FRKRVSMZAQZPVNEX2IQUWORJP5JDFEDEGBTR57VHRQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.362336397 (177h25m54.296790529s) [noise=true , address=145.79.227.20:4441 , piece_id=2BQMK2SV7WRW6CHOWQP3TTFDF2WMAWLLRE2JLRK23GGICXIFWPWQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.367837052 (177h25m54.302291185s) [noise=true , address=145.79.227.18:4006 , piece_id=DS5EW7KKKU5CU5O7VYQRRDXCEWGI4Y3Y2Z25QN4HHAVBQYOCKOZQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370090577 (177h25m54.304544716s) [noise=true , address=45.91.116.10:4081 , piece_id=3WSJADPR2XXP4CVQETVEN5YHFLLNW6YUID7LNXUZ2XBABSVHHIAA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370196164 (177h25m54.304650305s) [noise=true , address=145.79.227.5:4224 , piece_id=SW7UZB267DX7PPJUSFD2OQERUDEQZSZJAHMLO3LDWZVNK4IF6KXQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370933003 (177h25m54.305387143s) [noise=true , address=145.79.227.6:4260 , piece_id=KJ4JM2DPHDFAWJDW5QZGSYOGYOWFSJUDXYWPUZKZWEV3QIOIKEVQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.376133367 (177h25m54.310587499s) [noise=true , address=145.79.227.50:4375 , piece_id=5HSR37ZLO3NTMTKBLOWC2ABNQHKE25VMS6HLZ2CMUUPE5QIGZQGA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.376157312 (177h25m54.310611447s) [seg_pos={0 0}, upload=155983]: Satisfied cohort requirements after 13 pieces
Feb 25 05:42:49.376426106 (177h25m54.310880247s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376438581 (177h25m54.310892718s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376449477 (177h25m54.310903618s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G13M5QwzW2uRcXeNnFWFPkyHj5xSkReGmqrNheT16fUKZwsp3): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376461110 (177h25m54.310915243s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376688720 (177h25m54.311142862s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ULUPKjJwZocjV1R6Dy7vmWSrZ4hKx3YAHLAihgtMKf8Uw2UgA): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376702626 (177h25m54.311156768s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376740965 (177h25m54.3111951s) [seg_pos={0 0}, upload=155983]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 25 05:42:49.376835784 (177h25m54.311289916s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 25 05:42:49.376841584 (177h25m54.311295716s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 25 05:42:49.521783892 (177h25m54.456238024s) [upload=155983]: Done uploading segments...
Feb 25 05:42:49.521820652 (177h25m54.456274791s) [upload=155983]: Upload finished. err: <nil>
Duration: 2.36956251s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
308.469972ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Server=Storj X-Amz-Request-Id=1897690912B28A35 X-Request-Id=KrghccMFQwY Date=Wed, 25 Feb 2026 06:21:06 GMT Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/33311f1b00b69ad6
FAIL (2026-02-25 06:21:06 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897690912B28A35</RequestId><HostId></HostId></Error>"
Duration: 308.494939ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.764001ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18976909236CB31D X-Request-Id=ifq4EnhSwnc Server=Storj X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 06:21:06 GMT Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/573527b0167e073
FAIL (2026-02-25 06:21:06 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18976909236CB31D</RequestId><HostId></HostId></Error>"
Duration: 7.791002ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.540635ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18976902A7FEA3FC X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 06:20:38 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Request-Id=HGyvSZeZL8u target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/70b7ef215b901bf6
FAIL (2026-02-25 06:20:38 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18976902A7FEA3FC</RequestId><HostId></HostId></Error>"
Duration: 7.576596ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.787451ms remote:
"tcp:185.244.226.3:443" response headers:
Date=Wed, 25 Feb 2026 06:20:38 GMT Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18976902A737D6DC X-Request-Id=XrKcoSCE1mC X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/22b8d53f9cb76bf0
FAIL (2026-02-25 06:20:38 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18976902A737D6DC</RequestId><HostId></HostId></Error>"
Duration: 8.81376ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.494725ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=189768FF2A9EB2AA X-Request-Id=eodH4oLjGJv Accept-Ranges=bytes X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 06:20:23 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/3a21ed6154a363d9
FAIL (2026-02-25 06:20:23 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189768FF2A9EB2AA</RequestId><HostId></HostId></Error>"
Duration: 12.519753ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.390874045s trace:
https://jaeger.dev.storj.io/trace/6ba9cdd284c47f35
FAIL (2026-02-25 06:20:22 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Feb 25 05:42:48.492442491 (177h25m53.426896628s) [upload=155983]: Starting upload
Feb 25 05:42:48.492518689 (177h25m53.426972832s) [upload=155983]: Done starting upload
Feb 25 05:42:48.492850092 (177h25m53.427304211s) [upload=155983]: Uploading segments...
Feb 25 05:42:48.492982003 (177h25m53.427436149s) [upload=155983]: Got next segment. Inline: false
Feb 25 05:42:48.493030398 (177h25m53.427484531s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 25 05:42:48.493036271 (177h25m53.427490407s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 25 05:42:48.609378120 (177h25m53.543832252s) [seg_pos={0 0}, upload=155983]: Begin upload segment...
Feb 25 05:42:48.609500106 (177h25m53.543954282s) [noise=true , address=145.79.227.8:4330 , piece_id=5G3NFIJXYPK2BRZCO34FXIIUFQISLNZMF5GE6LYHXPOOTKVK7P4A, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.610216204 (177h25m53.544670348s) [noise=true , address=145.79.227.5:4224 , piece_id=SW7UZB267DX7PPJUSFD2OQERUDEQZSZJAHMLO3LDWZVNK4IF6KXQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.610682046 (177h25m53.545136182s) [noise=true , address=145.79.227.6:4260 , piece_id=KJ4JM2DPHDFAWJDW5QZGSYOGYOWFSJUDXYWPUZKZWEV3QIOIKEVQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611116131 (177h25m53.54557027s) [noise=true , address=145.79.227.50:4375 , piece_id=5HSR37ZLO3NTMTKBLOWC2ABNQHKE25VMS6HLZ2CMUUPE5QIGZQGA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611447353 (177h25m53.545901491s) [noise=true , address=145.79.227.20:4441 , piece_id=2BQMK2SV7WRW6CHOWQP3TTFDF2WMAWLLRE2JLRK23GGICXIFWPWQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611732463 (177h25m53.546186603s) [noise=true , address=145.79.227.35:4484 , piece_id=2KD6WZKUY6FRKRVSMZAQZPVNEX2IQUWORJP5JDFEDEGBTR57VHRQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.612359029 (177h25m53.546813169s) [seg_pos={0 0}, upload=155983]: Done begin upload segment.
Feb 25 05:42:48.612421514 (177h25m53.546875657s) [noise=true , address=45.91.116.12:4227 , piece_id=Z3CRDHRB6JI5UORE5SK67DUOFHS7XMMH6BI3BCFW2NPZ5LQH6NPA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613054414 (177h25m53.547508553s) [noise=true , address=45.91.116.9:4265 , piece_id=5X4OLVB2N2KF2FGLZDKITYNOTQJNZL6FOTIAXSQHDH6LBYLFXTZQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613355998 (177h25m53.547810141s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613532091 (177h25m53.547986232s) [noise=true , address=145.79.227.18:4006 , piece_id=DS5EW7KKKU5CU5O7VYQRRDXCEWGI4Y3Y2Z25QN4HHAVBQYOCKOZQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613794842 (177h25m53.54824898s) [noise=true , address=45.91.116.10:4081 , piece_id=3WSJADPR2XXP4CVQETVEN5YHFLLNW6YUID7LNXUZ2XBABSVHHIAA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613829958 (177h25m53.548284096s) [noise=true , address=145.79.227.27:4693 , piece_id=PN7EPCO4RNEAS3NJSUBCZO2J6V7M4NGC4SPM2GPLMRU47V3WUURA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614174057 (177h25m53.548628196s) [noise=true , address=145.79.227.9:4369 , piece_id=PMJ4E2UO7Q5GWSKOYS2GVNH5OS2TIUHQ5VLDHNSETJMZJTUOKWGA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614745799 (177h25m53.549199935s) [noise=true , address=145.79.227.47:4269 , piece_id=E4MZNWLH5OKXYWRSOPRVXIIIENKTJUZS7OMAF7EHA4X66AZ6MAIQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614781600 (177h25m53.549235737s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.615598548 (177h25m53.55005269s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:49.219849344 (177h25m54.154303478s) [upload=155983]: Next returned nil segment
Feb 25 05:42:49.219863932 (177h25m54.154318065s) [upload=155983]: Waiting for error group managing segments...
Feb 25 05:42:49.355130909 (177h25m54.289585042s) [noise=true , address=45.91.116.9:4265 , piece_id=5X4OLVB2N2KF2FGLZDKITYNOTQJNZL6FOTIAXSQHDH6LBYLFXTZQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.355538432 (177h25m54.289992565s) [noise=true , address=45.91.116.12:4227 , piece_id=Z3CRDHRB6JI5UORE5SK67DUOFHS7XMMH6BI3BCFW2NPZ5LQH6NPA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.356496709 (177h25m54.290950841s) [noise=true , address=145.79.227.8:4330 , piece_id=5G3NFIJXYPK2BRZCO34FXIIUFQISLNZMF5GE6LYHXPOOTKVK7P4A, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.357623689 (177h25m54.29207782s) [noise=true , address=145.79.227.9:4369 , piece_id=PMJ4E2UO7Q5GWSKOYS2GVNH5OS2TIUHQ5VLDHNSETJMZJTUOKWGA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.358496015 (177h25m54.292950148s) [noise=true , address=145.79.227.47:4269 , piece_id=E4MZNWLH5OKXYWRSOPRVXIIIENKTJUZS7OMAF7EHA4X66AZ6MAIQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.359168638 (177h25m54.293622769s) [noise=true , address=145.79.227.27:4693 , piece_id=PN7EPCO4RNEAS3NJSUBCZO2J6V7M4NGC4SPM2GPLMRU47V3WUURA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.360018880 (177h25m54.294473013s) [noise=true , address=145.79.227.35:4484 , piece_id=2KD6WZKUY6FRKRVSMZAQZPVNEX2IQUWORJP5JDFEDEGBTR57VHRQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.362336397 (177h25m54.296790529s) [noise=true , address=145.79.227.20:4441 , piece_id=2BQMK2SV7WRW6CHOWQP3TTFDF2WMAWLLRE2JLRK23GGICXIFWPWQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.367837052 (177h25m54.302291185s) [noise=true , address=145.79.227.18:4006 , piece_id=DS5EW7KKKU5CU5O7VYQRRDXCEWGI4Y3Y2Z25QN4HHAVBQYOCKOZQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370090577 (177h25m54.304544716s) [noise=true , address=45.91.116.10:4081 , piece_id=3WSJADPR2XXP4CVQETVEN5YHFLLNW6YUID7LNXUZ2XBABSVHHIAA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370196164 (177h25m54.304650305s) [noise=true , address=145.79.227.5:4224 , piece_id=SW7UZB267DX7PPJUSFD2OQERUDEQZSZJAHMLO3LDWZVNK4IF6KXQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370933003 (177h25m54.305387143s) [noise=true , address=145.79.227.6:4260 , piece_id=KJ4JM2DPHDFAWJDW5QZGSYOGYOWFSJUDXYWPUZKZWEV3QIOIKEVQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.376133367 (177h25m54.310587499s) [noise=true , address=145.79.227.50:4375 , piece_id=5HSR37ZLO3NTMTKBLOWC2ABNQHKE25VMS6HLZ2CMUUPE5QIGZQGA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.376157312 (177h25m54.310611447s) [seg_pos={0 0}, upload=155983]: Satisfied cohort requirements after 13 pieces
Feb 25 05:42:49.376426106 (177h25m54.310880247s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376438581 (177h25m54.310892718s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376449477 (177h25m54.310903618s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G13M5QwzW2uRcXeNnFWFPkyHj5xSkReGmqrNheT16fUKZwsp3): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376461110 (177h25m54.310915243s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376688720 (177h25m54.311142862s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ULUPKjJwZocjV1R6Dy7vmWSrZ4hKx3YAHLAihgtMKf8Uw2UgA): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376702626 (177h25m54.311156768s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376740965 (177h25m54.3111951s) [seg_pos={0 0}, upload=155983]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 25 05:42:49.376835784 (177h25m54.311289916s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 25 05:42:49.376841584 (177h25m54.311295716s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 25 05:42:49.521783892 (177h25m54.456238024s) [upload=155983]: Done uploading segments...
Feb 25 05:42:49.521820652 (177h25m54.456274791s) [upload=155983]: Upload finished. err: <nil>
Duration: 2.39094843s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
306.724103ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=etgMw2SheKo X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 06:20:20 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=189768FE5B860E25 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/168a4115174fdb1d
FAIL (2026-02-25 06:20:20 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189768FE5B860E25</RequestId><HostId></HostId></Error>"
Duration: 306.745615ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.36691152s trace:
https://jaeger.dev.storj.io/trace/6ba9cdd284c47f35
FAIL (2026-02-25 06:19:45 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Feb 25 05:42:48.492442491 (177h25m53.426896628s) [upload=155983]: Starting upload
Feb 25 05:42:48.492518689 (177h25m53.426972832s) [upload=155983]: Done starting upload
Feb 25 05:42:48.492850092 (177h25m53.427304211s) [upload=155983]: Uploading segments...
Feb 25 05:42:48.492982003 (177h25m53.427436149s) [upload=155983]: Got next segment. Inline: false
Feb 25 05:42:48.493030398 (177h25m53.427484531s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 25 05:42:48.493036271 (177h25m53.427490407s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 25 05:42:48.609378120 (177h25m53.543832252s) [seg_pos={0 0}, upload=155983]: Begin upload segment...
Feb 25 05:42:48.609500106 (177h25m53.543954282s) [noise=true , address=145.79.227.8:4330 , piece_id=5G3NFIJXYPK2BRZCO34FXIIUFQISLNZMF5GE6LYHXPOOTKVK7P4A, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.610216204 (177h25m53.544670348s) [noise=true , address=145.79.227.5:4224 , piece_id=SW7UZB267DX7PPJUSFD2OQERUDEQZSZJAHMLO3LDWZVNK4IF6KXQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.610682046 (177h25m53.545136182s) [noise=true , address=145.79.227.6:4260 , piece_id=KJ4JM2DPHDFAWJDW5QZGSYOGYOWFSJUDXYWPUZKZWEV3QIOIKEVQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611116131 (177h25m53.54557027s) [noise=true , address=145.79.227.50:4375 , piece_id=5HSR37ZLO3NTMTKBLOWC2ABNQHKE25VMS6HLZ2CMUUPE5QIGZQGA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611447353 (177h25m53.545901491s) [noise=true , address=145.79.227.20:4441 , piece_id=2BQMK2SV7WRW6CHOWQP3TTFDF2WMAWLLRE2JLRK23GGICXIFWPWQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611732463 (177h25m53.546186603s) [noise=true , address=145.79.227.35:4484 , piece_id=2KD6WZKUY6FRKRVSMZAQZPVNEX2IQUWORJP5JDFEDEGBTR57VHRQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.612359029 (177h25m53.546813169s) [seg_pos={0 0}, upload=155983]: Done begin upload segment.
Feb 25 05:42:48.612421514 (177h25m53.546875657s) [noise=true , address=45.91.116.12:4227 , piece_id=Z3CRDHRB6JI5UORE5SK67DUOFHS7XMMH6BI3BCFW2NPZ5LQH6NPA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613054414 (177h25m53.547508553s) [noise=true , address=45.91.116.9:4265 , piece_id=5X4OLVB2N2KF2FGLZDKITYNOTQJNZL6FOTIAXSQHDH6LBYLFXTZQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613355998 (177h25m53.547810141s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613532091 (177h25m53.547986232s) [noise=true , address=145.79.227.18:4006 , piece_id=DS5EW7KKKU5CU5O7VYQRRDXCEWGI4Y3Y2Z25QN4HHAVBQYOCKOZQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613794842 (177h25m53.54824898s) [noise=true , address=45.91.116.10:4081 , piece_id=3WSJADPR2XXP4CVQETVEN5YHFLLNW6YUID7LNXUZ2XBABSVHHIAA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613829958 (177h25m53.548284096s) [noise=true , address=145.79.227.27:4693 , piece_id=PN7EPCO4RNEAS3NJSUBCZO2J6V7M4NGC4SPM2GPLMRU47V3WUURA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614174057 (177h25m53.548628196s) [noise=true , address=145.79.227.9:4369 , piece_id=PMJ4E2UO7Q5GWSKOYS2GVNH5OS2TIUHQ5VLDHNSETJMZJTUOKWGA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614745799 (177h25m53.549199935s) [noise=true , address=145.79.227.47:4269 , piece_id=E4MZNWLH5OKXYWRSOPRVXIIIENKTJUZS7OMAF7EHA4X66AZ6MAIQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614781600 (177h25m53.549235737s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.615598548 (177h25m53.55005269s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:49.219849344 (177h25m54.154303478s) [upload=155983]: Next returned nil segment
Feb 25 05:42:49.219863932 (177h25m54.154318065s) [upload=155983]: Waiting for error group managing segments...
Feb 25 05:42:49.355130909 (177h25m54.289585042s) [noise=true , address=45.91.116.9:4265 , piece_id=5X4OLVB2N2KF2FGLZDKITYNOTQJNZL6FOTIAXSQHDH6LBYLFXTZQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.355538432 (177h25m54.289992565s) [noise=true , address=45.91.116.12:4227 , piece_id=Z3CRDHRB6JI5UORE5SK67DUOFHS7XMMH6BI3BCFW2NPZ5LQH6NPA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.356496709 (177h25m54.290950841s) [noise=true , address=145.79.227.8:4330 , piece_id=5G3NFIJXYPK2BRZCO34FXIIUFQISLNZMF5GE6LYHXPOOTKVK7P4A, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.357623689 (177h25m54.29207782s) [noise=true , address=145.79.227.9:4369 , piece_id=PMJ4E2UO7Q5GWSKOYS2GVNH5OS2TIUHQ5VLDHNSETJMZJTUOKWGA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.358496015 (177h25m54.292950148s) [noise=true , address=145.79.227.47:4269 , piece_id=E4MZNWLH5OKXYWRSOPRVXIIIENKTJUZS7OMAF7EHA4X66AZ6MAIQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.359168638 (177h25m54.293622769s) [noise=true , address=145.79.227.27:4693 , piece_id=PN7EPCO4RNEAS3NJSUBCZO2J6V7M4NGC4SPM2GPLMRU47V3WUURA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.360018880 (177h25m54.294473013s) [noise=true , address=145.79.227.35:4484 , piece_id=2KD6WZKUY6FRKRVSMZAQZPVNEX2IQUWORJP5JDFEDEGBTR57VHRQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.362336397 (177h25m54.296790529s) [noise=true , address=145.79.227.20:4441 , piece_id=2BQMK2SV7WRW6CHOWQP3TTFDF2WMAWLLRE2JLRK23GGICXIFWPWQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.367837052 (177h25m54.302291185s) [noise=true , address=145.79.227.18:4006 , piece_id=DS5EW7KKKU5CU5O7VYQRRDXCEWGI4Y3Y2Z25QN4HHAVBQYOCKOZQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370090577 (177h25m54.304544716s) [noise=true , address=45.91.116.10:4081 , piece_id=3WSJADPR2XXP4CVQETVEN5YHFLLNW6YUID7LNXUZ2XBABSVHHIAA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370196164 (177h25m54.304650305s) [noise=true , address=145.79.227.5:4224 , piece_id=SW7UZB267DX7PPJUSFD2OQERUDEQZSZJAHMLO3LDWZVNK4IF6KXQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370933003 (177h25m54.305387143s) [noise=true , address=145.79.227.6:4260 , piece_id=KJ4JM2DPHDFAWJDW5QZGSYOGYOWFSJUDXYWPUZKZWEV3QIOIKEVQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.376133367 (177h25m54.310587499s) [noise=true , address=145.79.227.50:4375 , piece_id=5HSR37ZLO3NTMTKBLOWC2ABNQHKE25VMS6HLZ2CMUUPE5QIGZQGA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.376157312 (177h25m54.310611447s) [seg_pos={0 0}, upload=155983]: Satisfied cohort requirements after 13 pieces
Feb 25 05:42:49.376426106 (177h25m54.310880247s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376438581 (177h25m54.310892718s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376449477 (177h25m54.310903618s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G13M5QwzW2uRcXeNnFWFPkyHj5xSkReGmqrNheT16fUKZwsp3): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376461110 (177h25m54.310915243s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376688720 (177h25m54.311142862s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ULUPKjJwZocjV1R6Dy7vmWSrZ4hKx3YAHLAihgtMKf8Uw2UgA): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376702626 (177h25m54.311156768s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376740965 (177h25m54.3111951s) [seg_pos={0 0}, upload=155983]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 25 05:42:49.376835784 (177h25m54.311289916s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 25 05:42:49.376841584 (177h25m54.311295716s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 25 05:42:49.521783892 (177h25m54.456238024s) [upload=155983]: Done uploading segments...
Feb 25 05:42:49.521820652 (177h25m54.456274791s) [upload=155983]: Upload finished. err: <nil>
Duration: 2.366940383s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.069162ms remote:
"tcp:185.244.226.3:443" response headers:
Vary=Origin X-Xss-Protection=1; mode=block Server=Storj X-Amz-Request-Id=189768F62DA02742 X-Request-Id=XsXXBvsFgw2 Date=Wed, 25 Feb 2026 06:19:44 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/68fcb00e9a1daa12
FAIL (2026-02-25 06:19:44 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189768F62DA02742</RequestId><HostId></HostId></Error>"
Duration: 7.084521ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
307.703394ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=189768F572F47830 X-Request-Id=SDAhA1zNE51 X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 06:19:41 GMT Content-Length=284 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/eda443056782c4b
FAIL (2026-02-25 06:19:41 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189768F572F47830</RequestId><HostId></HostId></Error>"
Duration: 307.734813ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.019058ms remote:
"tcp:185.244.226.3:443" response headers:
X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 06:19:37 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=189768F47936B4C3 X-Request-Id=JpQLoC4s7Qh Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/715d3012aa37f037
FAIL (2026-02-25 06:19:37 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189768F47936B4C3</RequestId><HostId></HostId></Error>"
Duration: 10.050072ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.353668544s trace:
https://jaeger.dev.storj.io/trace/6ba9cdd284c47f35
FAIL (2026-02-25 06:19:29 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Feb 25 05:42:48.492442491 (177h25m53.426896628s) [upload=155983]: Starting upload
Feb 25 05:42:48.492518689 (177h25m53.426972832s) [upload=155983]: Done starting upload
Feb 25 05:42:48.492850092 (177h25m53.427304211s) [upload=155983]: Uploading segments...
Feb 25 05:42:48.492982003 (177h25m53.427436149s) [upload=155983]: Got next segment. Inline: false
Feb 25 05:42:48.493030398 (177h25m53.427484531s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 25 05:42:48.493036271 (177h25m53.427490407s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 25 05:42:48.609378120 (177h25m53.543832252s) [seg_pos={0 0}, upload=155983]: Begin upload segment...
Feb 25 05:42:48.609500106 (177h25m53.543954282s) [noise=true , address=145.79.227.8:4330 , piece_id=5G3NFIJXYPK2BRZCO34FXIIUFQISLNZMF5GE6LYHXPOOTKVK7P4A, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.610216204 (177h25m53.544670348s) [noise=true , address=145.79.227.5:4224 , piece_id=SW7UZB267DX7PPJUSFD2OQERUDEQZSZJAHMLO3LDWZVNK4IF6KXQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.610682046 (177h25m53.545136182s) [noise=true , address=145.79.227.6:4260 , piece_id=KJ4JM2DPHDFAWJDW5QZGSYOGYOWFSJUDXYWPUZKZWEV3QIOIKEVQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611116131 (177h25m53.54557027s) [noise=true , address=145.79.227.50:4375 , piece_id=5HSR37ZLO3NTMTKBLOWC2ABNQHKE25VMS6HLZ2CMUUPE5QIGZQGA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611447353 (177h25m53.545901491s) [noise=true , address=145.79.227.20:4441 , piece_id=2BQMK2SV7WRW6CHOWQP3TTFDF2WMAWLLRE2JLRK23GGICXIFWPWQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611732463 (177h25m53.546186603s) [noise=true , address=145.79.227.35:4484 , piece_id=2KD6WZKUY6FRKRVSMZAQZPVNEX2IQUWORJP5JDFEDEGBTR57VHRQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.612359029 (177h25m53.546813169s) [seg_pos={0 0}, upload=155983]: Done begin upload segment.
Feb 25 05:42:48.612421514 (177h25m53.546875657s) [noise=true , address=45.91.116.12:4227 , piece_id=Z3CRDHRB6JI5UORE5SK67DUOFHS7XMMH6BI3BCFW2NPZ5LQH6NPA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613054414 (177h25m53.547508553s) [noise=true , address=45.91.116.9:4265 , piece_id=5X4OLVB2N2KF2FGLZDKITYNOTQJNZL6FOTIAXSQHDH6LBYLFXTZQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613355998 (177h25m53.547810141s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613532091 (177h25m53.547986232s) [noise=true , address=145.79.227.18:4006 , piece_id=DS5EW7KKKU5CU5O7VYQRRDXCEWGI4Y3Y2Z25QN4HHAVBQYOCKOZQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613794842 (177h25m53.54824898s) [noise=true , address=45.91.116.10:4081 , piece_id=3WSJADPR2XXP4CVQETVEN5YHFLLNW6YUID7LNXUZ2XBABSVHHIAA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613829958 (177h25m53.548284096s) [noise=true , address=145.79.227.27:4693 , piece_id=PN7EPCO4RNEAS3NJSUBCZO2J6V7M4NGC4SPM2GPLMRU47V3WUURA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614174057 (177h25m53.548628196s) [noise=true , address=145.79.227.9:4369 , piece_id=PMJ4E2UO7Q5GWSKOYS2GVNH5OS2TIUHQ5VLDHNSETJMZJTUOKWGA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614745799 (177h25m53.549199935s) [noise=true , address=145.79.227.47:4269 , piece_id=E4MZNWLH5OKXYWRSOPRVXIIIENKTJUZS7OMAF7EHA4X66AZ6MAIQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614781600 (177h25m53.549235737s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.615598548 (177h25m53.55005269s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:49.219849344 (177h25m54.154303478s) [upload=155983]: Next returned nil segment
Feb 25 05:42:49.219863932 (177h25m54.154318065s) [upload=155983]: Waiting for error group managing segments...
Feb 25 05:42:49.355130909 (177h25m54.289585042s) [noise=true , address=45.91.116.9:4265 , piece_id=5X4OLVB2N2KF2FGLZDKITYNOTQJNZL6FOTIAXSQHDH6LBYLFXTZQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.355538432 (177h25m54.289992565s) [noise=true , address=45.91.116.12:4227 , piece_id=Z3CRDHRB6JI5UORE5SK67DUOFHS7XMMH6BI3BCFW2NPZ5LQH6NPA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.356496709 (177h25m54.290950841s) [noise=true , address=145.79.227.8:4330 , piece_id=5G3NFIJXYPK2BRZCO34FXIIUFQISLNZMF5GE6LYHXPOOTKVK7P4A, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.357623689 (177h25m54.29207782s) [noise=true , address=145.79.227.9:4369 , piece_id=PMJ4E2UO7Q5GWSKOYS2GVNH5OS2TIUHQ5VLDHNSETJMZJTUOKWGA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.358496015 (177h25m54.292950148s) [noise=true , address=145.79.227.47:4269 , piece_id=E4MZNWLH5OKXYWRSOPRVXIIIENKTJUZS7OMAF7EHA4X66AZ6MAIQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.359168638 (177h25m54.293622769s) [noise=true , address=145.79.227.27:4693 , piece_id=PN7EPCO4RNEAS3NJSUBCZO2J6V7M4NGC4SPM2GPLMRU47V3WUURA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.360018880 (177h25m54.294473013s) [noise=true , address=145.79.227.35:4484 , piece_id=2KD6WZKUY6FRKRVSMZAQZPVNEX2IQUWORJP5JDFEDEGBTR57VHRQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.362336397 (177h25m54.296790529s) [noise=true , address=145.79.227.20:4441 , piece_id=2BQMK2SV7WRW6CHOWQP3TTFDF2WMAWLLRE2JLRK23GGICXIFWPWQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.367837052 (177h25m54.302291185s) [noise=true , address=145.79.227.18:4006 , piece_id=DS5EW7KKKU5CU5O7VYQRRDXCEWGI4Y3Y2Z25QN4HHAVBQYOCKOZQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370090577 (177h25m54.304544716s) [noise=true , address=45.91.116.10:4081 , piece_id=3WSJADPR2XXP4CVQETVEN5YHFLLNW6YUID7LNXUZ2XBABSVHHIAA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370196164 (177h25m54.304650305s) [noise=true , address=145.79.227.5:4224 , piece_id=SW7UZB267DX7PPJUSFD2OQERUDEQZSZJAHMLO3LDWZVNK4IF6KXQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370933003 (177h25m54.305387143s) [noise=true , address=145.79.227.6:4260 , piece_id=KJ4JM2DPHDFAWJDW5QZGSYOGYOWFSJUDXYWPUZKZWEV3QIOIKEVQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.376133367 (177h25m54.310587499s) [noise=true , address=145.79.227.50:4375 , piece_id=5HSR37ZLO3NTMTKBLOWC2ABNQHKE25VMS6HLZ2CMUUPE5QIGZQGA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.376157312 (177h25m54.310611447s) [seg_pos={0 0}, upload=155983]: Satisfied cohort requirements after 13 pieces
Feb 25 05:42:49.376426106 (177h25m54.310880247s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376438581 (177h25m54.310892718s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376449477 (177h25m54.310903618s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G13M5QwzW2uRcXeNnFWFPkyHj5xSkReGmqrNheT16fUKZwsp3): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376461110 (177h25m54.310915243s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376688720 (177h25m54.311142862s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ULUPKjJwZocjV1R6Dy7vmWSrZ4hKx3YAHLAihgtMKf8Uw2UgA): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376702626 (177h25m54.311156768s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376740965 (177h25m54.3111951s) [seg_pos={0 0}, upload=155983]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 25 05:42:49.376835784 (177h25m54.311289916s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 25 05:42:49.376841584 (177h25m54.311295716s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 25 05:42:49.521783892 (177h25m54.456238024s) [upload=155983]: Done uploading segments...
Feb 25 05:42:49.521820652 (177h25m54.456274791s) [upload=155983]: Upload finished. err: <nil>
Duration: 2.353699716s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
26.603346ms remote:
"tcp:185.244.226.3:443" response headers:
Server=Storj Vary=Origin X-Request-Id=Bxtp97XALMg Date=Wed, 25 Feb 2026 06:19:24 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=189768F17B5B9A9E X-Xss-Protection=1; mode=block Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/7331fefece7a3a9e
FAIL (2026-02-25 06:19:24 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189768F17B5B9A9E</RequestId><HostId></HostId></Error>"
Duration: 26.618677ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.881785ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=189768EF92A53E25 X-Request-Id=X1sMqMZudMA X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 06:19:16 GMT Content-Length=274 Vary=Origin Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/696d0f6b02cd3a67
FAIL (2026-02-25 06:19:16 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189768EF92A53E25</RequestId><HostId></HostId></Error>"
Duration: 7.916625ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.360367126s trace:
https://jaeger.dev.storj.io/trace/6ba9cdd284c47f35
FAIL (2026-02-25 06:19:04 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Feb 25 05:42:48.492442491 (177h25m53.426896628s) [upload=155983]: Starting upload
Feb 25 05:42:48.492518689 (177h25m53.426972832s) [upload=155983]: Done starting upload
Feb 25 05:42:48.492850092 (177h25m53.427304211s) [upload=155983]: Uploading segments...
Feb 25 05:42:48.492982003 (177h25m53.427436149s) [upload=155983]: Got next segment. Inline: false
Feb 25 05:42:48.493030398 (177h25m53.427484531s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 25 05:42:48.493036271 (177h25m53.427490407s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 25 05:42:48.609378120 (177h25m53.543832252s) [seg_pos={0 0}, upload=155983]: Begin upload segment...
Feb 25 05:42:48.609500106 (177h25m53.543954282s) [noise=true , address=145.79.227.8:4330 , piece_id=5G3NFIJXYPK2BRZCO34FXIIUFQISLNZMF5GE6LYHXPOOTKVK7P4A, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.610216204 (177h25m53.544670348s) [noise=true , address=145.79.227.5:4224 , piece_id=SW7UZB267DX7PPJUSFD2OQERUDEQZSZJAHMLO3LDWZVNK4IF6KXQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.610682046 (177h25m53.545136182s) [noise=true , address=145.79.227.6:4260 , piece_id=KJ4JM2DPHDFAWJDW5QZGSYOGYOWFSJUDXYWPUZKZWEV3QIOIKEVQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611116131 (177h25m53.54557027s) [noise=true , address=145.79.227.50:4375 , piece_id=5HSR37ZLO3NTMTKBLOWC2ABNQHKE25VMS6HLZ2CMUUPE5QIGZQGA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611447353 (177h25m53.545901491s) [noise=true , address=145.79.227.20:4441 , piece_id=2BQMK2SV7WRW6CHOWQP3TTFDF2WMAWLLRE2JLRK23GGICXIFWPWQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611732463 (177h25m53.546186603s) [noise=true , address=145.79.227.35:4484 , piece_id=2KD6WZKUY6FRKRVSMZAQZPVNEX2IQUWORJP5JDFEDEGBTR57VHRQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.612359029 (177h25m53.546813169s) [seg_pos={0 0}, upload=155983]: Done begin upload segment.
Feb 25 05:42:48.612421514 (177h25m53.546875657s) [noise=true , address=45.91.116.12:4227 , piece_id=Z3CRDHRB6JI5UORE5SK67DUOFHS7XMMH6BI3BCFW2NPZ5LQH6NPA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613054414 (177h25m53.547508553s) [noise=true , address=45.91.116.9:4265 , piece_id=5X4OLVB2N2KF2FGLZDKITYNOTQJNZL6FOTIAXSQHDH6LBYLFXTZQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613355998 (177h25m53.547810141s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613532091 (177h25m53.547986232s) [noise=true , address=145.79.227.18:4006 , piece_id=DS5EW7KKKU5CU5O7VYQRRDXCEWGI4Y3Y2Z25QN4HHAVBQYOCKOZQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613794842 (177h25m53.54824898s) [noise=true , address=45.91.116.10:4081 , piece_id=3WSJADPR2XXP4CVQETVEN5YHFLLNW6YUID7LNXUZ2XBABSVHHIAA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613829958 (177h25m53.548284096s) [noise=true , address=145.79.227.27:4693 , piece_id=PN7EPCO4RNEAS3NJSUBCZO2J6V7M4NGC4SPM2GPLMRU47V3WUURA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614174057 (177h25m53.548628196s) [noise=true , address=145.79.227.9:4369 , piece_id=PMJ4E2UO7Q5GWSKOYS2GVNH5OS2TIUHQ5VLDHNSETJMZJTUOKWGA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614745799 (177h25m53.549199935s) [noise=true , address=145.79.227.47:4269 , piece_id=E4MZNWLH5OKXYWRSOPRVXIIIENKTJUZS7OMAF7EHA4X66AZ6MAIQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614781600 (177h25m53.549235737s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.615598548 (177h25m53.55005269s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:49.219849344 (177h25m54.154303478s) [upload=155983]: Next returned nil segment
Feb 25 05:42:49.219863932 (177h25m54.154318065s) [upload=155983]: Waiting for error group managing segments...
Feb 25 05:42:49.355130909 (177h25m54.289585042s) [noise=true , address=45.91.116.9:4265 , piece_id=5X4OLVB2N2KF2FGLZDKITYNOTQJNZL6FOTIAXSQHDH6LBYLFXTZQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.355538432 (177h25m54.289992565s) [noise=true , address=45.91.116.12:4227 , piece_id=Z3CRDHRB6JI5UORE5SK67DUOFHS7XMMH6BI3BCFW2NPZ5LQH6NPA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.356496709 (177h25m54.290950841s) [noise=true , address=145.79.227.8:4330 , piece_id=5G3NFIJXYPK2BRZCO34FXIIUFQISLNZMF5GE6LYHXPOOTKVK7P4A, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.357623689 (177h25m54.29207782s) [noise=true , address=145.79.227.9:4369 , piece_id=PMJ4E2UO7Q5GWSKOYS2GVNH5OS2TIUHQ5VLDHNSETJMZJTUOKWGA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.358496015 (177h25m54.292950148s) [noise=true , address=145.79.227.47:4269 , piece_id=E4MZNWLH5OKXYWRSOPRVXIIIENKTJUZS7OMAF7EHA4X66AZ6MAIQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.359168638 (177h25m54.293622769s) [noise=true , address=145.79.227.27:4693 , piece_id=PN7EPCO4RNEAS3NJSUBCZO2J6V7M4NGC4SPM2GPLMRU47V3WUURA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.360018880 (177h25m54.294473013s) [noise=true , address=145.79.227.35:4484 , piece_id=2KD6WZKUY6FRKRVSMZAQZPVNEX2IQUWORJP5JDFEDEGBTR57VHRQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.362336397 (177h25m54.296790529s) [noise=true , address=145.79.227.20:4441 , piece_id=2BQMK2SV7WRW6CHOWQP3TTFDF2WMAWLLRE2JLRK23GGICXIFWPWQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.367837052 (177h25m54.302291185s) [noise=true , address=145.79.227.18:4006 , piece_id=DS5EW7KKKU5CU5O7VYQRRDXCEWGI4Y3Y2Z25QN4HHAVBQYOCKOZQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370090577 (177h25m54.304544716s) [noise=true , address=45.91.116.10:4081 , piece_id=3WSJADPR2XXP4CVQETVEN5YHFLLNW6YUID7LNXUZ2XBABSVHHIAA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370196164 (177h25m54.304650305s) [noise=true , address=145.79.227.5:4224 , piece_id=SW7UZB267DX7PPJUSFD2OQERUDEQZSZJAHMLO3LDWZVNK4IF6KXQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370933003 (177h25m54.305387143s) [noise=true , address=145.79.227.6:4260 , piece_id=KJ4JM2DPHDFAWJDW5QZGSYOGYOWFSJUDXYWPUZKZWEV3QIOIKEVQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.376133367 (177h25m54.310587499s) [noise=true , address=145.79.227.50:4375 , piece_id=5HSR37ZLO3NTMTKBLOWC2ABNQHKE25VMS6HLZ2CMUUPE5QIGZQGA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.376157312 (177h25m54.310611447s) [seg_pos={0 0}, upload=155983]: Satisfied cohort requirements after 13 pieces
Feb 25 05:42:49.376426106 (177h25m54.310880247s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376438581 (177h25m54.310892718s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376449477 (177h25m54.310903618s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G13M5QwzW2uRcXeNnFWFPkyHj5xSkReGmqrNheT16fUKZwsp3): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376461110 (177h25m54.310915243s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376688720 (177h25m54.311142862s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ULUPKjJwZocjV1R6Dy7vmWSrZ4hKx3YAHLAihgtMKf8Uw2UgA): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376702626 (177h25m54.311156768s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376740965 (177h25m54.3111951s) [seg_pos={0 0}, upload=155983]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 25 05:42:49.376835784 (177h25m54.311289916s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 25 05:42:49.376841584 (177h25m54.311295716s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 25 05:42:49.521783892 (177h25m54.456238024s) [upload=155983]: Done uploading segments...
Feb 25 05:42:49.521820652 (177h25m54.456274791s) [upload=155983]: Upload finished. err: <nil>
Duration: 2.360413953s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.654429ms remote:
"tcp:185.244.226.3:443" response headers:
X-Request-Id=U95k72pPXaE Date=Wed, 25 Feb 2026 06:18:58 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=189768EB448DC796 X-Xss-Protection=1; mode=block Content-Length=274 Content-Type=application/xml Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/e0740fa13502d02
FAIL (2026-02-25 06:18:58 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189768EB448DC796</RequestId><HostId></HostId></Error>"
Duration: 7.680358ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.309103217s trace:
https://jaeger.dev.storj.io/trace/6ba9cdd284c47f35
FAIL (2026-02-25 06:18:46 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Feb 25 05:42:48.492442491 (177h25m53.426896628s) [upload=155983]: Starting upload
Feb 25 05:42:48.492518689 (177h25m53.426972832s) [upload=155983]: Done starting upload
Feb 25 05:42:48.492850092 (177h25m53.427304211s) [upload=155983]: Uploading segments...
Feb 25 05:42:48.492982003 (177h25m53.427436149s) [upload=155983]: Got next segment. Inline: false
Feb 25 05:42:48.493030398 (177h25m53.427484531s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 25 05:42:48.493036271 (177h25m53.427490407s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 25 05:42:48.609378120 (177h25m53.543832252s) [seg_pos={0 0}, upload=155983]: Begin upload segment...
Feb 25 05:42:48.609500106 (177h25m53.543954282s) [noise=true , address=145.79.227.8:4330 , piece_id=5G3NFIJXYPK2BRZCO34FXIIUFQISLNZMF5GE6LYHXPOOTKVK7P4A, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.610216204 (177h25m53.544670348s) [noise=true , address=145.79.227.5:4224 , piece_id=SW7UZB267DX7PPJUSFD2OQERUDEQZSZJAHMLO3LDWZVNK4IF6KXQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.610682046 (177h25m53.545136182s) [noise=true , address=145.79.227.6:4260 , piece_id=KJ4JM2DPHDFAWJDW5QZGSYOGYOWFSJUDXYWPUZKZWEV3QIOIKEVQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611116131 (177h25m53.54557027s) [noise=true , address=145.79.227.50:4375 , piece_id=5HSR37ZLO3NTMTKBLOWC2ABNQHKE25VMS6HLZ2CMUUPE5QIGZQGA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611447353 (177h25m53.545901491s) [noise=true , address=145.79.227.20:4441 , piece_id=2BQMK2SV7WRW6CHOWQP3TTFDF2WMAWLLRE2JLRK23GGICXIFWPWQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611732463 (177h25m53.546186603s) [noise=true , address=145.79.227.35:4484 , piece_id=2KD6WZKUY6FRKRVSMZAQZPVNEX2IQUWORJP5JDFEDEGBTR57VHRQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.612359029 (177h25m53.546813169s) [seg_pos={0 0}, upload=155983]: Done begin upload segment.
Feb 25 05:42:48.612421514 (177h25m53.546875657s) [noise=true , address=45.91.116.12:4227 , piece_id=Z3CRDHRB6JI5UORE5SK67DUOFHS7XMMH6BI3BCFW2NPZ5LQH6NPA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613054414 (177h25m53.547508553s) [noise=true , address=45.91.116.9:4265 , piece_id=5X4OLVB2N2KF2FGLZDKITYNOTQJNZL6FOTIAXSQHDH6LBYLFXTZQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613355998 (177h25m53.547810141s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613532091 (177h25m53.547986232s) [noise=true , address=145.79.227.18:4006 , piece_id=DS5EW7KKKU5CU5O7VYQRRDXCEWGI4Y3Y2Z25QN4HHAVBQYOCKOZQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613794842 (177h25m53.54824898s) [noise=true , address=45.91.116.10:4081 , piece_id=3WSJADPR2XXP4CVQETVEN5YHFLLNW6YUID7LNXUZ2XBABSVHHIAA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613829958 (177h25m53.548284096s) [noise=true , address=145.79.227.27:4693 , piece_id=PN7EPCO4RNEAS3NJSUBCZO2J6V7M4NGC4SPM2GPLMRU47V3WUURA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614174057 (177h25m53.548628196s) [noise=true , address=145.79.227.9:4369 , piece_id=PMJ4E2UO7Q5GWSKOYS2GVNH5OS2TIUHQ5VLDHNSETJMZJTUOKWGA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614745799 (177h25m53.549199935s) [noise=true , address=145.79.227.47:4269 , piece_id=E4MZNWLH5OKXYWRSOPRVXIIIENKTJUZS7OMAF7EHA4X66AZ6MAIQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614781600 (177h25m53.549235737s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.615598548 (177h25m53.55005269s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:49.219849344 (177h25m54.154303478s) [upload=155983]: Next returned nil segment
Feb 25 05:42:49.219863932 (177h25m54.154318065s) [upload=155983]: Waiting for error group managing segments...
Feb 25 05:42:49.355130909 (177h25m54.289585042s) [noise=true , address=45.91.116.9:4265 , piece_id=5X4OLVB2N2KF2FGLZDKITYNOTQJNZL6FOTIAXSQHDH6LBYLFXTZQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.355538432 (177h25m54.289992565s) [noise=true , address=45.91.116.12:4227 , piece_id=Z3CRDHRB6JI5UORE5SK67DUOFHS7XMMH6BI3BCFW2NPZ5LQH6NPA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.356496709 (177h25m54.290950841s) [noise=true , address=145.79.227.8:4330 , piece_id=5G3NFIJXYPK2BRZCO34FXIIUFQISLNZMF5GE6LYHXPOOTKVK7P4A, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.357623689 (177h25m54.29207782s) [noise=true , address=145.79.227.9:4369 , piece_id=PMJ4E2UO7Q5GWSKOYS2GVNH5OS2TIUHQ5VLDHNSETJMZJTUOKWGA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.358496015 (177h25m54.292950148s) [noise=true , address=145.79.227.47:4269 , piece_id=E4MZNWLH5OKXYWRSOPRVXIIIENKTJUZS7OMAF7EHA4X66AZ6MAIQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.359168638 (177h25m54.293622769s) [noise=true , address=145.79.227.27:4693 , piece_id=PN7EPCO4RNEAS3NJSUBCZO2J6V7M4NGC4SPM2GPLMRU47V3WUURA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.360018880 (177h25m54.294473013s) [noise=true , address=145.79.227.35:4484 , piece_id=2KD6WZKUY6FRKRVSMZAQZPVNEX2IQUWORJP5JDFEDEGBTR57VHRQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.362336397 (177h25m54.296790529s) [noise=true , address=145.79.227.20:4441 , piece_id=2BQMK2SV7WRW6CHOWQP3TTFDF2WMAWLLRE2JLRK23GGICXIFWPWQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.367837052 (177h25m54.302291185s) [noise=true , address=145.79.227.18:4006 , piece_id=DS5EW7KKKU5CU5O7VYQRRDXCEWGI4Y3Y2Z25QN4HHAVBQYOCKOZQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370090577 (177h25m54.304544716s) [noise=true , address=45.91.116.10:4081 , piece_id=3WSJADPR2XXP4CVQETVEN5YHFLLNW6YUID7LNXUZ2XBABSVHHIAA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370196164 (177h25m54.304650305s) [noise=true , address=145.79.227.5:4224 , piece_id=SW7UZB267DX7PPJUSFD2OQERUDEQZSZJAHMLO3LDWZVNK4IF6KXQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370933003 (177h25m54.305387143s) [noise=true , address=145.79.227.6:4260 , piece_id=KJ4JM2DPHDFAWJDW5QZGSYOGYOWFSJUDXYWPUZKZWEV3QIOIKEVQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.376133367 (177h25m54.310587499s) [noise=true , address=145.79.227.50:4375 , piece_id=5HSR37ZLO3NTMTKBLOWC2ABNQHKE25VMS6HLZ2CMUUPE5QIGZQGA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.376157312 (177h25m54.310611447s) [seg_pos={0 0}, upload=155983]: Satisfied cohort requirements after 13 pieces
Feb 25 05:42:49.376426106 (177h25m54.310880247s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376438581 (177h25m54.310892718s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376449477 (177h25m54.310903618s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G13M5QwzW2uRcXeNnFWFPkyHj5xSkReGmqrNheT16fUKZwsp3): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376461110 (177h25m54.310915243s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376688720 (177h25m54.311142862s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ULUPKjJwZocjV1R6Dy7vmWSrZ4hKx3YAHLAihgtMKf8Uw2UgA): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376702626 (177h25m54.311156768s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376740965 (177h25m54.3111951s) [seg_pos={0 0}, upload=155983]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 25 05:42:49.376835784 (177h25m54.311289916s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 25 05:42:49.376841584 (177h25m54.311295716s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 25 05:42:49.521783892 (177h25m54.456238024s) [upload=155983]: Done uploading segments...
Feb 25 05:42:49.521820652 (177h25m54.456274791s) [upload=155983]: Upload finished. err: <nil>
Duration: 2.309134545s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.571525ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=189768E855C781FE X-Request-Id=T8gsJUuavHx X-Xss-Protection=1; mode=block Accept-Ranges=bytes Vary=Origin Date=Wed, 25 Feb 2026 06:18:45 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/6d21ef714bec9247
FAIL (2026-02-25 06:18:45 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189768E855C781FE</RequestId><HostId></HostId></Error>"
Duration: 8.598411ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
320.899642ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=189768E7F6FE6F0D X-Request-Id=PDXyHoqbymi Date=Wed, 25 Feb 2026 06:18:43 GMT Vary=Origin X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/616474302149b08b
FAIL (2026-02-25 06:18:43 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189768E7F6FE6F0D</RequestId><HostId></HostId></Error>"
Duration: 320.923016ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.568632ms remote:
"tcp:185.244.226.3:443" response headers:
Date=Wed, 25 Feb 2026 06:18:33 GMT Content-Length=274 Vary=Origin X-Request-Id=4NefXJV71f7 Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=189768E574944D33 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/55a6f8eef6a6cecf
FAIL (2026-02-25 06:18:33 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189768E574944D33</RequestId><HostId></HostId></Error>"
Duration: 12.594939ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.474196ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Request-Id=8T8Kh4WLD8t X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 06:18:22 GMT Accept-Ranges=bytes Server=Storj X-Amz-Request-Id=189768E30C89DBC0 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/72ac57f0ab63534e
FAIL (2026-02-25 06:18:22 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189768E30C89DBC0</RequestId><HostId></HostId></Error>"
Duration: 9.487024ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
287.24936ms remote:
"tcp:45.38.24.2:443" response headers:
X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 06:18:19 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=TraRwB86fVx Accept-Ranges=bytes Content-Length=284 Server=Storj Vary=Origin X-Amz-Request-Id=189768E24125592A target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/49bf24b9f4914d77
FAIL (2026-02-25 06:18:19 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189768E24125592A</RequestId><HostId></HostId></Error>"
Duration: 287.272259ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
2.269773962s trace:
https://jaeger.dev.storj.io/trace/6ba9cdd284c47f35
FAIL (2026-02-25 06:18:17 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Feb 25 05:42:48.492442491 (177h25m53.426896628s) [upload=155983]: Starting upload
Feb 25 05:42:48.492518689 (177h25m53.426972832s) [upload=155983]: Done starting upload
Feb 25 05:42:48.492850092 (177h25m53.427304211s) [upload=155983]: Uploading segments...
Feb 25 05:42:48.492982003 (177h25m53.427436149s) [upload=155983]: Got next segment. Inline: false
Feb 25 05:42:48.493030398 (177h25m53.427484531s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 25 05:42:48.493036271 (177h25m53.427490407s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 25 05:42:48.609378120 (177h25m53.543832252s) [seg_pos={0 0}, upload=155983]: Begin upload segment...
Feb 25 05:42:48.609500106 (177h25m53.543954282s) [noise=true , address=145.79.227.8:4330 , piece_id=5G3NFIJXYPK2BRZCO34FXIIUFQISLNZMF5GE6LYHXPOOTKVK7P4A, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.610216204 (177h25m53.544670348s) [noise=true , address=145.79.227.5:4224 , piece_id=SW7UZB267DX7PPJUSFD2OQERUDEQZSZJAHMLO3LDWZVNK4IF6KXQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.610682046 (177h25m53.545136182s) [noise=true , address=145.79.227.6:4260 , piece_id=KJ4JM2DPHDFAWJDW5QZGSYOGYOWFSJUDXYWPUZKZWEV3QIOIKEVQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611116131 (177h25m53.54557027s) [noise=true , address=145.79.227.50:4375 , piece_id=5HSR37ZLO3NTMTKBLOWC2ABNQHKE25VMS6HLZ2CMUUPE5QIGZQGA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611447353 (177h25m53.545901491s) [noise=true , address=145.79.227.20:4441 , piece_id=2BQMK2SV7WRW6CHOWQP3TTFDF2WMAWLLRE2JLRK23GGICXIFWPWQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611732463 (177h25m53.546186603s) [noise=true , address=145.79.227.35:4484 , piece_id=2KD6WZKUY6FRKRVSMZAQZPVNEX2IQUWORJP5JDFEDEGBTR57VHRQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.612359029 (177h25m53.546813169s) [seg_pos={0 0}, upload=155983]: Done begin upload segment.
Feb 25 05:42:48.612421514 (177h25m53.546875657s) [noise=true , address=45.91.116.12:4227 , piece_id=Z3CRDHRB6JI5UORE5SK67DUOFHS7XMMH6BI3BCFW2NPZ5LQH6NPA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613054414 (177h25m53.547508553s) [noise=true , address=45.91.116.9:4265 , piece_id=5X4OLVB2N2KF2FGLZDKITYNOTQJNZL6FOTIAXSQHDH6LBYLFXTZQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613355998 (177h25m53.547810141s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613532091 (177h25m53.547986232s) [noise=true , address=145.79.227.18:4006 , piece_id=DS5EW7KKKU5CU5O7VYQRRDXCEWGI4Y3Y2Z25QN4HHAVBQYOCKOZQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613794842 (177h25m53.54824898s) [noise=true , address=45.91.116.10:4081 , piece_id=3WSJADPR2XXP4CVQETVEN5YHFLLNW6YUID7LNXUZ2XBABSVHHIAA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613829958 (177h25m53.548284096s) [noise=true , address=145.79.227.27:4693 , piece_id=PN7EPCO4RNEAS3NJSUBCZO2J6V7M4NGC4SPM2GPLMRU47V3WUURA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614174057 (177h25m53.548628196s) [noise=true , address=145.79.227.9:4369 , piece_id=PMJ4E2UO7Q5GWSKOYS2GVNH5OS2TIUHQ5VLDHNSETJMZJTUOKWGA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614745799 (177h25m53.549199935s) [noise=true , address=145.79.227.47:4269 , piece_id=E4MZNWLH5OKXYWRSOPRVXIIIENKTJUZS7OMAF7EHA4X66AZ6MAIQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614781600 (177h25m53.549235737s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.615598548 (177h25m53.55005269s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:49.219849344 (177h25m54.154303478s) [upload=155983]: Next returned nil segment
Feb 25 05:42:49.219863932 (177h25m54.154318065s) [upload=155983]: Waiting for error group managing segments...
Feb 25 05:42:49.355130909 (177h25m54.289585042s) [noise=true , address=45.91.116.9:4265 , piece_id=5X4OLVB2N2KF2FGLZDKITYNOTQJNZL6FOTIAXSQHDH6LBYLFXTZQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.355538432 (177h25m54.289992565s) [noise=true , address=45.91.116.12:4227 , piece_id=Z3CRDHRB6JI5UORE5SK67DUOFHS7XMMH6BI3BCFW2NPZ5LQH6NPA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.356496709 (177h25m54.290950841s) [noise=true , address=145.79.227.8:4330 , piece_id=5G3NFIJXYPK2BRZCO34FXIIUFQISLNZMF5GE6LYHXPOOTKVK7P4A, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.357623689 (177h25m54.29207782s) [noise=true , address=145.79.227.9:4369 , piece_id=PMJ4E2UO7Q5GWSKOYS2GVNH5OS2TIUHQ5VLDHNSETJMZJTUOKWGA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.358496015 (177h25m54.292950148s) [noise=true , address=145.79.227.47:4269 , piece_id=E4MZNWLH5OKXYWRSOPRVXIIIENKTJUZS7OMAF7EHA4X66AZ6MAIQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.359168638 (177h25m54.293622769s) [noise=true , address=145.79.227.27:4693 , piece_id=PN7EPCO4RNEAS3NJSUBCZO2J6V7M4NGC4SPM2GPLMRU47V3WUURA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.360018880 (177h25m54.294473013s) [noise=true , address=145.79.227.35:4484 , piece_id=2KD6WZKUY6FRKRVSMZAQZPVNEX2IQUWORJP5JDFEDEGBTR57VHRQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.362336397 (177h25m54.296790529s) [noise=true , address=145.79.227.20:4441 , piece_id=2BQMK2SV7WRW6CHOWQP3TTFDF2WMAWLLRE2JLRK23GGICXIFWPWQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.367837052 (177h25m54.302291185s) [noise=true , address=145.79.227.18:4006 , piece_id=DS5EW7KKKU5CU5O7VYQRRDXCEWGI4Y3Y2Z25QN4HHAVBQYOCKOZQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370090577 (177h25m54.304544716s) [noise=true , address=45.91.116.10:4081 , piece_id=3WSJADPR2XXP4CVQETVEN5YHFLLNW6YUID7LNXUZ2XBABSVHHIAA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370196164 (177h25m54.304650305s) [noise=true , address=145.79.227.5:4224 , piece_id=SW7UZB267DX7PPJUSFD2OQERUDEQZSZJAHMLO3LDWZVNK4IF6KXQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370933003 (177h25m54.305387143s) [noise=true , address=145.79.227.6:4260 , piece_id=KJ4JM2DPHDFAWJDW5QZGSYOGYOWFSJUDXYWPUZKZWEV3QIOIKEVQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.376133367 (177h25m54.310587499s) [noise=true , address=145.79.227.50:4375 , piece_id=5HSR37ZLO3NTMTKBLOWC2ABNQHKE25VMS6HLZ2CMUUPE5QIGZQGA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.376157312 (177h25m54.310611447s) [seg_pos={0 0}, upload=155983]: Satisfied cohort requirements after 13 pieces
Feb 25 05:42:49.376426106 (177h25m54.310880247s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376438581 (177h25m54.310892718s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376449477 (177h25m54.310903618s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G13M5QwzW2uRcXeNnFWFPkyHj5xSkReGmqrNheT16fUKZwsp3): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376461110 (177h25m54.310915243s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376688720 (177h25m54.311142862s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ULUPKjJwZocjV1R6Dy7vmWSrZ4hKx3YAHLAihgtMKf8Uw2UgA): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376702626 (177h25m54.311156768s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376740965 (177h25m54.3111951s) [seg_pos={0 0}, upload=155983]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 25 05:42:49.376835784 (177h25m54.311289916s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 25 05:42:49.376841584 (177h25m54.311295716s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 25 05:42:49.521783892 (177h25m54.456238024s) [upload=155983]: Done uploading segments...
Feb 25 05:42:49.521820652 (177h25m54.456274791s) [upload=155983]: Upload finished. err: <nil>
Duration: 2.269806048s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.380791ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=gdr4iUc2R6V Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=189768E1DE1AAC3E X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 06:18:17 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/c6d36487fb01044
FAIL (2026-02-25 06:18:17 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189768E1DE1AAC3E</RequestId><HostId></HostId></Error>"
Duration: 7.39337ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.98875ms remote:
"tcp:185.244.226.3:443" response headers:
Date=Wed, 25 Feb 2026 06:17:48 GMT Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=189768DB15E0694D X-Request-Id=hXdVkrTUhUh target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/67d6f127e0f3b97c
FAIL (2026-02-25 06:17:48 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189768DB15E0694D</RequestId><HostId></HostId></Error>"
Duration: 8.015958ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.687151ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Server=Storj X-Xss-Protection=1; mode=block Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=189768D9C6C792E5 X-Request-Id=F9ifdbKkdxN Date=Wed, 25 Feb 2026 06:17:42 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/7f920b6d1ccc83f1
FAIL (2026-02-25 06:17:42 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189768D9C6C792E5</RequestId><HostId></HostId></Error>"
Duration: 11.719137ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
333.876106ms remote:
"tcp:45.38.24.2:443" response headers:
X-Request-Id=fPA12BrC1RH X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=189768D7689317B6 Date=Wed, 25 Feb 2026 06:17:32 GMT Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Server=Storj target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/322da9db9e1603dc
FAIL (2026-02-25 06:17:32 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189768D7689317B6</RequestId><HostId></HostId></Error>"
Duration: 333.903065ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.941735ms remote:
"tcp:185.244.226.3:443" response headers:
Server=Storj Date=Wed, 25 Feb 2026 06:17:21 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=189768D4CA7B94B5 X-Request-Id=TpFkbMTq77L X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/66536ad24e8922e0
FAIL (2026-02-25 06:17:21 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189768D4CA7B94B5</RequestId><HostId></HostId></Error>"
Duration: 9.029856ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.500957ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=189768D3F8C9B07C X-Request-Id=FqwmoiWKXpb X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 06:17:18 GMT Content-Security-Policy=block-all-mixed-content Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/70c04b1b93d66403
FAIL (2026-02-25 06:17:18 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189768D3F8C9B07C</RequestId><HostId></HostId></Error>"
Duration: 8.528937ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.297320837s trace:
https://jaeger.dev.storj.io/trace/6ba9cdd284c47f35
FAIL (2026-02-25 06:17:08 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Feb 25 05:42:48.492442491 (177h25m53.426896628s) [upload=155983]: Starting upload
Feb 25 05:42:48.492518689 (177h25m53.426972832s) [upload=155983]: Done starting upload
Feb 25 05:42:48.492850092 (177h25m53.427304211s) [upload=155983]: Uploading segments...
Feb 25 05:42:48.492982003 (177h25m53.427436149s) [upload=155983]: Got next segment. Inline: false
Feb 25 05:42:48.493030398 (177h25m53.427484531s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 25 05:42:48.493036271 (177h25m53.427490407s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 25 05:42:48.609378120 (177h25m53.543832252s) [seg_pos={0 0}, upload=155983]: Begin upload segment...
Feb 25 05:42:48.609500106 (177h25m53.543954282s) [noise=true , address=145.79.227.8:4330 , piece_id=5G3NFIJXYPK2BRZCO34FXIIUFQISLNZMF5GE6LYHXPOOTKVK7P4A, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.610216204 (177h25m53.544670348s) [noise=true , address=145.79.227.5:4224 , piece_id=SW7UZB267DX7PPJUSFD2OQERUDEQZSZJAHMLO3LDWZVNK4IF6KXQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.610682046 (177h25m53.545136182s) [noise=true , address=145.79.227.6:4260 , piece_id=KJ4JM2DPHDFAWJDW5QZGSYOGYOWFSJUDXYWPUZKZWEV3QIOIKEVQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611116131 (177h25m53.54557027s) [noise=true , address=145.79.227.50:4375 , piece_id=5HSR37ZLO3NTMTKBLOWC2ABNQHKE25VMS6HLZ2CMUUPE5QIGZQGA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611447353 (177h25m53.545901491s) [noise=true , address=145.79.227.20:4441 , piece_id=2BQMK2SV7WRW6CHOWQP3TTFDF2WMAWLLRE2JLRK23GGICXIFWPWQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611732463 (177h25m53.546186603s) [noise=true , address=145.79.227.35:4484 , piece_id=2KD6WZKUY6FRKRVSMZAQZPVNEX2IQUWORJP5JDFEDEGBTR57VHRQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.612359029 (177h25m53.546813169s) [seg_pos={0 0}, upload=155983]: Done begin upload segment.
Feb 25 05:42:48.612421514 (177h25m53.546875657s) [noise=true , address=45.91.116.12:4227 , piece_id=Z3CRDHRB6JI5UORE5SK67DUOFHS7XMMH6BI3BCFW2NPZ5LQH6NPA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613054414 (177h25m53.547508553s) [noise=true , address=45.91.116.9:4265 , piece_id=5X4OLVB2N2KF2FGLZDKITYNOTQJNZL6FOTIAXSQHDH6LBYLFXTZQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613355998 (177h25m53.547810141s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613532091 (177h25m53.547986232s) [noise=true , address=145.79.227.18:4006 , piece_id=DS5EW7KKKU5CU5O7VYQRRDXCEWGI4Y3Y2Z25QN4HHAVBQYOCKOZQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613794842 (177h25m53.54824898s) [noise=true , address=45.91.116.10:4081 , piece_id=3WSJADPR2XXP4CVQETVEN5YHFLLNW6YUID7LNXUZ2XBABSVHHIAA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613829958 (177h25m53.548284096s) [noise=true , address=145.79.227.27:4693 , piece_id=PN7EPCO4RNEAS3NJSUBCZO2J6V7M4NGC4SPM2GPLMRU47V3WUURA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614174057 (177h25m53.548628196s) [noise=true , address=145.79.227.9:4369 , piece_id=PMJ4E2UO7Q5GWSKOYS2GVNH5OS2TIUHQ5VLDHNSETJMZJTUOKWGA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614745799 (177h25m53.549199935s) [noise=true , address=145.79.227.47:4269 , piece_id=E4MZNWLH5OKXYWRSOPRVXIIIENKTJUZS7OMAF7EHA4X66AZ6MAIQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614781600 (177h25m53.549235737s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.615598548 (177h25m53.55005269s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:49.219849344 (177h25m54.154303478s) [upload=155983]: Next returned nil segment
Feb 25 05:42:49.219863932 (177h25m54.154318065s) [upload=155983]: Waiting for error group managing segments...
Feb 25 05:42:49.355130909 (177h25m54.289585042s) [noise=true , address=45.91.116.9:4265 , piece_id=5X4OLVB2N2KF2FGLZDKITYNOTQJNZL6FOTIAXSQHDH6LBYLFXTZQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.355538432 (177h25m54.289992565s) [noise=true , address=45.91.116.12:4227 , piece_id=Z3CRDHRB6JI5UORE5SK67DUOFHS7XMMH6BI3BCFW2NPZ5LQH6NPA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.356496709 (177h25m54.290950841s) [noise=true , address=145.79.227.8:4330 , piece_id=5G3NFIJXYPK2BRZCO34FXIIUFQISLNZMF5GE6LYHXPOOTKVK7P4A, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.357623689 (177h25m54.29207782s) [noise=true , address=145.79.227.9:4369 , piece_id=PMJ4E2UO7Q5GWSKOYS2GVNH5OS2TIUHQ5VLDHNSETJMZJTUOKWGA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.358496015 (177h25m54.292950148s) [noise=true , address=145.79.227.47:4269 , piece_id=E4MZNWLH5OKXYWRSOPRVXIIIENKTJUZS7OMAF7EHA4X66AZ6MAIQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.359168638 (177h25m54.293622769s) [noise=true , address=145.79.227.27:4693 , piece_id=PN7EPCO4RNEAS3NJSUBCZO2J6V7M4NGC4SPM2GPLMRU47V3WUURA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.360018880 (177h25m54.294473013s) [noise=true , address=145.79.227.35:4484 , piece_id=2KD6WZKUY6FRKRVSMZAQZPVNEX2IQUWORJP5JDFEDEGBTR57VHRQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.362336397 (177h25m54.296790529s) [noise=true , address=145.79.227.20:4441 , piece_id=2BQMK2SV7WRW6CHOWQP3TTFDF2WMAWLLRE2JLRK23GGICXIFWPWQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.367837052 (177h25m54.302291185s) [noise=true , address=145.79.227.18:4006 , piece_id=DS5EW7KKKU5CU5O7VYQRRDXCEWGI4Y3Y2Z25QN4HHAVBQYOCKOZQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370090577 (177h25m54.304544716s) [noise=true , address=45.91.116.10:4081 , piece_id=3WSJADPR2XXP4CVQETVEN5YHFLLNW6YUID7LNXUZ2XBABSVHHIAA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370196164 (177h25m54.304650305s) [noise=true , address=145.79.227.5:4224 , piece_id=SW7UZB267DX7PPJUSFD2OQERUDEQZSZJAHMLO3LDWZVNK4IF6KXQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370933003 (177h25m54.305387143s) [noise=true , address=145.79.227.6:4260 , piece_id=KJ4JM2DPHDFAWJDW5QZGSYOGYOWFSJUDXYWPUZKZWEV3QIOIKEVQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.376133367 (177h25m54.310587499s) [noise=true , address=145.79.227.50:4375 , piece_id=5HSR37ZLO3NTMTKBLOWC2ABNQHKE25VMS6HLZ2CMUUPE5QIGZQGA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.376157312 (177h25m54.310611447s) [seg_pos={0 0}, upload=155983]: Satisfied cohort requirements after 13 pieces
Feb 25 05:42:49.376426106 (177h25m54.310880247s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376438581 (177h25m54.310892718s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376449477 (177h25m54.310903618s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G13M5QwzW2uRcXeNnFWFPkyHj5xSkReGmqrNheT16fUKZwsp3): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376461110 (177h25m54.310915243s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376688720 (177h25m54.311142862s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ULUPKjJwZocjV1R6Dy7vmWSrZ4hKx3YAHLAihgtMKf8Uw2UgA): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376702626 (177h25m54.311156768s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376740965 (177h25m54.3111951s) [seg_pos={0 0}, upload=155983]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 25 05:42:49.376835784 (177h25m54.311289916s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 25 05:42:49.376841584 (177h25m54.311295716s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 25 05:42:49.521783892 (177h25m54.456238024s) [upload=155983]: Done uploading segments...
Feb 25 05:42:49.521820652 (177h25m54.456274791s) [upload=155983]: Upload finished. err: <nil>
Duration: 2.297345913s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.137751ms remote:
"tcp:185.244.226.3:443" response headers:
Vary=Origin X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=189768CC42430271 X-Request-Id=E6zQ7iiDhYb Date=Wed, 25 Feb 2026 06:16:44 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/111959639b640ef1
FAIL (2026-02-25 06:16:44 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189768CC42430271</RequestId><HostId></HostId></Error>"
Duration: 8.178831ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.247291ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=189768CA539CB36E X-Request-Id=Zr9iBHqivxK Date=Wed, 25 Feb 2026 06:16:36 GMT Accept-Ranges=bytes Vary=Origin X-Xss-Protection=1; mode=block Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/31150518dde7924
FAIL (2026-02-25 06:16:36 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189768CA539CB36E</RequestId><HostId></HostId></Error>"
Duration: 11.289985ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
2.318518511s trace:
https://jaeger.dev.storj.io/trace/6ba9cdd284c47f35
FAIL (2026-02-25 06:16:34 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Feb 25 05:42:48.492442491 (177h25m53.426896628s) [upload=155983]: Starting upload
Feb 25 05:42:48.492518689 (177h25m53.426972832s) [upload=155983]: Done starting upload
Feb 25 05:42:48.492850092 (177h25m53.427304211s) [upload=155983]: Uploading segments...
Feb 25 05:42:48.492982003 (177h25m53.427436149s) [upload=155983]: Got next segment. Inline: false
Feb 25 05:42:48.493030398 (177h25m53.427484531s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 25 05:42:48.493036271 (177h25m53.427490407s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 25 05:42:48.609378120 (177h25m53.543832252s) [seg_pos={0 0}, upload=155983]: Begin upload segment...
Feb 25 05:42:48.609500106 (177h25m53.543954282s) [noise=true , address=145.79.227.8:4330 , piece_id=5G3NFIJXYPK2BRZCO34FXIIUFQISLNZMF5GE6LYHXPOOTKVK7P4A, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.610216204 (177h25m53.544670348s) [noise=true , address=145.79.227.5:4224 , piece_id=SW7UZB267DX7PPJUSFD2OQERUDEQZSZJAHMLO3LDWZVNK4IF6KXQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.610682046 (177h25m53.545136182s) [noise=true , address=145.79.227.6:4260 , piece_id=KJ4JM2DPHDFAWJDW5QZGSYOGYOWFSJUDXYWPUZKZWEV3QIOIKEVQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611116131 (177h25m53.54557027s) [noise=true , address=145.79.227.50:4375 , piece_id=5HSR37ZLO3NTMTKBLOWC2ABNQHKE25VMS6HLZ2CMUUPE5QIGZQGA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611447353 (177h25m53.545901491s) [noise=true , address=145.79.227.20:4441 , piece_id=2BQMK2SV7WRW6CHOWQP3TTFDF2WMAWLLRE2JLRK23GGICXIFWPWQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.611732463 (177h25m53.546186603s) [noise=true , address=145.79.227.35:4484 , piece_id=2KD6WZKUY6FRKRVSMZAQZPVNEX2IQUWORJP5JDFEDEGBTR57VHRQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.612359029 (177h25m53.546813169s) [seg_pos={0 0}, upload=155983]: Done begin upload segment.
Feb 25 05:42:48.612421514 (177h25m53.546875657s) [noise=true , address=45.91.116.12:4227 , piece_id=Z3CRDHRB6JI5UORE5SK67DUOFHS7XMMH6BI3BCFW2NPZ5LQH6NPA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613054414 (177h25m53.547508553s) [noise=true , address=45.91.116.9:4265 , piece_id=5X4OLVB2N2KF2FGLZDKITYNOTQJNZL6FOTIAXSQHDH6LBYLFXTZQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613355998 (177h25m53.547810141s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613532091 (177h25m53.547986232s) [noise=true , address=145.79.227.18:4006 , piece_id=DS5EW7KKKU5CU5O7VYQRRDXCEWGI4Y3Y2Z25QN4HHAVBQYOCKOZQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613794842 (177h25m53.54824898s) [noise=true , address=45.91.116.10:4081 , piece_id=3WSJADPR2XXP4CVQETVEN5YHFLLNW6YUID7LNXUZ2XBABSVHHIAA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.613829958 (177h25m53.548284096s) [noise=true , address=145.79.227.27:4693 , piece_id=PN7EPCO4RNEAS3NJSUBCZO2J6V7M4NGC4SPM2GPLMRU47V3WUURA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614174057 (177h25m53.548628196s) [noise=true , address=145.79.227.9:4369 , piece_id=PMJ4E2UO7Q5GWSKOYS2GVNH5OS2TIUHQ5VLDHNSETJMZJTUOKWGA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614745799 (177h25m53.549199935s) [noise=true , address=145.79.227.47:4269 , piece_id=E4MZNWLH5OKXYWRSOPRVXIIIENKTJUZS7OMAF7EHA4X66AZ6MAIQ, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.614781600 (177h25m53.549235737s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:48.615598548 (177h25m53.55005269s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Uploading piece...
Feb 25 05:42:49.219849344 (177h25m54.154303478s) [upload=155983]: Next returned nil segment
Feb 25 05:42:49.219863932 (177h25m54.154318065s) [upload=155983]: Waiting for error group managing segments...
Feb 25 05:42:49.355130909 (177h25m54.289585042s) [noise=true , address=45.91.116.9:4265 , piece_id=5X4OLVB2N2KF2FGLZDKITYNOTQJNZL6FOTIAXSQHDH6LBYLFXTZQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.355538432 (177h25m54.289992565s) [noise=true , address=45.91.116.12:4227 , piece_id=Z3CRDHRB6JI5UORE5SK67DUOFHS7XMMH6BI3BCFW2NPZ5LQH6NPA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.356496709 (177h25m54.290950841s) [noise=true , address=145.79.227.8:4330 , piece_id=5G3NFIJXYPK2BRZCO34FXIIUFQISLNZMF5GE6LYHXPOOTKVK7P4A, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.357623689 (177h25m54.29207782s) [noise=true , address=145.79.227.9:4369 , piece_id=PMJ4E2UO7Q5GWSKOYS2GVNH5OS2TIUHQ5VLDHNSETJMZJTUOKWGA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.358496015 (177h25m54.292950148s) [noise=true , address=145.79.227.47:4269 , piece_id=E4MZNWLH5OKXYWRSOPRVXIIIENKTJUZS7OMAF7EHA4X66AZ6MAIQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.359168638 (177h25m54.293622769s) [noise=true , address=145.79.227.27:4693 , piece_id=PN7EPCO4RNEAS3NJSUBCZO2J6V7M4NGC4SPM2GPLMRU47V3WUURA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.360018880 (177h25m54.294473013s) [noise=true , address=145.79.227.35:4484 , piece_id=2KD6WZKUY6FRKRVSMZAQZPVNEX2IQUWORJP5JDFEDEGBTR57VHRQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.362336397 (177h25m54.296790529s) [noise=true , address=145.79.227.20:4441 , piece_id=2BQMK2SV7WRW6CHOWQP3TTFDF2WMAWLLRE2JLRK23GGICXIFWPWQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.367837052 (177h25m54.302291185s) [noise=true , address=145.79.227.18:4006 , piece_id=DS5EW7KKKU5CU5O7VYQRRDXCEWGI4Y3Y2Z25QN4HHAVBQYOCKOZQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370090577 (177h25m54.304544716s) [noise=true , address=45.91.116.10:4081 , piece_id=3WSJADPR2XXP4CVQETVEN5YHFLLNW6YUID7LNXUZ2XBABSVHHIAA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370196164 (177h25m54.304650305s) [noise=true , address=145.79.227.5:4224 , piece_id=SW7UZB267DX7PPJUSFD2OQERUDEQZSZJAHMLO3LDWZVNK4IF6KXQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.370933003 (177h25m54.305387143s) [noise=true , address=145.79.227.6:4260 , piece_id=KJ4JM2DPHDFAWJDW5QZGSYOGYOWFSJUDXYWPUZKZWEV3QIOIKEVQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.376133367 (177h25m54.310587499s) [noise=true , address=145.79.227.50:4375 , piece_id=5HSR37ZLO3NTMTKBLOWC2ABNQHKE25VMS6HLZ2CMUUPE5QIGZQGA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: <nil>
Feb 25 05:42:49.376157312 (177h25m54.310611447s) [seg_pos={0 0}, upload=155983]: Satisfied cohort requirements after 13 pieces
Feb 25 05:42:49.376426106 (177h25m54.310880247s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376438581 (177h25m54.310892718s) [noise=true , address=145.79.227.24:4582 , piece_id=GL2T4E4VGMDSIUYRSOYUABXI3NVOQU7HYHED6FXPKEM27LOD6CGQ, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376449477 (177h25m54.310903618s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G13M5QwzW2uRcXeNnFWFPkyHj5xSkReGmqrNheT16fUKZwsp3): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376461110 (177h25m54.310915243s) [noise=true , address=79.127.219.46:4889 , piece_id=255HO7C4QUNCP7W7I7HCF5SAAHH4I3CJUF2WL5JH7ZUEDZBPC6YA, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376688720 (177h25m54.311142862s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ULUPKjJwZocjV1R6Dy7vmWSrZ4hKx3YAHLAihgtMKf8Uw2UgA): protocol: expected piece hash; context canceled; EOF
Feb 25 05:42:49.376702626 (177h25m54.311156768s) [noise=true , address=145.79.227.43:4159 , piece_id=4I4RGC2UIOY6P2QHZQAUAXJQ775UMGWSBVAZ3VH4ZRWDC3D4VD6A, seg_pos={0 0}, upload=155983]: Long tail cancellation due to optimal threshold
Feb 25 05:42:49.376740965 (177h25m54.3111951s) [seg_pos={0 0}, upload=155983]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 25 05:42:49.376835784 (177h25m54.311289916s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 25 05:42:49.376841584 (177h25m54.311295716s) [upload=155983]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 25 05:42:49.521783892 (177h25m54.456238024s) [upload=155983]: Done uploading segments...
Feb 25 05:42:49.521820652 (177h25m54.456274791s) [upload=155983]: Upload finished. err: <nil>
Duration: 2.318559837s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
303.535432ms remote:
"tcp:45.38.24.2:443" response headers:
X-Amz-Request-Id=189768C95BFE9168 X-Request-Id=g4uBHxViUEu Date=Wed, 25 Feb 2026 06:16:32 GMT Content-Length=284 Content-Type=application/xml X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/2f3e5e36c1448bf1
FAIL (2026-02-25 06:16:32 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189768C95BFE9168</RequestId><HostId></HostId></Error>"
Duration: 303.63312ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.766458ms remote:
"tcp:185.244.226.3:443" response headers:
Vary=Origin X-Request-Id=jNoRckCwBM8 Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=189768C6F4D34E11 X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 06:16:22 GMT Accept-Ranges=bytes Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/5d689dc4b77c3ad7
FAIL (2026-02-25 06:16:22 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189768C6F4D34E11</RequestId><HostId></HostId></Error>"
Duration: 7.791681ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.929106ms remote:
"tcp:185.244.226.3:443" response headers:
Date=Wed, 25 Feb 2026 06:16:06 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=TkcfpgPqBRb Content-Length=274 Server=Storj Vary=Origin X-Amz-Request-Id=189768C33A430122 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/1c8d64eb17bc7488
FAIL (2026-02-25 06:16:06 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189768C33A430122</RequestId><HostId></HostId></Error>"
Duration: 9.949067ms
edge
gateway
vhost
bgp
ap1
|