Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
15.080966ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Server=Storj Vary=Origin Date=Tue, 24 Feb 2026 19:16:38 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=189744C6A747F9CB X-Request-Id=SSPApf7k8FL X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/56fcddc57ac24bf4
FAIL (2026-02-24 19:16:38 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744C6A747F9CB</RequestId><HostId></HostId></Error>"
Duration: 15.115178ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
17 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXX.X..........................................] duration:
2.355313242s trace:
https://jaeger.dev.storj.io/trace/34cb6d1b452f899e
FAIL (2026-02-24 19:16:37 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:46:10.298604913 (166h29m15.233059039s) [upload=146328]: Starting upload
Feb 24 18:46:10.298694572 (166h29m15.233148698s) [upload=146328]: Done starting upload
Feb 24 18:46:10.298808673 (166h29m15.2332628s) [upload=146328]: Uploading segments...
Feb 24 18:46:10.299060123 (166h29m15.233514248s) [upload=146328]: Got next segment. Inline: false
Feb 24 18:46:10.299127664 (166h29m15.233581869s) [upload=146328]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:46:10.299134965 (166h29m15.233589103s) [upload=146328]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 24 18:46:14.386535467 (166h29m19.320989591s) [seg_pos={0 0}, upload=146328]: Begin upload segment...
Feb 24 18:46:14.386609320 (166h29m19.321063443s) [seg_pos={0 0}, upload=146328]: Done begin upload segment.
Feb 24 18:46:14.386651770 (166h29m19.321105909s) [noise=true , address=79.127.219.41:4926 , piece_id=3MVRZCJRS4LCD5BCG2BNROH6YZLMY36KGVNGKZ3PR3662TMHGOHQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.386689137 (166h29m19.321143279s) [noise=true , address=145.79.227.9:4366 , piece_id=TP2ZYWRAS2TEU2DFFTCNMIZZLJ7ORZQJQ4YMFGKEIKTV5B2NDPZQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.387262604 (166h29m19.321716739s) [noise=true , address=145.79.227.26:4656 , piece_id=QWFLUSXVFYVWFFPC3KL5NUM325VJUF2G7L4VQ3MFVYQH5VOAKXQQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.387281978 (166h29m19.321736111s) [noise=true , address=145.79.227.13:4803 , piece_id=UHSHD5LU6FPNYTLJC7R2N47VODLCO6G4LBUSA24NK2HI4TQI7NNA, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.387684997 (166h29m19.322139139s) [noise=true , address=77.90.31.13:4626 , piece_id=SCL3JYHW2LTOHXBCMOS6XA7CIDK6UKFWDHDDACABM3IUVS4KJXPQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.387758959 (166h29m19.322213091s) [noise=true , address=145.79.227.7:4293 , piece_id=PUILSZ2JFEXXCQE3TXPLTM4RAUYEQ6WLQKUPPGFSDBKLEYVBUJVQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.388076578 (166h29m19.32253071s) [noise=true , address=145.79.227.17:4972 , piece_id=BK7RYKZEK43T6E5PDP4BQFU5FSD5GPFPDA6IFMLDBBK24IURPKRQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.388338636 (166h29m19.322792779s) [noise=true , address=145.79.227.19:4077 , piece_id=FUZVWTJIOR5X6NN5W53FSQSDCWZ7H7NTUP7QR7ZD77OLCMGNF3BQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.388522986 (166h29m19.322977124s) [noise=true , address=79.127.219.38:4817 , piece_id=VSDJRVJRSZRXKAGGXBPMCVUIJZR4OE3WFTQM44EG5QGCBYF6EKHA, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.388955917 (166h29m19.323410053s) [noise=true , address=145.79.227.39:4018 , piece_id=AEXOUAJGZBAHJQZGUQ54JLKQZTMYXNW55FPQUA2DDISFVRZLJWKA, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.388962547 (166h29m19.323416671s) [noise=true , address=145.79.227.42:4125 , piece_id=VW5NSROAUYOPDHQKBQAAOSZJVCBXX7MA5VZNDBBQHOC6WPJJO3TQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.389487579 (166h29m19.323941717s) [noise=true , address=145.79.227.3:4155 , piece_id=OGUK5XPPX6GJXKWJO4APHD2P2H6QLPCYGZKLYJGHNAFPJV3JBHAQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.389656635 (166h29m19.324110777s) [noise=true , address=145.79.227.45:4234 , piece_id=NIKILNGW7SNYD5G4FLW3MDGR36PR36OBUTWVXKHNX3PN3I7PDJXA, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.389904102 (166h29m19.324358239s) [noise=true , address=77.90.31.17:4770 , piece_id=G6GOXLZFNFPSOAOKUZ576KVWUH7VVGTUKP6YELJNYA6QKSQ6V43Q, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.390173491 (166h29m19.324627638s) [noise=true , address=45.91.116.10:4084 , piece_id=B3T4IS2GQGE3672YMZBH573JV5UNAXBH6MTMHBCQQDH6YRGDDSOQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.390680007 (166h29m19.325134143s) [noise=true , address=77.90.31.15:4700 , piece_id=RXMZF53ZHZARKQF5YXWLJT7TWQOJWVW3F4GT3OBS6FYG3BP2AANA, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.999552917 (166h29m19.934007055s) [upload=146328]: Next returned nil segment
Feb 24 18:46:14.999572659 (166h29m19.934026808s) [upload=146328]: Waiting for error group managing segments...
Feb 24 18:46:15.133573664 (166h29m20.068027806s) [noise=true , address=145.79.227.19:4077 , piece_id=FUZVWTJIOR5X6NN5W53FSQSDCWZ7H7NTUP7QR7ZD77OLCMGNF3BQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.135121334 (166h29m20.069575489s) [noise=true , address=145.79.227.13:4803 , piece_id=UHSHD5LU6FPNYTLJC7R2N47VODLCO6G4LBUSA24NK2HI4TQI7NNA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.135808911 (166h29m20.070263048s) [noise=true , address=145.79.227.3:4155 , piece_id=OGUK5XPPX6GJXKWJO4APHD2P2H6QLPCYGZKLYJGHNAFPJV3JBHAQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.136063429 (166h29m20.070517571s) [noise=true , address=45.91.116.10:4084 , piece_id=B3T4IS2GQGE3672YMZBH573JV5UNAXBH6MTMHBCQQDH6YRGDDSOQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.147571506 (166h29m20.08202564s) [noise=true , address=145.79.227.42:4125 , piece_id=VW5NSROAUYOPDHQKBQAAOSZJVCBXX7MA5VZNDBBQHOC6WPJJO3TQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.152125874 (166h29m20.086580008s) [noise=true , address=145.79.227.7:4293 , piece_id=PUILSZ2JFEXXCQE3TXPLTM4RAUYEQ6WLQKUPPGFSDBKLEYVBUJVQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.156384278 (166h29m20.090838414s) [noise=true , address=145.79.227.39:4018 , piece_id=AEXOUAJGZBAHJQZGUQ54JLKQZTMYXNW55FPQUA2DDISFVRZLJWKA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.156878029 (166h29m20.091332164s) [noise=true , address=145.79.227.9:4366 , piece_id=TP2ZYWRAS2TEU2DFFTCNMIZZLJ7ORZQJQ4YMFGKEIKTV5B2NDPZQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.158388008 (166h29m20.092842152s) [noise=true , address=145.79.227.45:4234 , piece_id=NIKILNGW7SNYD5G4FLW3MDGR36PR36OBUTWVXKHNX3PN3I7PDJXA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.158969175 (166h29m20.09342331s) [noise=true , address=145.79.227.17:4972 , piece_id=BK7RYKZEK43T6E5PDP4BQFU5FSD5GPFPDA6IFMLDBBK24IURPKRQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.161901086 (166h29m20.096355222s) [noise=true , address=79.127.219.41:4926 , piece_id=3MVRZCJRS4LCD5BCG2BNROH6YZLMY36KGVNGKZ3PR3662TMHGOHQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.167562010 (166h29m20.102016148s) [noise=true , address=79.127.219.38:4817 , piece_id=VSDJRVJRSZRXKAGGXBPMCVUIJZR4OE3WFTQM44EG5QGCBYF6EKHA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.197064489 (166h29m20.131518639s) [noise=true , address=77.90.31.13:4626 , piece_id=SCL3JYHW2LTOHXBCMOS6XA7CIDK6UKFWDHDDACABM3IUVS4KJXPQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.197191533 (166h29m20.131645675s) [seg_pos={0 0}, upload=146328]: Satisfied cohort requirements after 13 pieces
Feb 24 18:46:15.197465113 (166h29m20.131919257s) [noise=true , address=145.79.227.26:4656 , piece_id=QWFLUSXVFYVWFFPC3KL5NUM325VJUF2G7L4VQ3MFVYQH5VOAKXQQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u6e2ZjrPg2q3EDN2ZjDj9hzEmCAoRvt39HMeM79gcVmMVm53j): protocol: expected piece hash; context canceled; EOF
Feb 24 18:46:15.197478634 (166h29m20.131932777s) [noise=true , address=145.79.227.26:4656 , piece_id=QWFLUSXVFYVWFFPC3KL5NUM325VJUF2G7L4VQ3MFVYQH5VOAKXQQ, seg_pos={0 0}, upload=146328]: Long tail cancellation due to optimal threshold
Feb 24 18:46:15.197655516 (166h29m20.13210966s) [noise=true , address=77.90.31.17:4770 , piece_id=G6GOXLZFNFPSOAOKUZ576KVWUH7VVGTUKP6YELJNYA6QKSQ6V43Q, seg_pos={0 0}, upload=146328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Feb 24 18:46:15.197666194 (166h29m20.132120336s) [noise=true , address=77.90.31.17:4770 , piece_id=G6GOXLZFNFPSOAOKUZ576KVWUH7VVGTUKP6YELJNYA6QKSQ6V43Q, seg_pos={0 0}, upload=146328]: Long tail cancellation due to optimal threshold
Feb 24 18:46:15.197767092 (166h29m20.132221229s) [noise=true , address=77.90.31.15:4700 , piece_id=RXMZF53ZHZARKQF5YXWLJT7TWQOJWVW3F4GT3OBS6FYG3BP2AANA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q): protocol: expected piece hash; context canceled; EOF
Feb 24 18:46:15.197783861 (166h29m20.132237994s) [noise=true , address=77.90.31.15:4700 , piece_id=RXMZF53ZHZARKQF5YXWLJT7TWQOJWVW3F4GT3OBS6FYG3BP2AANA, seg_pos={0 0}, upload=146328]: Long tail cancellation due to optimal threshold
Feb 24 18:46:15.197815694 (166h29m20.132269813s) [seg_pos={0 0}, upload=146328]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 24 18:46:15.197905836 (166h29m20.132359971s) [upload=146328]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 24 18:46:15.197936276 (166h29m20.132390411s) [upload=146328]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:46:25.272856749 (166h29m30.207310871s) [upload=146328]: Done uploading segments...
Feb 24 18:46:25.272890825 (166h29m30.207344961s) [upload=146328]: Upload finished. err: <nil>
Duration: 2.355345391s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)antiblip:
8 out of 60 is failed (threshold=6) [XXX.XX.XXX..................................................] duration:
111.877557ms remote:
"tcp:185.244.226.4:443" target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/43ad6243e9f92940
FAIL (2026-02-24 19:16:37 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 111.906239ms
edge
linksharing
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.38568ms remote:
"tcp:185.244.226.3:443" response headers:
X-Amz-Request-Id=189744C4A8E63040 X-Request-Id=EaTmqV8V76p Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 19:16:29 GMT Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/f067db1afa31d07
FAIL (2026-02-24 19:16:29 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744C4A8E63040</RequestId><HostId></HostId></Error>"
Duration: 8.432124ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
13 out of 60 is failed (threshold=3) [XXXXXXXXXXXX...X............................................] duration:
2.509889095s trace:
https://jaeger.dev.storj.io/trace/5f0b31811a3a7df8
FAIL (2026-02-24 19:16:25 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 2.509922341s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
13 out of 60 is failed (threshold=3) [XXXXXXXXXXXXX...............................................] duration:
2.861056799s trace:
https://jaeger.dev.storj.io/trace/73cef0d4f8588a82
FAIL (2026-02-24 19:16:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Feb 24 18:42:40.331706604 (166h25m45.266160746s) [upload=146280]: Starting upload Feb 24 18:42:40.331826626 (166h25m45.266280764s) [upload=146280]: Done starting upload Feb 24 18:42:40.331904481 (166h25m45.266358598s) [upload=146280]: Uploading segments... Feb 24 18:42:40.332266211 (166h25m45.266720352s) [upload=146280]: Got next segment. Inline: false Feb 24 18:42:40.332351248 (166h25m45.266805381s) [upload=146280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:42:40.332357321 (166h25m45.266811453s) [upload=146280]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Feb 24 18:43:40.022165933 (166h26m44.956620058s) [upload=146280]: Next segment err: context deadline exceeded Feb 24 18:43:40.022586871 (166h26m44.957040994s) [upload=146280]: Done uploading segments... Feb 24 18:43:40.022728565 (166h26m44.957182691s) [upload=146280]: Upload finished. err: context deadline exceeded
Duration: 2.86107781s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
15 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXX.............................................] duration:
1.117368834s trace:
https://jaeger.dev.storj.io/trace/10dc5f232dfe5501
FAIL (2026-02-24 19:16:20 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.117404807s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
18 out of 60 is failed (threshold=3) [XXXXXXXXXXXX.XXXX.XX........................................] duration:
932.876399ms trace:
https://jaeger.dev.storj.io/trace/672241cb7c0a47f8
FAIL (2026-02-24 19:16:18 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 932.935584ms
core
uplink
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
15 out of 60 is failed (threshold=6) [X...X.XX.XXXX..XX.XX...X............................X...X...] duration:
1.628487488s trace:
https://jaeger.dev.storj.io/trace/3b928fb003180502
FAIL (2026-02-24 19:16:12 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.628515072s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
14 out of 60 is failed (threshold=3) [XXXXXXXXXXXXX...X...........................................] duration:
2.164418914s trace:
https://jaeger.dev.storj.io/trace/5f0b31811a3a7df8
FAIL (2026-02-24 19:16:03 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 2.164668272s
core
uplink
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.386589ms remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=189744BE88E4D32E Date=Tue, 24 Feb 2026 19:16:03 GMT Vary=Origin X-Request-Id=Hp2W1S1wp5X X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/1d858252c2974ba8
FAIL (2026-02-24 19:16:03 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744BE88E4D32E</RequestId><HostId></HostId></Error>"
Duration: 11.434128ms
edge
gateway
vhost
bgp
eu1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
19 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXX.........................................] duration:
2.914369868s trace:
https://jaeger.dev.storj.io/trace/30d8e2a6a3198912
FAIL (2026-02-24 19:16:03 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.914414823s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
297.195424ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 19:16:00 GMT Accept-Ranges=bytes X-Amz-Request-Id=189744BDDD4FA887 X-Request-Id=BwxTUMuN9eE Content-Length=284 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/7b1155a485a9728
FAIL (2026-02-24 19:16:00 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744BDDD4FA887</RequestId><HostId></HostId></Error>"
Duration: 297.298687ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
16 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXX............................................] duration:
892.788247ms trace:
https://jaeger.dev.storj.io/trace/10dc5f232dfe5501
FAIL (2026-02-24 19:15:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 892.892044ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
19 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXX.XXX.X.......................................] duration:
971.590393ms trace:
https://jaeger.dev.storj.io/trace/c2303a2d8cc4559
FAIL (2026-02-24 19:15:58 UTC)
orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:46:25.455945314 (166h29m30.390399449s) [upload=146330]: Starting upload Feb 24 18:46:25.456028421 (166h29m30.390482554s) [upload=146330]: Done starting upload Feb 24 18:46:25.456183000 (166h29m30.390637123s) [upload=146330]: Uploading segments... Feb 24 18:46:25.456241745 (166h29m30.390695879s) [upload=146330]: Got next segment. Inline: true Feb 24 18:46:25.456248406 (166h29m30.390702538s) [upload=146330]: Waiting for error group managing segments... Feb 24 18:46:25.456313221 (166h29m30.390767353s) [upload=146330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:46:25.456318913 (166h29m30.390773046s) [upload=146330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Feb 24 18:46:25.456322453 (166h29m30.390776585s) [upload=146330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Feb 24 18:46:42.336159913 (166h29m47.270614055s) [upload=146330]: Done uploading segments... Feb 24 18:46:42.336191328 (166h29m47.270645479s) [upload=146330]: Upload finished. err: <nil>
Duration: 971.622876ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
15 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXX.............................................] duration:
949.498577ms trace:
https://jaeger.dev.storj.io/trace/7ebec86835c4464b
FAIL (2026-02-24 19:15:48 UTC)
orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:43:06.746940362 (166h26m11.681394495s) [upload=146286]: Starting upload Feb 24 18:43:06.747106775 (166h26m11.681560915s) [upload=146286]: Done starting upload Feb 24 18:43:06.747390196 (166h26m11.681844318s) [upload=146286]: Uploading segments... Feb 24 18:43:06.747735916 (166h26m11.682190059s) [upload=146286]: Got next segment. Inline: true Feb 24 18:43:06.747744937 (166h26m11.682199074s) [upload=146286]: Waiting for error group managing segments... Feb 24 18:43:06.747919695 (166h26m11.682373826s) [upload=146286]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:43:06.747926018 (166h26m11.68238015s) [upload=146286]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Feb 24 18:43:06.747929848 (166h26m11.68238398s) [upload=146286]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Feb 24 18:43:47.388785505 (166h26m52.32323964s) [upload=146286]: Done uploading segments... Feb 24 18:43:47.388809684 (166h26m52.323263817s) [upload=146286]: Upload finished. err: <nil>
Duration: 949.526918ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
14 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXX..............................................] duration:
5.247918695s trace:
https://jaeger.dev.storj.io/trace/73cef0d4f8588a82
FAIL (2026-02-24 19:15:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Feb 24 18:42:40.331706604 (166h25m45.266160746s) [upload=146280]: Starting upload Feb 24 18:42:40.331826626 (166h25m45.266280764s) [upload=146280]: Done starting upload Feb 24 18:42:40.331904481 (166h25m45.266358598s) [upload=146280]: Uploading segments... Feb 24 18:42:40.332266211 (166h25m45.266720352s) [upload=146280]: Got next segment. Inline: false Feb 24 18:42:40.332351248 (166h25m45.266805381s) [upload=146280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:42:40.332357321 (166h25m45.266811453s) [upload=146280]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Feb 24 18:43:40.022165933 (166h26m44.956620058s) [upload=146280]: Next segment err: context deadline exceeded Feb 24 18:43:40.022586871 (166h26m44.957040994s) [upload=146280]: Done uploading segments... Feb 24 18:43:40.022728565 (166h26m44.957182691s) [upload=146280]: Upload finished. err: context deadline exceeded
Duration: 5.247941301s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
18 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXX.X.........................................] duration:
2.498169102s trace:
https://jaeger.dev.storj.io/trace/34cb6d1b452f899e
FAIL (2026-02-24 19:15:40 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:46:10.298604913 (166h29m15.233059039s) [upload=146328]: Starting upload
Feb 24 18:46:10.298694572 (166h29m15.233148698s) [upload=146328]: Done starting upload
Feb 24 18:46:10.298808673 (166h29m15.2332628s) [upload=146328]: Uploading segments...
Feb 24 18:46:10.299060123 (166h29m15.233514248s) [upload=146328]: Got next segment. Inline: false
Feb 24 18:46:10.299127664 (166h29m15.233581869s) [upload=146328]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:46:10.299134965 (166h29m15.233589103s) [upload=146328]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 24 18:46:14.386535467 (166h29m19.320989591s) [seg_pos={0 0}, upload=146328]: Begin upload segment...
Feb 24 18:46:14.386609320 (166h29m19.321063443s) [seg_pos={0 0}, upload=146328]: Done begin upload segment.
Feb 24 18:46:14.386651770 (166h29m19.321105909s) [noise=true , address=79.127.219.41:4926 , piece_id=3MVRZCJRS4LCD5BCG2BNROH6YZLMY36KGVNGKZ3PR3662TMHGOHQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.386689137 (166h29m19.321143279s) [noise=true , address=145.79.227.9:4366 , piece_id=TP2ZYWRAS2TEU2DFFTCNMIZZLJ7ORZQJQ4YMFGKEIKTV5B2NDPZQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.387262604 (166h29m19.321716739s) [noise=true , address=145.79.227.26:4656 , piece_id=QWFLUSXVFYVWFFPC3KL5NUM325VJUF2G7L4VQ3MFVYQH5VOAKXQQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.387281978 (166h29m19.321736111s) [noise=true , address=145.79.227.13:4803 , piece_id=UHSHD5LU6FPNYTLJC7R2N47VODLCO6G4LBUSA24NK2HI4TQI7NNA, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.387684997 (166h29m19.322139139s) [noise=true , address=77.90.31.13:4626 , piece_id=SCL3JYHW2LTOHXBCMOS6XA7CIDK6UKFWDHDDACABM3IUVS4KJXPQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.387758959 (166h29m19.322213091s) [noise=true , address=145.79.227.7:4293 , piece_id=PUILSZ2JFEXXCQE3TXPLTM4RAUYEQ6WLQKUPPGFSDBKLEYVBUJVQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.388076578 (166h29m19.32253071s) [noise=true , address=145.79.227.17:4972 , piece_id=BK7RYKZEK43T6E5PDP4BQFU5FSD5GPFPDA6IFMLDBBK24IURPKRQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.388338636 (166h29m19.322792779s) [noise=true , address=145.79.227.19:4077 , piece_id=FUZVWTJIOR5X6NN5W53FSQSDCWZ7H7NTUP7QR7ZD77OLCMGNF3BQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.388522986 (166h29m19.322977124s) [noise=true , address=79.127.219.38:4817 , piece_id=VSDJRVJRSZRXKAGGXBPMCVUIJZR4OE3WFTQM44EG5QGCBYF6EKHA, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.388955917 (166h29m19.323410053s) [noise=true , address=145.79.227.39:4018 , piece_id=AEXOUAJGZBAHJQZGUQ54JLKQZTMYXNW55FPQUA2DDISFVRZLJWKA, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.388962547 (166h29m19.323416671s) [noise=true , address=145.79.227.42:4125 , piece_id=VW5NSROAUYOPDHQKBQAAOSZJVCBXX7MA5VZNDBBQHOC6WPJJO3TQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.389487579 (166h29m19.323941717s) [noise=true , address=145.79.227.3:4155 , piece_id=OGUK5XPPX6GJXKWJO4APHD2P2H6QLPCYGZKLYJGHNAFPJV3JBHAQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.389656635 (166h29m19.324110777s) [noise=true , address=145.79.227.45:4234 , piece_id=NIKILNGW7SNYD5G4FLW3MDGR36PR36OBUTWVXKHNX3PN3I7PDJXA, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.389904102 (166h29m19.324358239s) [noise=true , address=77.90.31.17:4770 , piece_id=G6GOXLZFNFPSOAOKUZ576KVWUH7VVGTUKP6YELJNYA6QKSQ6V43Q, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.390173491 (166h29m19.324627638s) [noise=true , address=45.91.116.10:4084 , piece_id=B3T4IS2GQGE3672YMZBH573JV5UNAXBH6MTMHBCQQDH6YRGDDSOQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.390680007 (166h29m19.325134143s) [noise=true , address=77.90.31.15:4700 , piece_id=RXMZF53ZHZARKQF5YXWLJT7TWQOJWVW3F4GT3OBS6FYG3BP2AANA, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.999552917 (166h29m19.934007055s) [upload=146328]: Next returned nil segment
Feb 24 18:46:14.999572659 (166h29m19.934026808s) [upload=146328]: Waiting for error group managing segments...
Feb 24 18:46:15.133573664 (166h29m20.068027806s) [noise=true , address=145.79.227.19:4077 , piece_id=FUZVWTJIOR5X6NN5W53FSQSDCWZ7H7NTUP7QR7ZD77OLCMGNF3BQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.135121334 (166h29m20.069575489s) [noise=true , address=145.79.227.13:4803 , piece_id=UHSHD5LU6FPNYTLJC7R2N47VODLCO6G4LBUSA24NK2HI4TQI7NNA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.135808911 (166h29m20.070263048s) [noise=true , address=145.79.227.3:4155 , piece_id=OGUK5XPPX6GJXKWJO4APHD2P2H6QLPCYGZKLYJGHNAFPJV3JBHAQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.136063429 (166h29m20.070517571s) [noise=true , address=45.91.116.10:4084 , piece_id=B3T4IS2GQGE3672YMZBH573JV5UNAXBH6MTMHBCQQDH6YRGDDSOQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.147571506 (166h29m20.08202564s) [noise=true , address=145.79.227.42:4125 , piece_id=VW5NSROAUYOPDHQKBQAAOSZJVCBXX7MA5VZNDBBQHOC6WPJJO3TQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.152125874 (166h29m20.086580008s) [noise=true , address=145.79.227.7:4293 , piece_id=PUILSZ2JFEXXCQE3TXPLTM4RAUYEQ6WLQKUPPGFSDBKLEYVBUJVQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.156384278 (166h29m20.090838414s) [noise=true , address=145.79.227.39:4018 , piece_id=AEXOUAJGZBAHJQZGUQ54JLKQZTMYXNW55FPQUA2DDISFVRZLJWKA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.156878029 (166h29m20.091332164s) [noise=true , address=145.79.227.9:4366 , piece_id=TP2ZYWRAS2TEU2DFFTCNMIZZLJ7ORZQJQ4YMFGKEIKTV5B2NDPZQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.158388008 (166h29m20.092842152s) [noise=true , address=145.79.227.45:4234 , piece_id=NIKILNGW7SNYD5G4FLW3MDGR36PR36OBUTWVXKHNX3PN3I7PDJXA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.158969175 (166h29m20.09342331s) [noise=true , address=145.79.227.17:4972 , piece_id=BK7RYKZEK43T6E5PDP4BQFU5FSD5GPFPDA6IFMLDBBK24IURPKRQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.161901086 (166h29m20.096355222s) [noise=true , address=79.127.219.41:4926 , piece_id=3MVRZCJRS4LCD5BCG2BNROH6YZLMY36KGVNGKZ3PR3662TMHGOHQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.167562010 (166h29m20.102016148s) [noise=true , address=79.127.219.38:4817 , piece_id=VSDJRVJRSZRXKAGGXBPMCVUIJZR4OE3WFTQM44EG5QGCBYF6EKHA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.197064489 (166h29m20.131518639s) [noise=true , address=77.90.31.13:4626 , piece_id=SCL3JYHW2LTOHXBCMOS6XA7CIDK6UKFWDHDDACABM3IUVS4KJXPQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.197191533 (166h29m20.131645675s) [seg_pos={0 0}, upload=146328]: Satisfied cohort requirements after 13 pieces
Feb 24 18:46:15.197465113 (166h29m20.131919257s) [noise=true , address=145.79.227.26:4656 , piece_id=QWFLUSXVFYVWFFPC3KL5NUM325VJUF2G7L4VQ3MFVYQH5VOAKXQQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u6e2ZjrPg2q3EDN2ZjDj9hzEmCAoRvt39HMeM79gcVmMVm53j): protocol: expected piece hash; context canceled; EOF
Feb 24 18:46:15.197478634 (166h29m20.131932777s) [noise=true , address=145.79.227.26:4656 , piece_id=QWFLUSXVFYVWFFPC3KL5NUM325VJUF2G7L4VQ3MFVYQH5VOAKXQQ, seg_pos={0 0}, upload=146328]: Long tail cancellation due to optimal threshold
Feb 24 18:46:15.197655516 (166h29m20.13210966s) [noise=true , address=77.90.31.17:4770 , piece_id=G6GOXLZFNFPSOAOKUZ576KVWUH7VVGTUKP6YELJNYA6QKSQ6V43Q, seg_pos={0 0}, upload=146328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Feb 24 18:46:15.197666194 (166h29m20.132120336s) [noise=true , address=77.90.31.17:4770 , piece_id=G6GOXLZFNFPSOAOKUZ576KVWUH7VVGTUKP6YELJNYA6QKSQ6V43Q, seg_pos={0 0}, upload=146328]: Long tail cancellation due to optimal threshold
Feb 24 18:46:15.197767092 (166h29m20.132221229s) [noise=true , address=77.90.31.15:4700 , piece_id=RXMZF53ZHZARKQF5YXWLJT7TWQOJWVW3F4GT3OBS6FYG3BP2AANA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q): protocol: expected piece hash; context canceled; EOF
Feb 24 18:46:15.197783861 (166h29m20.132237994s) [noise=true , address=77.90.31.15:4700 , piece_id=RXMZF53ZHZARKQF5YXWLJT7TWQOJWVW3F4GT3OBS6FYG3BP2AANA, seg_pos={0 0}, upload=146328]: Long tail cancellation due to optimal threshold
Feb 24 18:46:15.197815694 (166h29m20.132269813s) [seg_pos={0 0}, upload=146328]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 24 18:46:15.197905836 (166h29m20.132359971s) [upload=146328]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 24 18:46:15.197936276 (166h29m20.132390411s) [upload=146328]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:46:25.272856749 (166h29m30.207310871s) [upload=146328]: Done uploading segments...
Feb 24 18:46:25.272890825 (166h29m30.207344961s) [upload=146328]: Upload finished. err: <nil>
Duration: 2.498264446s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.912757ms remote:
"tcp:185.244.226.3:443" response headers:
X-Amz-Request-Id=189744B91218D23C X-Request-Id=4tKCDwgkeWv Date=Tue, 24 Feb 2026 19:15:40 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Xss-Protection=1; mode=block Content-Type=application/xml Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/22b0b04964a32928
FAIL (2026-02-24 19:15:40 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744B91218D23C</RequestId><HostId></HostId></Error>"
Duration: 8.94372ms
edge
gateway
vhost
bgp
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
19 out of 60 is failed (threshold=3) [.XXXXXXXXXXXXXXXXXXX........................................] duration:
2.868516868s trace:
https://jaeger.dev.storj.io/trace/30d8e2a6a3198912
FAIL (2026-02-24 19:15:40 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.868536383s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
17 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXX...........................................] duration:
979.162205ms trace:
https://jaeger.dev.storj.io/trace/10dc5f232dfe5501
FAIL (2026-02-24 19:15:38 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 979.210146ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)antiblip:
9 out of 60 is failed (threshold=6) [XXXX.XX.XXX.................................................] duration:
111.473301ms remote:
"tcp:185.244.226.4:443" target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/43ad6243e9f92940
FAIL (2026-02-24 19:15:34 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 111.504983ms
edge
linksharing
bgp
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
14 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXX..............................................] duration:
2.780626888s trace:
https://jaeger.dev.storj.io/trace/7fde6e39a6e83ecb
FAIL (2026-02-24 19:15:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.780655576s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
19 out of 60 is failed (threshold=3) [XXXXXXXXXXXXX.XXXX.XX.......................................] duration:
896.021054ms trace:
https://jaeger.dev.storj.io/trace/672241cb7c0a47f8
FAIL (2026-02-24 19:15:30 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 896.050004ms
core
uplink
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.605169ms remote:
"tcp:185.244.226.3:443" response headers:
Vary=Origin X-Xss-Protection=1; mode=block Content-Length=274 Server=Storj X-Amz-Request-Id=189744B5ED344ECC X-Request-Id=YdCD7GG2Lm3 Date=Tue, 24 Feb 2026 19:15:26 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/5b0e489056541ab1
FAIL (2026-02-24 19:15:26 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744B5ED344ECC</RequestId><HostId></HostId></Error>"
Duration: 7.634055ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
15 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXX...X..........................................] duration:
2.677232748s trace:
https://jaeger.dev.storj.io/trace/5f0b31811a3a7df8
FAIL (2026-02-24 19:15:23 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 2.677257064s
core
uplink
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
20 out of 60 is failed (threshold=3) [X.XXXXXXXXXXXXXXXXXXX.......................................] duration:
2.77225301s trace:
https://jaeger.dev.storj.io/trace/30d8e2a6a3198912
FAIL (2026-02-24 19:15:23 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.772276785s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
15 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXX.............................................] duration:
3.249635324s trace:
https://jaeger.dev.storj.io/trace/73cef0d4f8588a82
FAIL (2026-02-24 19:15:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Feb 24 18:42:40.331706604 (166h25m45.266160746s) [upload=146280]: Starting upload Feb 24 18:42:40.331826626 (166h25m45.266280764s) [upload=146280]: Done starting upload Feb 24 18:42:40.331904481 (166h25m45.266358598s) [upload=146280]: Uploading segments... Feb 24 18:42:40.332266211 (166h25m45.266720352s) [upload=146280]: Got next segment. Inline: false Feb 24 18:42:40.332351248 (166h25m45.266805381s) [upload=146280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:42:40.332357321 (166h25m45.266811453s) [upload=146280]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Feb 24 18:43:40.022165933 (166h26m44.956620058s) [upload=146280]: Next segment err: context deadline exceeded Feb 24 18:43:40.022586871 (166h26m44.957040994s) [upload=146280]: Done uploading segments... Feb 24 18:43:40.022728565 (166h26m44.957182691s) [upload=146280]: Upload finished. err: context deadline exceeded
Duration: 3.249666217s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.265006ms remote:
"tcp:185.244.226.3:443" response headers:
X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=189744B3AE4DB633 Date=Tue, 24 Feb 2026 19:15:16 GMT Content-Length=274 Content-Type=application/xml Vary=Origin X-Request-Id=MYzJVxsopaC target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/7ad7e0b61e5a58bf
FAIL (2026-02-24 19:15:16 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744B3AE4DB633</RequestId><HostId></HostId></Error>"
Duration: 11.288708ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
320.852966ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Vary=Origin X-Amz-Request-Id=189744B203463073 X-Request-Id=QX2etPKRmGo X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 19:15:09 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/13609ea9476a4928
FAIL (2026-02-24 19:15:09 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744B203463073</RequestId><HostId></HostId></Error>"
Duration: 320.903557ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
16 out of 60 is failed (threshold=6) [XX...X.XX.XXXX..XX.XX...X............................X...X..] duration:
1.679998824s trace:
https://jaeger.dev.storj.io/trace/3b928fb003180502
FAIL (2026-02-24 19:15:08 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.680030663s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
18 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXX..........................................] duration:
1.013739155s trace:
https://jaeger.dev.storj.io/trace/10dc5f232dfe5501
FAIL (2026-02-24 19:15:08 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.013945782s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
16 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXX...X.........................................] duration:
2.254214819s trace:
https://jaeger.dev.storj.io/trace/5f0b31811a3a7df8
FAIL (2026-02-24 19:15:06 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 2.254249297s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
20 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXX.XXXX.XX......................................] duration:
969.720408ms trace:
https://jaeger.dev.storj.io/trace/672241cb7c0a47f8
FAIL (2026-02-24 19:15:05 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 969.825673ms
core
uplink
us1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)antiblip:
10 out of 60 is failed (threshold=6) [XXXXX.XX.XXX................................................] duration:
113.21616ms remote:
"tcp:185.244.226.4:443" target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/43ad6243e9f92940
FAIL (2026-02-24 19:15:01 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 113.335519ms
edge
linksharing
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
16 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXX............................................] duration:
2.478008274s trace:
https://jaeger.dev.storj.io/trace/73cef0d4f8588a82
FAIL (2026-02-24 19:14:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Feb 24 18:42:40.331706604 (166h25m45.266160746s) [upload=146280]: Starting upload Feb 24 18:42:40.331826626 (166h25m45.266280764s) [upload=146280]: Done starting upload Feb 24 18:42:40.331904481 (166h25m45.266358598s) [upload=146280]: Uploading segments... Feb 24 18:42:40.332266211 (166h25m45.266720352s) [upload=146280]: Got next segment. Inline: false Feb 24 18:42:40.332351248 (166h25m45.266805381s) [upload=146280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:42:40.332357321 (166h25m45.266811453s) [upload=146280]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Feb 24 18:43:40.022165933 (166h26m44.956620058s) [upload=146280]: Next segment err: context deadline exceeded Feb 24 18:43:40.022586871 (166h26m44.957040994s) [upload=146280]: Done uploading segments... Feb 24 18:43:40.022728565 (166h26m44.957182691s) [upload=146280]: Upload finished. err: context deadline exceeded
Duration: 2.478038119s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
16 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXX............................................] duration:
904.805222ms trace:
https://jaeger.dev.storj.io/trace/7ebec86835c4464b
FAIL (2026-02-24 19:14:58 UTC)
orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:43:06.746940362 (166h26m11.681394495s) [upload=146286]: Starting upload Feb 24 18:43:06.747106775 (166h26m11.681560915s) [upload=146286]: Done starting upload Feb 24 18:43:06.747390196 (166h26m11.681844318s) [upload=146286]: Uploading segments... Feb 24 18:43:06.747735916 (166h26m11.682190059s) [upload=146286]: Got next segment. Inline: true Feb 24 18:43:06.747744937 (166h26m11.682199074s) [upload=146286]: Waiting for error group managing segments... Feb 24 18:43:06.747919695 (166h26m11.682373826s) [upload=146286]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:43:06.747926018 (166h26m11.68238015s) [upload=146286]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Feb 24 18:43:06.747929848 (166h26m11.68238398s) [upload=146286]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Feb 24 18:43:47.388785505 (166h26m52.32323964s) [upload=146286]: Done uploading segments... Feb 24 18:43:47.388809684 (166h26m52.323263817s) [upload=146286]: Upload finished. err: <nil>
Duration: 904.851484ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
20 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXX.XXX.X......................................] duration:
909.117939ms trace:
https://jaeger.dev.storj.io/trace/c2303a2d8cc4559
FAIL (2026-02-24 19:14:56 UTC)
orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:46:25.455945314 (166h29m30.390399449s) [upload=146330]: Starting upload Feb 24 18:46:25.456028421 (166h29m30.390482554s) [upload=146330]: Done starting upload Feb 24 18:46:25.456183000 (166h29m30.390637123s) [upload=146330]: Uploading segments... Feb 24 18:46:25.456241745 (166h29m30.390695879s) [upload=146330]: Got next segment. Inline: true Feb 24 18:46:25.456248406 (166h29m30.390702538s) [upload=146330]: Waiting for error group managing segments... Feb 24 18:46:25.456313221 (166h29m30.390767353s) [upload=146330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:46:25.456318913 (166h29m30.390773046s) [upload=146330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Feb 24 18:46:25.456322453 (166h29m30.390776585s) [upload=146330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Feb 24 18:46:42.336159913 (166h29m47.270614055s) [upload=146330]: Done uploading segments... Feb 24 18:46:42.336191328 (166h29m47.270645479s) [upload=146330]: Upload finished. err: <nil>
Duration: 909.145828ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.749219ms remote:
"tcp:185.244.226.3:443" response headers:
X-Amz-Request-Id=189744AE07FF0674 X-Request-Id=4PLgsM6fYPD Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 19:14:52 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/62a06b5987221c22
FAIL (2026-02-24 19:14:52 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744AE07FF0674</RequestId><HostId></HostId></Error>"
Duration: 7.783963ms
edge
gateway
vhost
bgp
ap1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
15 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXX.............................................] duration:
2.880033463s trace:
https://jaeger.dev.storj.io/trace/7fde6e39a6e83ecb
FAIL (2026-02-24 19:14:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.880063091s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.436534ms remote:
"tcp:185.244.226.3:443" response headers:
X-Request-Id=RPWATs5DCRr Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 19:14:48 GMT Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=189744AD0C720C0D target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/2c22e42cba4e3811
FAIL (2026-02-24 19:14:48 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744AD0C720C0D</RequestId><HostId></HostId></Error>"
Duration: 8.458996ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
19 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXX.X........................................] duration:
2.40915142s trace:
https://jaeger.dev.storj.io/trace/34cb6d1b452f899e
FAIL (2026-02-24 19:14:47 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:46:10.298604913 (166h29m15.233059039s) [upload=146328]: Starting upload
Feb 24 18:46:10.298694572 (166h29m15.233148698s) [upload=146328]: Done starting upload
Feb 24 18:46:10.298808673 (166h29m15.2332628s) [upload=146328]: Uploading segments...
Feb 24 18:46:10.299060123 (166h29m15.233514248s) [upload=146328]: Got next segment. Inline: false
Feb 24 18:46:10.299127664 (166h29m15.233581869s) [upload=146328]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:46:10.299134965 (166h29m15.233589103s) [upload=146328]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 24 18:46:14.386535467 (166h29m19.320989591s) [seg_pos={0 0}, upload=146328]: Begin upload segment...
Feb 24 18:46:14.386609320 (166h29m19.321063443s) [seg_pos={0 0}, upload=146328]: Done begin upload segment.
Feb 24 18:46:14.386651770 (166h29m19.321105909s) [noise=true , address=79.127.219.41:4926 , piece_id=3MVRZCJRS4LCD5BCG2BNROH6YZLMY36KGVNGKZ3PR3662TMHGOHQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.386689137 (166h29m19.321143279s) [noise=true , address=145.79.227.9:4366 , piece_id=TP2ZYWRAS2TEU2DFFTCNMIZZLJ7ORZQJQ4YMFGKEIKTV5B2NDPZQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.387262604 (166h29m19.321716739s) [noise=true , address=145.79.227.26:4656 , piece_id=QWFLUSXVFYVWFFPC3KL5NUM325VJUF2G7L4VQ3MFVYQH5VOAKXQQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.387281978 (166h29m19.321736111s) [noise=true , address=145.79.227.13:4803 , piece_id=UHSHD5LU6FPNYTLJC7R2N47VODLCO6G4LBUSA24NK2HI4TQI7NNA, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.387684997 (166h29m19.322139139s) [noise=true , address=77.90.31.13:4626 , piece_id=SCL3JYHW2LTOHXBCMOS6XA7CIDK6UKFWDHDDACABM3IUVS4KJXPQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.387758959 (166h29m19.322213091s) [noise=true , address=145.79.227.7:4293 , piece_id=PUILSZ2JFEXXCQE3TXPLTM4RAUYEQ6WLQKUPPGFSDBKLEYVBUJVQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.388076578 (166h29m19.32253071s) [noise=true , address=145.79.227.17:4972 , piece_id=BK7RYKZEK43T6E5PDP4BQFU5FSD5GPFPDA6IFMLDBBK24IURPKRQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.388338636 (166h29m19.322792779s) [noise=true , address=145.79.227.19:4077 , piece_id=FUZVWTJIOR5X6NN5W53FSQSDCWZ7H7NTUP7QR7ZD77OLCMGNF3BQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.388522986 (166h29m19.322977124s) [noise=true , address=79.127.219.38:4817 , piece_id=VSDJRVJRSZRXKAGGXBPMCVUIJZR4OE3WFTQM44EG5QGCBYF6EKHA, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.388955917 (166h29m19.323410053s) [noise=true , address=145.79.227.39:4018 , piece_id=AEXOUAJGZBAHJQZGUQ54JLKQZTMYXNW55FPQUA2DDISFVRZLJWKA, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.388962547 (166h29m19.323416671s) [noise=true , address=145.79.227.42:4125 , piece_id=VW5NSROAUYOPDHQKBQAAOSZJVCBXX7MA5VZNDBBQHOC6WPJJO3TQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.389487579 (166h29m19.323941717s) [noise=true , address=145.79.227.3:4155 , piece_id=OGUK5XPPX6GJXKWJO4APHD2P2H6QLPCYGZKLYJGHNAFPJV3JBHAQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.389656635 (166h29m19.324110777s) [noise=true , address=145.79.227.45:4234 , piece_id=NIKILNGW7SNYD5G4FLW3MDGR36PR36OBUTWVXKHNX3PN3I7PDJXA, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.389904102 (166h29m19.324358239s) [noise=true , address=77.90.31.17:4770 , piece_id=G6GOXLZFNFPSOAOKUZ576KVWUH7VVGTUKP6YELJNYA6QKSQ6V43Q, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.390173491 (166h29m19.324627638s) [noise=true , address=45.91.116.10:4084 , piece_id=B3T4IS2GQGE3672YMZBH573JV5UNAXBH6MTMHBCQQDH6YRGDDSOQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.390680007 (166h29m19.325134143s) [noise=true , address=77.90.31.15:4700 , piece_id=RXMZF53ZHZARKQF5YXWLJT7TWQOJWVW3F4GT3OBS6FYG3BP2AANA, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.999552917 (166h29m19.934007055s) [upload=146328]: Next returned nil segment
Feb 24 18:46:14.999572659 (166h29m19.934026808s) [upload=146328]: Waiting for error group managing segments...
Feb 24 18:46:15.133573664 (166h29m20.068027806s) [noise=true , address=145.79.227.19:4077 , piece_id=FUZVWTJIOR5X6NN5W53FSQSDCWZ7H7NTUP7QR7ZD77OLCMGNF3BQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.135121334 (166h29m20.069575489s) [noise=true , address=145.79.227.13:4803 , piece_id=UHSHD5LU6FPNYTLJC7R2N47VODLCO6G4LBUSA24NK2HI4TQI7NNA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.135808911 (166h29m20.070263048s) [noise=true , address=145.79.227.3:4155 , piece_id=OGUK5XPPX6GJXKWJO4APHD2P2H6QLPCYGZKLYJGHNAFPJV3JBHAQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.136063429 (166h29m20.070517571s) [noise=true , address=45.91.116.10:4084 , piece_id=B3T4IS2GQGE3672YMZBH573JV5UNAXBH6MTMHBCQQDH6YRGDDSOQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.147571506 (166h29m20.08202564s) [noise=true , address=145.79.227.42:4125 , piece_id=VW5NSROAUYOPDHQKBQAAOSZJVCBXX7MA5VZNDBBQHOC6WPJJO3TQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.152125874 (166h29m20.086580008s) [noise=true , address=145.79.227.7:4293 , piece_id=PUILSZ2JFEXXCQE3TXPLTM4RAUYEQ6WLQKUPPGFSDBKLEYVBUJVQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.156384278 (166h29m20.090838414s) [noise=true , address=145.79.227.39:4018 , piece_id=AEXOUAJGZBAHJQZGUQ54JLKQZTMYXNW55FPQUA2DDISFVRZLJWKA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.156878029 (166h29m20.091332164s) [noise=true , address=145.79.227.9:4366 , piece_id=TP2ZYWRAS2TEU2DFFTCNMIZZLJ7ORZQJQ4YMFGKEIKTV5B2NDPZQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.158388008 (166h29m20.092842152s) [noise=true , address=145.79.227.45:4234 , piece_id=NIKILNGW7SNYD5G4FLW3MDGR36PR36OBUTWVXKHNX3PN3I7PDJXA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.158969175 (166h29m20.09342331s) [noise=true , address=145.79.227.17:4972 , piece_id=BK7RYKZEK43T6E5PDP4BQFU5FSD5GPFPDA6IFMLDBBK24IURPKRQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.161901086 (166h29m20.096355222s) [noise=true , address=79.127.219.41:4926 , piece_id=3MVRZCJRS4LCD5BCG2BNROH6YZLMY36KGVNGKZ3PR3662TMHGOHQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.167562010 (166h29m20.102016148s) [noise=true , address=79.127.219.38:4817 , piece_id=VSDJRVJRSZRXKAGGXBPMCVUIJZR4OE3WFTQM44EG5QGCBYF6EKHA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.197064489 (166h29m20.131518639s) [noise=true , address=77.90.31.13:4626 , piece_id=SCL3JYHW2LTOHXBCMOS6XA7CIDK6UKFWDHDDACABM3IUVS4KJXPQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.197191533 (166h29m20.131645675s) [seg_pos={0 0}, upload=146328]: Satisfied cohort requirements after 13 pieces
Feb 24 18:46:15.197465113 (166h29m20.131919257s) [noise=true , address=145.79.227.26:4656 , piece_id=QWFLUSXVFYVWFFPC3KL5NUM325VJUF2G7L4VQ3MFVYQH5VOAKXQQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u6e2ZjrPg2q3EDN2ZjDj9hzEmCAoRvt39HMeM79gcVmMVm53j): protocol: expected piece hash; context canceled; EOF
Feb 24 18:46:15.197478634 (166h29m20.131932777s) [noise=true , address=145.79.227.26:4656 , piece_id=QWFLUSXVFYVWFFPC3KL5NUM325VJUF2G7L4VQ3MFVYQH5VOAKXQQ, seg_pos={0 0}, upload=146328]: Long tail cancellation due to optimal threshold
Feb 24 18:46:15.197655516 (166h29m20.13210966s) [noise=true , address=77.90.31.17:4770 , piece_id=G6GOXLZFNFPSOAOKUZ576KVWUH7VVGTUKP6YELJNYA6QKSQ6V43Q, seg_pos={0 0}, upload=146328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Feb 24 18:46:15.197666194 (166h29m20.132120336s) [noise=true , address=77.90.31.17:4770 , piece_id=G6GOXLZFNFPSOAOKUZ576KVWUH7VVGTUKP6YELJNYA6QKSQ6V43Q, seg_pos={0 0}, upload=146328]: Long tail cancellation due to optimal threshold
Feb 24 18:46:15.197767092 (166h29m20.132221229s) [noise=true , address=77.90.31.15:4700 , piece_id=RXMZF53ZHZARKQF5YXWLJT7TWQOJWVW3F4GT3OBS6FYG3BP2AANA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q): protocol: expected piece hash; context canceled; EOF
Feb 24 18:46:15.197783861 (166h29m20.132237994s) [noise=true , address=77.90.31.15:4700 , piece_id=RXMZF53ZHZARKQF5YXWLJT7TWQOJWVW3F4GT3OBS6FYG3BP2AANA, seg_pos={0 0}, upload=146328]: Long tail cancellation due to optimal threshold
Feb 24 18:46:15.197815694 (166h29m20.132269813s) [seg_pos={0 0}, upload=146328]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 24 18:46:15.197905836 (166h29m20.132359971s) [upload=146328]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 24 18:46:15.197936276 (166h29m20.132390411s) [upload=146328]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:46:25.272856749 (166h29m30.207310871s) [upload=146328]: Done uploading segments...
Feb 24 18:46:25.272890825 (166h29m30.207344961s) [upload=146328]: Upload finished. err: <nil>
Duration: 2.409182776s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
16 out of 60 is failed (threshold=6) [.XX...X.XX.XXXX..XX.XX...X............................X...X.] duration:
1.644996461s trace:
https://jaeger.dev.storj.io/trace/3b928fb003180502
FAIL (2026-02-24 19:14:47 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.645054041s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
322.95801ms remote:
"tcp:45.38.24.2:443" response headers:
Date=Tue, 24 Feb 2026 19:14:45 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=189744AC7460E384 X-Request-Id=Q6eKDt8Etef Content-Length=284 Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/1772c301151136a6
FAIL (2026-02-24 19:14:45 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744AC7460E384</RequestId><HostId></HostId></Error>"
Duration: 322.994598ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)antiblip:
10 out of 60 is failed (threshold=6) [.XXXXX.XX.XXX...............................................] duration:
118.235902ms remote:
"tcp:185.244.226.4:443" target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/43ad6243e9f92940
FAIL (2026-02-24 19:14:44 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 118.267101ms
edge
linksharing
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
17 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXX...........................................] duration:
1.041086419s trace:
https://jaeger.dev.storj.io/trace/7ebec86835c4464b
FAIL (2026-02-24 19:14:36 UTC)
orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:43:06.746940362 (166h26m11.681394495s) [upload=146286]: Starting upload Feb 24 18:43:06.747106775 (166h26m11.681560915s) [upload=146286]: Done starting upload Feb 24 18:43:06.747390196 (166h26m11.681844318s) [upload=146286]: Uploading segments... Feb 24 18:43:06.747735916 (166h26m11.682190059s) [upload=146286]: Got next segment. Inline: true Feb 24 18:43:06.747744937 (166h26m11.682199074s) [upload=146286]: Waiting for error group managing segments... Feb 24 18:43:06.747919695 (166h26m11.682373826s) [upload=146286]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:43:06.747926018 (166h26m11.68238015s) [upload=146286]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Feb 24 18:43:06.747929848 (166h26m11.68238398s) [upload=146286]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Feb 24 18:43:47.388785505 (166h26m52.32323964s) [upload=146286]: Done uploading segments... Feb 24 18:43:47.388809684 (166h26m52.323263817s) [upload=146286]: Upload finished. err: <nil>
Duration: 1.041129455s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
21 out of 60 is failed (threshold=3) [XX.XXXXXXXXXXXXXXXXXXX......................................] duration:
2.697632846s trace:
https://jaeger.dev.storj.io/trace/30d8e2a6a3198912
FAIL (2026-02-24 19:14:36 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.697664988s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.488448ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin Date=Tue, 24 Feb 2026 19:14:33 GMT Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Amz-Request-Id=189744A982439FA9 X-Request-Id=HqCT3A9a17 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/7ad530f1f361ec15
FAIL (2026-02-24 19:14:33 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744A982439FA9</RequestId><HostId></HostId></Error>"
Duration: 8.558636ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
21 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXX.XXX.X.....................................] duration:
1.175972965s trace:
https://jaeger.dev.storj.io/trace/c2303a2d8cc4559
FAIL (2026-02-24 19:14:28 UTC)
orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:46:25.455945314 (166h29m30.390399449s) [upload=146330]: Starting upload Feb 24 18:46:25.456028421 (166h29m30.390482554s) [upload=146330]: Done starting upload Feb 24 18:46:25.456183000 (166h29m30.390637123s) [upload=146330]: Uploading segments... Feb 24 18:46:25.456241745 (166h29m30.390695879s) [upload=146330]: Got next segment. Inline: true Feb 24 18:46:25.456248406 (166h29m30.390702538s) [upload=146330]: Waiting for error group managing segments... Feb 24 18:46:25.456313221 (166h29m30.390767353s) [upload=146330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:46:25.456318913 (166h29m30.390773046s) [upload=146330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Feb 24 18:46:25.456322453 (166h29m30.390776585s) [upload=146330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Feb 24 18:46:42.336159913 (166h29m47.270614055s) [upload=146330]: Done uploading segments... Feb 24 18:46:42.336191328 (166h29m47.270645479s) [upload=146330]: Upload finished. err: <nil>
Duration: 1.176007969s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.015803ms remote:
"tcp:185.244.226.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin Date=Tue, 24 Feb 2026 19:14:27 GMT Content-Length=274 Content-Type=application/xml X-Amz-Request-Id=189744A824C8D749 X-Request-Id=eKJ9bXP5jKp X-Xss-Protection=1; mode=block Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/1985bf78e7033a21
FAIL (2026-02-24 19:14:27 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744A824C8D749</RequestId><HostId></HostId></Error>"
Duration: 8.036434ms
edge
gateway
vhost
bgp
us1
|