Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 18 out of 60 is failed (threshold=3) [....................................XXXXXXXXXXXXXXXXXX......] duration: 3.004008747s trace: https://jaeger.dev.storj.io/trace/73cef0d4f8588a82 FAIL (2026-02-24 18:47:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Feb 24 18:42:40.331706604 (166h25m45.266160746s) [upload=146280]: Starting upload Feb 24 18:42:40.331826626 (166h25m45.266280764s) [upload=146280]: Done starting upload Feb 24 18:42:40.331904481 (166h25m45.266358598s) [upload=146280]: Uploading segments... Feb 24 18:42:40.332266211 (166h25m45.266720352s) [upload=146280]: Got next segment. Inline: false Feb 24 18:42:40.332351248 (166h25m45.266805381s) [upload=146280]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 24 18:42:40.332357321 (166h25m45.266811453s) [upload=146280]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 24 18:43:40.022165933 (166h26m44.956620058s) [upload=146280]: Next segment err: context deadline exceeded Feb 24 18:43:40.022586871 (166h26m44.957040994s) [upload=146280]: Done uploading segments... Feb 24 18:43:40.022728565 (166h26m44.957182691s) [upload=146280]: Upload finished. err: context deadline exceeded Duration: 3.004036566s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 30 out of 60 is failed (threshold=3) [........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX......] duration: 3.405848967s trace: https://jaeger.dev.storj.io/trace/7fde6e39a6e83ecb FAIL (2026-02-24 18:47:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.405955605s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 37 out of 60 is failed (threshold=3) [....................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X..] duration: 2.70983435s trace: https://jaeger.dev.storj.io/trace/34cb6d1b452f899e FAIL (2026-02-24 18:47:40 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:46:10.298604913 (166h29m15.233059039s) [upload=146328]: Starting upload Feb 24 18:46:10.298694572 (166h29m15.233148698s) [upload=146328]: Done starting upload Feb 24 18:46:10.298808673 (166h29m15.2332628s) [upload=146328]: Uploading segments... Feb 24 18:46:10.299060123 (166h29m15.233514248s) [upload=146328]: Got next segment. Inline: false Feb 24 18:46:10.299127664 (166h29m15.233581869s) [upload=146328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 24 18:46:10.299134965 (166h29m15.233589103s) [upload=146328]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 24 18:46:14.386535467 (166h29m19.320989591s) [seg_pos={0 0}, upload=146328]: Begin upload segment... Feb 24 18:46:14.386609320 (166h29m19.321063443s) [seg_pos={0 0}, upload=146328]: Done begin upload segment. Feb 24 18:46:14.386651770 (166h29m19.321105909s) [noise=true , address=79.127.219.41:4926 , piece_id=3MVRZCJRS4LCD5BCG2BNROH6YZLMY36KGVNGKZ3PR3662TMHGOHQ, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.386689137 (166h29m19.321143279s) [noise=true , address=145.79.227.9:4366 , piece_id=TP2ZYWRAS2TEU2DFFTCNMIZZLJ7ORZQJQ4YMFGKEIKTV5B2NDPZQ, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.387262604 (166h29m19.321716739s) [noise=true , address=145.79.227.26:4656 , piece_id=QWFLUSXVFYVWFFPC3KL5NUM325VJUF2G7L4VQ3MFVYQH5VOAKXQQ, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.387281978 (166h29m19.321736111s) [noise=true , address=145.79.227.13:4803 , piece_id=UHSHD5LU6FPNYTLJC7R2N47VODLCO6G4LBUSA24NK2HI4TQI7NNA, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.387684997 (166h29m19.322139139s) [noise=true , address=77.90.31.13:4626 , piece_id=SCL3JYHW2LTOHXBCMOS6XA7CIDK6UKFWDHDDACABM3IUVS4KJXPQ, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.387758959 (166h29m19.322213091s) [noise=true , address=145.79.227.7:4293 , piece_id=PUILSZ2JFEXXCQE3TXPLTM4RAUYEQ6WLQKUPPGFSDBKLEYVBUJVQ, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.388076578 (166h29m19.32253071s) [noise=true , address=145.79.227.17:4972 , piece_id=BK7RYKZEK43T6E5PDP4BQFU5FSD5GPFPDA6IFMLDBBK24IURPKRQ, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.388338636 (166h29m19.322792779s) [noise=true , address=145.79.227.19:4077 , piece_id=FUZVWTJIOR5X6NN5W53FSQSDCWZ7H7NTUP7QR7ZD77OLCMGNF3BQ, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.388522986 (166h29m19.322977124s) [noise=true , address=79.127.219.38:4817 , piece_id=VSDJRVJRSZRXKAGGXBPMCVUIJZR4OE3WFTQM44EG5QGCBYF6EKHA, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.388955917 (166h29m19.323410053s) [noise=true , address=145.79.227.39:4018 , piece_id=AEXOUAJGZBAHJQZGUQ54JLKQZTMYXNW55FPQUA2DDISFVRZLJWKA, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.388962547 (166h29m19.323416671s) [noise=true , address=145.79.227.42:4125 , piece_id=VW5NSROAUYOPDHQKBQAAOSZJVCBXX7MA5VZNDBBQHOC6WPJJO3TQ, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.389487579 (166h29m19.323941717s) [noise=true , address=145.79.227.3:4155 , piece_id=OGUK5XPPX6GJXKWJO4APHD2P2H6QLPCYGZKLYJGHNAFPJV3JBHAQ, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.389656635 (166h29m19.324110777s) [noise=true , address=145.79.227.45:4234 , piece_id=NIKILNGW7SNYD5G4FLW3MDGR36PR36OBUTWVXKHNX3PN3I7PDJXA, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.389904102 (166h29m19.324358239s) [noise=true , address=77.90.31.17:4770 , piece_id=G6GOXLZFNFPSOAOKUZ576KVWUH7VVGTUKP6YELJNYA6QKSQ6V43Q, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.390173491 (166h29m19.324627638s) [noise=true , address=45.91.116.10:4084 , piece_id=B3T4IS2GQGE3672YMZBH573JV5UNAXBH6MTMHBCQQDH6YRGDDSOQ, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.390680007 (166h29m19.325134143s) [noise=true , address=77.90.31.15:4700 , piece_id=RXMZF53ZHZARKQF5YXWLJT7TWQOJWVW3F4GT3OBS6FYG3BP2AANA, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.999552917 (166h29m19.934007055s) [upload=146328]: Next returned nil segment Feb 24 18:46:14.999572659 (166h29m19.934026808s) [upload=146328]: Waiting for error group managing segments... Feb 24 18:46:15.133573664 (166h29m20.068027806s) [noise=true , address=145.79.227.19:4077 , piece_id=FUZVWTJIOR5X6NN5W53FSQSDCWZ7H7NTUP7QR7ZD77OLCMGNF3BQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.135121334 (166h29m20.069575489s) [noise=true , address=145.79.227.13:4803 , piece_id=UHSHD5LU6FPNYTLJC7R2N47VODLCO6G4LBUSA24NK2HI4TQI7NNA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.135808911 (166h29m20.070263048s) [noise=true , address=145.79.227.3:4155 , piece_id=OGUK5XPPX6GJXKWJO4APHD2P2H6QLPCYGZKLYJGHNAFPJV3JBHAQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.136063429 (166h29m20.070517571s) [noise=true , address=45.91.116.10:4084 , piece_id=B3T4IS2GQGE3672YMZBH573JV5UNAXBH6MTMHBCQQDH6YRGDDSOQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.147571506 (166h29m20.08202564s) [noise=true , address=145.79.227.42:4125 , piece_id=VW5NSROAUYOPDHQKBQAAOSZJVCBXX7MA5VZNDBBQHOC6WPJJO3TQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.152125874 (166h29m20.086580008s) [noise=true , address=145.79.227.7:4293 , piece_id=PUILSZ2JFEXXCQE3TXPLTM4RAUYEQ6WLQKUPPGFSDBKLEYVBUJVQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.156384278 (166h29m20.090838414s) [noise=true , address=145.79.227.39:4018 , piece_id=AEXOUAJGZBAHJQZGUQ54JLKQZTMYXNW55FPQUA2DDISFVRZLJWKA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.156878029 (166h29m20.091332164s) [noise=true , address=145.79.227.9:4366 , piece_id=TP2ZYWRAS2TEU2DFFTCNMIZZLJ7ORZQJQ4YMFGKEIKTV5B2NDPZQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.158388008 (166h29m20.092842152s) [noise=true , address=145.79.227.45:4234 , piece_id=NIKILNGW7SNYD5G4FLW3MDGR36PR36OBUTWVXKHNX3PN3I7PDJXA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.158969175 (166h29m20.09342331s) [noise=true , address=145.79.227.17:4972 , piece_id=BK7RYKZEK43T6E5PDP4BQFU5FSD5GPFPDA6IFMLDBBK24IURPKRQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.161901086 (166h29m20.096355222s) [noise=true , address=79.127.219.41:4926 , piece_id=3MVRZCJRS4LCD5BCG2BNROH6YZLMY36KGVNGKZ3PR3662TMHGOHQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.167562010 (166h29m20.102016148s) [noise=true , address=79.127.219.38:4817 , piece_id=VSDJRVJRSZRXKAGGXBPMCVUIJZR4OE3WFTQM44EG5QGCBYF6EKHA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.197064489 (166h29m20.131518639s) [noise=true , address=77.90.31.13:4626 , piece_id=SCL3JYHW2LTOHXBCMOS6XA7CIDK6UKFWDHDDACABM3IUVS4KJXPQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.197191533 (166h29m20.131645675s) [seg_pos={0 0}, upload=146328]: Satisfied cohort requirements after 13 pieces Feb 24 18:46:15.197465113 (166h29m20.131919257s) [noise=true , address=145.79.227.26:4656 , piece_id=QWFLUSXVFYVWFFPC3KL5NUM325VJUF2G7L4VQ3MFVYQH5VOAKXQQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u6e2ZjrPg2q3EDN2ZjDj9hzEmCAoRvt39HMeM79gcVmMVm53j): protocol: expected piece hash; context canceled; EOF Feb 24 18:46:15.197478634 (166h29m20.131932777s) [noise=true , address=145.79.227.26:4656 , piece_id=QWFLUSXVFYVWFFPC3KL5NUM325VJUF2G7L4VQ3MFVYQH5VOAKXQQ, seg_pos={0 0}, upload=146328]: Long tail cancellation due to optimal threshold Feb 24 18:46:15.197655516 (166h29m20.13210966s) [noise=true , address=77.90.31.17:4770 , piece_id=G6GOXLZFNFPSOAOKUZ576KVWUH7VVGTUKP6YELJNYA6QKSQ6V43Q, seg_pos={0 0}, upload=146328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Feb 24 18:46:15.197666194 (166h29m20.132120336s) [noise=true , address=77.90.31.17:4770 , piece_id=G6GOXLZFNFPSOAOKUZ576KVWUH7VVGTUKP6YELJNYA6QKSQ6V43Q, seg_pos={0 0}, upload=146328]: Long tail cancellation due to optimal threshold Feb 24 18:46:15.197767092 (166h29m20.132221229s) [noise=true , address=77.90.31.15:4700 , piece_id=RXMZF53ZHZARKQF5YXWLJT7TWQOJWVW3F4GT3OBS6FYG3BP2AANA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q): protocol: expected piece hash; context canceled; EOF Feb 24 18:46:15.197783861 (166h29m20.132237994s) [noise=true , address=77.90.31.15:4700 , piece_id=RXMZF53ZHZARKQF5YXWLJT7TWQOJWVW3F4GT3OBS6FYG3BP2AANA, seg_pos={0 0}, upload=146328]: Long tail cancellation due to optimal threshold Feb 24 18:46:15.197815694 (166h29m20.132269813s) [seg_pos={0 0}, upload=146328]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 24 18:46:15.197905836 (166h29m20.132359971s) [upload=146328]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 24 18:46:15.197936276 (166h29m20.132390411s) [upload=146328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 24 18:46:25.272856749 (166h29m30.207310871s) [upload=146328]: Done uploading segments... Feb 24 18:46:25.272890825 (166h29m30.207344961s) [upload=146328]: Upload finished. err: <nil> Duration: 2.709861584s core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 14.923945ms remote: "tcp:185.244.226.3:443" response headers: Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 18:47:39 GMT Content-Type=application/xml X-Amz-Request-Id=18974331C9349092 X-Request-Id=K3nnfsNtPpm target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace: https://jaeger.dev.storj.io/trace/204b046bcd560123 FAIL (2026-02-24 18:47:39 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18974331C9349092</RequestId><HostId></HostId></Error>" Duration: 14.951739ms edge gateway vhost bgp us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 39 out of 60 is failed (threshold=3) [................XXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXX....] duration: 2.739370559s trace: https://jaeger.dev.storj.io/trace/30d8e2a6a3198912 FAIL (2026-02-24 18:47:36 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.739404516s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 40 out of 60 is failed (threshold=3) [.................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...] duration: 3.582770718s trace: https://jaeger.dev.storj.io/trace/10dc5f232dfe5501 FAIL (2026-02-24 18:47:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.58287326s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 8.429794ms remote: "tcp:185.244.226.3:443" response headers: Server=Storj X-Amz-Request-Id=189743308E06BF79 X-Request-Id=ga23uniEht6 X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 18:47:34 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin Accept-Ranges=bytes Content-Type=application/xml target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/5589cf01522e102a FAIL (2026-02-24 18:47:34 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189743308E06BF79</RequestId><HostId></HostId></Error>" Duration: 8.462031ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 37 out of 60 is failed (threshold=3) [.....................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X.] duration: 22.496419664s trace: https://jaeger.dev.storj.io/trace/34cb6d1b452f899e FAIL (2026-02-24 18:47:28 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:46:10.298604913 (166h29m15.233059039s) [upload=146328]: Starting upload Feb 24 18:46:10.298694572 (166h29m15.233148698s) [upload=146328]: Done starting upload Feb 24 18:46:10.298808673 (166h29m15.2332628s) [upload=146328]: Uploading segments... Feb 24 18:46:10.299060123 (166h29m15.233514248s) [upload=146328]: Got next segment. Inline: false Feb 24 18:46:10.299127664 (166h29m15.233581869s) [upload=146328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 24 18:46:10.299134965 (166h29m15.233589103s) [upload=146328]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 24 18:46:14.386535467 (166h29m19.320989591s) [seg_pos={0 0}, upload=146328]: Begin upload segment... Feb 24 18:46:14.386609320 (166h29m19.321063443s) [seg_pos={0 0}, upload=146328]: Done begin upload segment. Feb 24 18:46:14.386651770 (166h29m19.321105909s) [noise=true , address=79.127.219.41:4926 , piece_id=3MVRZCJRS4LCD5BCG2BNROH6YZLMY36KGVNGKZ3PR3662TMHGOHQ, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.386689137 (166h29m19.321143279s) [noise=true , address=145.79.227.9:4366 , piece_id=TP2ZYWRAS2TEU2DFFTCNMIZZLJ7ORZQJQ4YMFGKEIKTV5B2NDPZQ, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.387262604 (166h29m19.321716739s) [noise=true , address=145.79.227.26:4656 , piece_id=QWFLUSXVFYVWFFPC3KL5NUM325VJUF2G7L4VQ3MFVYQH5VOAKXQQ, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.387281978 (166h29m19.321736111s) [noise=true , address=145.79.227.13:4803 , piece_id=UHSHD5LU6FPNYTLJC7R2N47VODLCO6G4LBUSA24NK2HI4TQI7NNA, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.387684997 (166h29m19.322139139s) [noise=true , address=77.90.31.13:4626 , piece_id=SCL3JYHW2LTOHXBCMOS6XA7CIDK6UKFWDHDDACABM3IUVS4KJXPQ, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.387758959 (166h29m19.322213091s) [noise=true , address=145.79.227.7:4293 , piece_id=PUILSZ2JFEXXCQE3TXPLTM4RAUYEQ6WLQKUPPGFSDBKLEYVBUJVQ, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.388076578 (166h29m19.32253071s) [noise=true , address=145.79.227.17:4972 , piece_id=BK7RYKZEK43T6E5PDP4BQFU5FSD5GPFPDA6IFMLDBBK24IURPKRQ, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.388338636 (166h29m19.322792779s) [noise=true , address=145.79.227.19:4077 , piece_id=FUZVWTJIOR5X6NN5W53FSQSDCWZ7H7NTUP7QR7ZD77OLCMGNF3BQ, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.388522986 (166h29m19.322977124s) [noise=true , address=79.127.219.38:4817 , piece_id=VSDJRVJRSZRXKAGGXBPMCVUIJZR4OE3WFTQM44EG5QGCBYF6EKHA, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.388955917 (166h29m19.323410053s) [noise=true , address=145.79.227.39:4018 , piece_id=AEXOUAJGZBAHJQZGUQ54JLKQZTMYXNW55FPQUA2DDISFVRZLJWKA, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.388962547 (166h29m19.323416671s) [noise=true , address=145.79.227.42:4125 , piece_id=VW5NSROAUYOPDHQKBQAAOSZJVCBXX7MA5VZNDBBQHOC6WPJJO3TQ, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.389487579 (166h29m19.323941717s) [noise=true , address=145.79.227.3:4155 , piece_id=OGUK5XPPX6GJXKWJO4APHD2P2H6QLPCYGZKLYJGHNAFPJV3JBHAQ, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.389656635 (166h29m19.324110777s) [noise=true , address=145.79.227.45:4234 , piece_id=NIKILNGW7SNYD5G4FLW3MDGR36PR36OBUTWVXKHNX3PN3I7PDJXA, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.389904102 (166h29m19.324358239s) [noise=true , address=77.90.31.17:4770 , piece_id=G6GOXLZFNFPSOAOKUZ576KVWUH7VVGTUKP6YELJNYA6QKSQ6V43Q, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.390173491 (166h29m19.324627638s) [noise=true , address=45.91.116.10:4084 , piece_id=B3T4IS2GQGE3672YMZBH573JV5UNAXBH6MTMHBCQQDH6YRGDDSOQ, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.390680007 (166h29m19.325134143s) [noise=true , address=77.90.31.15:4700 , piece_id=RXMZF53ZHZARKQF5YXWLJT7TWQOJWVW3F4GT3OBS6FYG3BP2AANA, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.999552917 (166h29m19.934007055s) [upload=146328]: Next returned nil segment Feb 24 18:46:14.999572659 (166h29m19.934026808s) [upload=146328]: Waiting for error group managing segments... Feb 24 18:46:15.133573664 (166h29m20.068027806s) [noise=true , address=145.79.227.19:4077 , piece_id=FUZVWTJIOR5X6NN5W53FSQSDCWZ7H7NTUP7QR7ZD77OLCMGNF3BQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.135121334 (166h29m20.069575489s) [noise=true , address=145.79.227.13:4803 , piece_id=UHSHD5LU6FPNYTLJC7R2N47VODLCO6G4LBUSA24NK2HI4TQI7NNA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.135808911 (166h29m20.070263048s) [noise=true , address=145.79.227.3:4155 , piece_id=OGUK5XPPX6GJXKWJO4APHD2P2H6QLPCYGZKLYJGHNAFPJV3JBHAQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.136063429 (166h29m20.070517571s) [noise=true , address=45.91.116.10:4084 , piece_id=B3T4IS2GQGE3672YMZBH573JV5UNAXBH6MTMHBCQQDH6YRGDDSOQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.147571506 (166h29m20.08202564s) [noise=true , address=145.79.227.42:4125 , piece_id=VW5NSROAUYOPDHQKBQAAOSZJVCBXX7MA5VZNDBBQHOC6WPJJO3TQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.152125874 (166h29m20.086580008s) [noise=true , address=145.79.227.7:4293 , piece_id=PUILSZ2JFEXXCQE3TXPLTM4RAUYEQ6WLQKUPPGFSDBKLEYVBUJVQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.156384278 (166h29m20.090838414s) [noise=true , address=145.79.227.39:4018 , piece_id=AEXOUAJGZBAHJQZGUQ54JLKQZTMYXNW55FPQUA2DDISFVRZLJWKA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.156878029 (166h29m20.091332164s) [noise=true , address=145.79.227.9:4366 , piece_id=TP2ZYWRAS2TEU2DFFTCNMIZZLJ7ORZQJQ4YMFGKEIKTV5B2NDPZQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.158388008 (166h29m20.092842152s) [noise=true , address=145.79.227.45:4234 , piece_id=NIKILNGW7SNYD5G4FLW3MDGR36PR36OBUTWVXKHNX3PN3I7PDJXA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.158969175 (166h29m20.09342331s) [noise=true , address=145.79.227.17:4972 , piece_id=BK7RYKZEK43T6E5PDP4BQFU5FSD5GPFPDA6IFMLDBBK24IURPKRQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.161901086 (166h29m20.096355222s) [noise=true , address=79.127.219.41:4926 , piece_id=3MVRZCJRS4LCD5BCG2BNROH6YZLMY36KGVNGKZ3PR3662TMHGOHQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.167562010 (166h29m20.102016148s) [noise=true , address=79.127.219.38:4817 , piece_id=VSDJRVJRSZRXKAGGXBPMCVUIJZR4OE3WFTQM44EG5QGCBYF6EKHA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.197064489 (166h29m20.131518639s) [noise=true , address=77.90.31.13:4626 , piece_id=SCL3JYHW2LTOHXBCMOS6XA7CIDK6UKFWDHDDACABM3IUVS4KJXPQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.197191533 (166h29m20.131645675s) [seg_pos={0 0}, upload=146328]: Satisfied cohort requirements after 13 pieces Feb 24 18:46:15.197465113 (166h29m20.131919257s) [noise=true , address=145.79.227.26:4656 , piece_id=QWFLUSXVFYVWFFPC3KL5NUM325VJUF2G7L4VQ3MFVYQH5VOAKXQQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u6e2ZjrPg2q3EDN2ZjDj9hzEmCAoRvt39HMeM79gcVmMVm53j): protocol: expected piece hash; context canceled; EOF Feb 24 18:46:15.197478634 (166h29m20.131932777s) [noise=true , address=145.79.227.26:4656 , piece_id=QWFLUSXVFYVWFFPC3KL5NUM325VJUF2G7L4VQ3MFVYQH5VOAKXQQ, seg_pos={0 0}, upload=146328]: Long tail cancellation due to optimal threshold Feb 24 18:46:15.197655516 (166h29m20.13210966s) [noise=true , address=77.90.31.17:4770 , piece_id=G6GOXLZFNFPSOAOKUZ576KVWUH7VVGTUKP6YELJNYA6QKSQ6V43Q, seg_pos={0 0}, upload=146328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Feb 24 18:46:15.197666194 (166h29m20.132120336s) [noise=true , address=77.90.31.17:4770 , piece_id=G6GOXLZFNFPSOAOKUZ576KVWUH7VVGTUKP6YELJNYA6QKSQ6V43Q, seg_pos={0 0}, upload=146328]: Long tail cancellation due to optimal threshold Feb 24 18:46:15.197767092 (166h29m20.132221229s) [noise=true , address=77.90.31.15:4700 , piece_id=RXMZF53ZHZARKQF5YXWLJT7TWQOJWVW3F4GT3OBS6FYG3BP2AANA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q): protocol: expected piece hash; context canceled; EOF Feb 24 18:46:15.197783861 (166h29m20.132237994s) [noise=true , address=77.90.31.15:4700 , piece_id=RXMZF53ZHZARKQF5YXWLJT7TWQOJWVW3F4GT3OBS6FYG3BP2AANA, seg_pos={0 0}, upload=146328]: Long tail cancellation due to optimal threshold Feb 24 18:46:15.197815694 (166h29m20.132269813s) [seg_pos={0 0}, upload=146328]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 24 18:46:15.197905836 (166h29m20.132359971s) [upload=146328]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 24 18:46:15.197936276 (166h29m20.132390411s) [upload=146328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 24 18:46:25.272856749 (166h29m30.207310871s) [upload=146328]: Done uploading segments... Feb 24 18:46:25.272890825 (166h29m30.207344961s) [upload=146328]: Upload finished. err: <nil> Duration: 22.496449291s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 43 out of 60 is failed (threshold=3) [..............XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXX.X.] duration: 1.273306474s trace: https://jaeger.dev.storj.io/trace/c2303a2d8cc4559 FAIL (2026-02-24 18:47:28 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:46:25.455945314 (166h29m30.390399449s) [upload=146330]: Starting upload Feb 24 18:46:25.456028421 (166h29m30.390482554s) [upload=146330]: Done starting upload Feb 24 18:46:25.456183000 (166h29m30.390637123s) [upload=146330]: Uploading segments... Feb 24 18:46:25.456241745 (166h29m30.390695879s) [upload=146330]: Got next segment. Inline: true Feb 24 18:46:25.456248406 (166h29m30.390702538s) [upload=146330]: Waiting for error group managing segments... Feb 24 18:46:25.456313221 (166h29m30.390767353s) [upload=146330]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 24 18:46:25.456318913 (166h29m30.390773046s) [upload=146330]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Feb 24 18:46:25.456322453 (166h29m30.390776585s) [upload=146330]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 24 18:46:42.336159913 (166h29m47.270614055s) [upload=146330]: Done uploading segments... Feb 24 18:46:42.336191328 (166h29m47.270645479s) [upload=146330]: Upload finished. err: <nil> Duration:* 1.27333352s core uplink us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 14 out of 60 is failed (threshold=6) [...................................XX.XX.XXXXX.XX.XXX.......] duration: 503.425062ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/43ad6243e9f92940 FAIL (2026-02-24 18:47:24 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 503.535345ms edge linksharing bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 10.155713ms remote: "tcp:185.244.226.3:443" response headers: Content-Length=274 Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=1897432E2A594306 X-Request-Id=6GnremcW7N4 Date=Tue, 24 Feb 2026 18:47:23 GMT Accept-Ranges=bytes target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace: https://jaeger.dev.storj.io/trace/25b45fee1d1197b7 FAIL (2026-02-24 18:47:23 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897432E2A594306</RequestId><HostId></HostId></Error>" Duration: 10.177594ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 40 out of 60 is failed (threshold=3) [................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXXX.XX..] duration: 959.112309ms trace: https://jaeger.dev.storj.io/trace/672241cb7c0a47f8 FAIL (2026-02-24 18:47:21 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 959.146082ms core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 39 out of 60 is failed (threshold=3) [.................XXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXX...] duration: 9.722095474s trace: https://jaeger.dev.storj.io/trace/30d8e2a6a3198912 FAIL (2026-02-24 18:47:10 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.722130854s edge gateway us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 14 out of 60 is failed (threshold=6) [....................................XX.XX.XXXXX.XX.XXX......] duration: 312.561174ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/43ad6243e9f92940 FAIL (2026-02-24 18:47:07 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 312.595406ms edge linksharing bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 12.327278ms remote: "tcp:185.244.226.3:443" response headers: X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 18:47:05 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml X-Request-Id=DqMiot6H4YZ Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18974329CB3B54EB target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/4689c94d7ffeb4cd FAIL (2026-02-24 18:47:05 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18974329CB3B54EB</RequestId><HostId></HostId></Error>" Duration: 12.352964ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 334.648522ms remote: "tcp:45.38.24.2:443" response headers: Content-Length=284 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 18:47:02 GMT Accept-Ranges=bytes Content-Type=application/xml X-Amz-Request-Id=18974329431527C3 X-Request-Id=A9u67zJYGVy target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace: https://jaeger.dev.storj.io/trace/5c8c7ba84374a4bb FAIL (2026-02-24 18:47:02 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18974329431527C3</RequestId><HostId></HostId></Error>" Duration: 334.79095ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 31 out of 60 is failed (threshold=3) [........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.....] duration: 929.572935ms trace: https://jaeger.dev.storj.io/trace/7ebec86835c4464b FAIL (2026-02-24 18:47:01 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:43:06.746940362 (166h26m11.681394495s) [upload=146286]: Starting upload Feb 24 18:43:06.747106775 (166h26m11.681560915s) [upload=146286]: Done starting upload Feb 24 18:43:06.747390196 (166h26m11.681844318s) [upload=146286]: Uploading segments... Feb 24 18:43:06.747735916 (166h26m11.682190059s) [upload=146286]: Got next segment. Inline: true Feb 24 18:43:06.747744937 (166h26m11.682199074s) [upload=146286]: Waiting for error group managing segments... Feb 24 18:43:06.747919695 (166h26m11.682373826s) [upload=146286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 24 18:43:06.747926018 (166h26m11.68238015s) [upload=146286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Feb 24 18:43:06.747929848 (166h26m11.68238398s) [upload=146286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 24 18:43:47.388785505 (166h26m52.32323964s) [upload=146286]: Done uploading segments... Feb 24 18:43:47.388809684 (166h26m52.323263817s) [upload=146286]: Upload finished. err: <nil> Duration:* 929.670822ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 42 out of 60 is failed (threshold=3) [..............XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...X.] duration: 2.461741293s trace: https://jaeger.dev.storj.io/trace/5f0b31811a3a7df8 FAIL (2026-02-24 18:46:58 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 2.461761462s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 30 out of 60 is failed (threshold=3) [.........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.....] duration: 11.034726226s trace: https://jaeger.dev.storj.io/trace/7fde6e39a6e83ecb FAIL (2026-02-24 18:46:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 11.034756176s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 42 out of 60 is failed (threshold=3) [...............XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...X] duration: 30.005880284s trace: https://jaeger.dev.storj.io/trace/5f0b31811a3a7df8 FAIL (2026-02-24 18:46:56 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 30.005908652s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 43 out of 60 is failed (threshold=3) [...............XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXX.X] duration: 30.00143108s trace: https://jaeger.dev.storj.io/trace/c2303a2d8cc4559 FAIL (2026-02-24 18:46:55 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:46:25.455945314 (166h29m30.390399449s) [upload=146330]: Starting upload Feb 24 18:46:25.456028421 (166h29m30.390482554s) [upload=146330]: Done starting upload Feb 24 18:46:25.456183000 (166h29m30.390637123s) [upload=146330]: Uploading segments... Feb 24 18:46:25.456241745 (166h29m30.390695879s) [upload=146330]: Got next segment. Inline: true Feb 24 18:46:25.456248406 (166h29m30.390702538s) [upload=146330]: Waiting for error group managing segments... Feb 24 18:46:25.456313221 (166h29m30.390767353s) [upload=146330]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 24 18:46:25.456318913 (166h29m30.390773046s) [upload=146330]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Feb 24 18:46:25.456322453 (166h29m30.390776585s) [upload=146330]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 24 18:46:42.336159913 (166h29m47.270614055s) [upload=146330]: Done uploading segments... Feb 24 18:46:42.336191328 (166h29m47.270645479s) [upload=146330]: Upload finished. err: <nil> Duration:* 30.001515055s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 40 out of 60 is failed (threshold=3) [..................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..] duration: 22.853993541s trace: https://jaeger.dev.storj.io/trace/10dc5f232dfe5501 FAIL (2026-02-24 18:46:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 22.854024093s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 18 out of 60 is failed (threshold=3) [.....................................XXXXXXXXXXXXXXXXXX.....] duration: 13.260030066s trace: https://jaeger.dev.storj.io/trace/73cef0d4f8588a82 FAIL (2026-02-24 18:46:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Feb 24 18:42:40.331706604 (166h25m45.266160746s) [upload=146280]: Starting upload Feb 24 18:42:40.331826626 (166h25m45.266280764s) [upload=146280]: Done starting upload Feb 24 18:42:40.331904481 (166h25m45.266358598s) [upload=146280]: Uploading segments... Feb 24 18:42:40.332266211 (166h25m45.266720352s) [upload=146280]: Got next segment. Inline: false Feb 24 18:42:40.332351248 (166h25m45.266805381s) [upload=146280]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 24 18:42:40.332357321 (166h25m45.266811453s) [upload=146280]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 24 18:43:40.022165933 (166h26m44.956620058s) [upload=146280]: Next segment err: context deadline exceeded Feb 24 18:43:40.022586871 (166h26m44.957040994s) [upload=146280]: Done uploading segments... Feb 24 18:43:40.022728565 (166h26m44.957182691s) [upload=146280]: Upload finished. err: context deadline exceeded Duration: 13.260052554s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 19 out of 60 is failed (threshold=6) [..X....X..XX..X.................X...XX...X.XX.XXXX..XX.XX...] duration: 2.944952741s trace: https://jaeger.dev.storj.io/trace/735f4b0581be18ee FAIL (2026-02-24 18:46:47 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.944988601s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 37 out of 60 is failed (threshold=3) [......................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X] duration: 30.003636843s trace: https://jaeger.dev.storj.io/trace/34cb6d1b452f899e FAIL (2026-02-24 18:46:39 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:46:10.298604913 (166h29m15.233059039s) [upload=146328]: Starting upload Feb 24 18:46:10.298694572 (166h29m15.233148698s) [upload=146328]: Done starting upload Feb 24 18:46:10.298808673 (166h29m15.2332628s) [upload=146328]: Uploading segments... Feb 24 18:46:10.299060123 (166h29m15.233514248s) [upload=146328]: Got next segment. Inline: false Feb 24 18:46:10.299127664 (166h29m15.233581869s) [upload=146328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 24 18:46:10.299134965 (166h29m15.233589103s) [upload=146328]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 24 18:46:14.386535467 (166h29m19.320989591s) [seg_pos={0 0}, upload=146328]: Begin upload segment... Feb 24 18:46:14.386609320 (166h29m19.321063443s) [seg_pos={0 0}, upload=146328]: Done begin upload segment. Feb 24 18:46:14.386651770 (166h29m19.321105909s) [noise=true , address=79.127.219.41:4926 , piece_id=3MVRZCJRS4LCD5BCG2BNROH6YZLMY36KGVNGKZ3PR3662TMHGOHQ, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.386689137 (166h29m19.321143279s) [noise=true , address=145.79.227.9:4366 , piece_id=TP2ZYWRAS2TEU2DFFTCNMIZZLJ7ORZQJQ4YMFGKEIKTV5B2NDPZQ, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.387262604 (166h29m19.321716739s) [noise=true , address=145.79.227.26:4656 , piece_id=QWFLUSXVFYVWFFPC3KL5NUM325VJUF2G7L4VQ3MFVYQH5VOAKXQQ, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.387281978 (166h29m19.321736111s) [noise=true , address=145.79.227.13:4803 , piece_id=UHSHD5LU6FPNYTLJC7R2N47VODLCO6G4LBUSA24NK2HI4TQI7NNA, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.387684997 (166h29m19.322139139s) [noise=true , address=77.90.31.13:4626 , piece_id=SCL3JYHW2LTOHXBCMOS6XA7CIDK6UKFWDHDDACABM3IUVS4KJXPQ, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.387758959 (166h29m19.322213091s) [noise=true , address=145.79.227.7:4293 , piece_id=PUILSZ2JFEXXCQE3TXPLTM4RAUYEQ6WLQKUPPGFSDBKLEYVBUJVQ, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.388076578 (166h29m19.32253071s) [noise=true , address=145.79.227.17:4972 , piece_id=BK7RYKZEK43T6E5PDP4BQFU5FSD5GPFPDA6IFMLDBBK24IURPKRQ, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.388338636 (166h29m19.322792779s) [noise=true , address=145.79.227.19:4077 , piece_id=FUZVWTJIOR5X6NN5W53FSQSDCWZ7H7NTUP7QR7ZD77OLCMGNF3BQ, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.388522986 (166h29m19.322977124s) [noise=true , address=79.127.219.38:4817 , piece_id=VSDJRVJRSZRXKAGGXBPMCVUIJZR4OE3WFTQM44EG5QGCBYF6EKHA, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.388955917 (166h29m19.323410053s) [noise=true , address=145.79.227.39:4018 , piece_id=AEXOUAJGZBAHJQZGUQ54JLKQZTMYXNW55FPQUA2DDISFVRZLJWKA, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.388962547 (166h29m19.323416671s) [noise=true , address=145.79.227.42:4125 , piece_id=VW5NSROAUYOPDHQKBQAAOSZJVCBXX7MA5VZNDBBQHOC6WPJJO3TQ, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.389487579 (166h29m19.323941717s) [noise=true , address=145.79.227.3:4155 , piece_id=OGUK5XPPX6GJXKWJO4APHD2P2H6QLPCYGZKLYJGHNAFPJV3JBHAQ, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.389656635 (166h29m19.324110777s) [noise=true , address=145.79.227.45:4234 , piece_id=NIKILNGW7SNYD5G4FLW3MDGR36PR36OBUTWVXKHNX3PN3I7PDJXA, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.389904102 (166h29m19.324358239s) [noise=true , address=77.90.31.17:4770 , piece_id=G6GOXLZFNFPSOAOKUZ576KVWUH7VVGTUKP6YELJNYA6QKSQ6V43Q, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.390173491 (166h29m19.324627638s) [noise=true , address=45.91.116.10:4084 , piece_id=B3T4IS2GQGE3672YMZBH573JV5UNAXBH6MTMHBCQQDH6YRGDDSOQ, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.390680007 (166h29m19.325134143s) [noise=true , address=77.90.31.15:4700 , piece_id=RXMZF53ZHZARKQF5YXWLJT7TWQOJWVW3F4GT3OBS6FYG3BP2AANA, seg_pos={0 0}, upload=146328]: Uploading piece... Feb 24 18:46:14.999552917 (166h29m19.934007055s) [upload=146328]: Next returned nil segment Feb 24 18:46:14.999572659 (166h29m19.934026808s) [upload=146328]: Waiting for error group managing segments... Feb 24 18:46:15.133573664 (166h29m20.068027806s) [noise=true , address=145.79.227.19:4077 , piece_id=FUZVWTJIOR5X6NN5W53FSQSDCWZ7H7NTUP7QR7ZD77OLCMGNF3BQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.135121334 (166h29m20.069575489s) [noise=true , address=145.79.227.13:4803 , piece_id=UHSHD5LU6FPNYTLJC7R2N47VODLCO6G4LBUSA24NK2HI4TQI7NNA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.135808911 (166h29m20.070263048s) [noise=true , address=145.79.227.3:4155 , piece_id=OGUK5XPPX6GJXKWJO4APHD2P2H6QLPCYGZKLYJGHNAFPJV3JBHAQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.136063429 (166h29m20.070517571s) [noise=true , address=45.91.116.10:4084 , piece_id=B3T4IS2GQGE3672YMZBH573JV5UNAXBH6MTMHBCQQDH6YRGDDSOQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.147571506 (166h29m20.08202564s) [noise=true , address=145.79.227.42:4125 , piece_id=VW5NSROAUYOPDHQKBQAAOSZJVCBXX7MA5VZNDBBQHOC6WPJJO3TQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.152125874 (166h29m20.086580008s) [noise=true , address=145.79.227.7:4293 , piece_id=PUILSZ2JFEXXCQE3TXPLTM4RAUYEQ6WLQKUPPGFSDBKLEYVBUJVQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.156384278 (166h29m20.090838414s) [noise=true , address=145.79.227.39:4018 , piece_id=AEXOUAJGZBAHJQZGUQ54JLKQZTMYXNW55FPQUA2DDISFVRZLJWKA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.156878029 (166h29m20.091332164s) [noise=true , address=145.79.227.9:4366 , piece_id=TP2ZYWRAS2TEU2DFFTCNMIZZLJ7ORZQJQ4YMFGKEIKTV5B2NDPZQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.158388008 (166h29m20.092842152s) [noise=true , address=145.79.227.45:4234 , piece_id=NIKILNGW7SNYD5G4FLW3MDGR36PR36OBUTWVXKHNX3PN3I7PDJXA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.158969175 (166h29m20.09342331s) [noise=true , address=145.79.227.17:4972 , piece_id=BK7RYKZEK43T6E5PDP4BQFU5FSD5GPFPDA6IFMLDBBK24IURPKRQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.161901086 (166h29m20.096355222s) [noise=true , address=79.127.219.41:4926 , piece_id=3MVRZCJRS4LCD5BCG2BNROH6YZLMY36KGVNGKZ3PR3662TMHGOHQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.167562010 (166h29m20.102016148s) [noise=true , address=79.127.219.38:4817 , piece_id=VSDJRVJRSZRXKAGGXBPMCVUIJZR4OE3WFTQM44EG5QGCBYF6EKHA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.197064489 (166h29m20.131518639s) [noise=true , address=77.90.31.13:4626 , piece_id=SCL3JYHW2LTOHXBCMOS6XA7CIDK6UKFWDHDDACABM3IUVS4KJXPQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil> Feb 24 18:46:15.197191533 (166h29m20.131645675s) [seg_pos={0 0}, upload=146328]: Satisfied cohort requirements after 13 pieces Feb 24 18:46:15.197465113 (166h29m20.131919257s) [noise=true , address=145.79.227.26:4656 , piece_id=QWFLUSXVFYVWFFPC3KL5NUM325VJUF2G7L4VQ3MFVYQH5VOAKXQQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u6e2ZjrPg2q3EDN2ZjDj9hzEmCAoRvt39HMeM79gcVmMVm53j): protocol: expected piece hash; context canceled; EOF Feb 24 18:46:15.197478634 (166h29m20.131932777s) [noise=true , address=145.79.227.26:4656 , piece_id=QWFLUSXVFYVWFFPC3KL5NUM325VJUF2G7L4VQ3MFVYQH5VOAKXQQ, seg_pos={0 0}, upload=146328]: Long tail cancellation due to optimal threshold Feb 24 18:46:15.197655516 (166h29m20.13210966s) [noise=true , address=77.90.31.17:4770 , piece_id=G6GOXLZFNFPSOAOKUZ576KVWUH7VVGTUKP6YELJNYA6QKSQ6V43Q, seg_pos={0 0}, upload=146328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Feb 24 18:46:15.197666194 (166h29m20.132120336s) [noise=true , address=77.90.31.17:4770 , piece_id=G6GOXLZFNFPSOAOKUZ576KVWUH7VVGTUKP6YELJNYA6QKSQ6V43Q, seg_pos={0 0}, upload=146328]: Long tail cancellation due to optimal threshold Feb 24 18:46:15.197767092 (166h29m20.132221229s) [noise=true , address=77.90.31.15:4700 , piece_id=RXMZF53ZHZARKQF5YXWLJT7TWQOJWVW3F4GT3OBS6FYG3BP2AANA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q): protocol: expected piece hash; context canceled; EOF Feb 24 18:46:15.197783861 (166h29m20.132237994s) [noise=true , address=77.90.31.15:4700 , piece_id=RXMZF53ZHZARKQF5YXWLJT7TWQOJWVW3F4GT3OBS6FYG3BP2AANA, seg_pos={0 0}, upload=146328]: Long tail cancellation due to optimal threshold Feb 24 18:46:15.197815694 (166h29m20.132269813s) [seg_pos={0 0}, upload=146328]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 24 18:46:15.197905836 (166h29m20.132359971s) [upload=146328]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 24 18:46:15.197936276 (166h29m20.132390411s) [upload=146328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 24 18:46:25.272856749 (166h29m30.207310871s) [upload=146328]: Done uploading segments... Feb 24 18:46:25.272890825 (166h29m30.207344961s) [upload=146328]: Upload finished. err: <nil> Duration: 30.003664309s core uplink us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 14 out of 60 is failed (threshold=6) [.....................................XX.XX.XXXXX.XX.XXX.....] duration: 10.941622622s remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/43ad6243e9f92940 FAIL (2026-02-24 18:46:37 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 10.941669308s edge linksharing bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 8.789025ms remote: "tcp:185.244.226.3:443" response headers: Vary=Origin X-Amz-Request-Id=1897432344B6F284 Content-Type=application/xml X-Request-Id=dNErbAbPvw4 X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 18:46:37 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/4b9c7cb0e7f1be41 FAIL (2026-02-24 18:46:37 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897432344B6F284</RequestId><HostId></HostId></Error>" Duration: 8.820236ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 31 out of 60 is failed (threshold=3) [.........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX....] duration: 27.408205394s trace: https://jaeger.dev.storj.io/trace/7ebec86835c4464b FAIL (2026-02-24 18:46:36 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:43:06.746940362 (166h26m11.681394495s) [upload=146286]: Starting upload Feb 24 18:43:06.747106775 (166h26m11.681560915s) [upload=146286]: Done starting upload Feb 24 18:43:06.747390196 (166h26m11.681844318s) [upload=146286]: Uploading segments... Feb 24 18:43:06.747735916 (166h26m11.682190059s) [upload=146286]: Got next segment. Inline: true Feb 24 18:43:06.747744937 (166h26m11.682199074s) [upload=146286]: Waiting for error group managing segments... Feb 24 18:43:06.747919695 (166h26m11.682373826s) [upload=146286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 24 18:43:06.747926018 (166h26m11.68238015s) [upload=146286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Feb 24 18:43:06.747929848 (166h26m11.68238398s) [upload=146286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 24 18:43:47.388785505 (166h26m52.32323964s) [upload=146286]: Done uploading segments... Feb 24 18:43:47.388809684 (166h26m52.323263817s) [upload=146286]: Upload finished. err: <nil> Duration:* 27.408237357s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 40 out of 60 is failed (threshold=3) [.................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXXX.XX.] duration: 2.227698637s trace: https://jaeger.dev.storj.io/trace/672241cb7c0a47f8 FAIL (2026-02-24 18:46:19 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.227716653s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 39 out of 60 is failed (threshold=3) [..................XXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXX..] duration: 15.627979649s trace: https://jaeger.dev.storj.io/trace/30d8e2a6a3198912 FAIL (2026-02-24 18:46:19 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 15.628017466s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 18 out of 60 is failed (threshold=3) [......................................XXXXXXXXXXXXXXXXXX....] duration: 11.091683553s trace: https://jaeger.dev.storj.io/trace/73cef0d4f8588a82 FAIL (2026-02-24 18:46:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Feb 24 18:42:40.331706604 (166h25m45.266160746s) [upload=146280]: Starting upload Feb 24 18:42:40.331826626 (166h25m45.266280764s) [upload=146280]: Done starting upload Feb 24 18:42:40.331904481 (166h25m45.266358598s) [upload=146280]: Uploading segments... Feb 24 18:42:40.332266211 (166h25m45.266720352s) [upload=146280]: Got next segment. Inline: false Feb 24 18:42:40.332351248 (166h25m45.266805381s) [upload=146280]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 24 18:42:40.332357321 (166h25m45.266811453s) [upload=146280]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 24 18:43:40.022165933 (166h26m44.956620058s) [upload=146280]: Next segment err: context deadline exceeded Feb 24 18:43:40.022586871 (166h26m44.957040994s) [upload=146280]: Done uploading segments... Feb 24 18:43:40.022728565 (166h26m44.957182691s) [upload=146280]: Upload finished. err: context deadline exceeded Duration: 11.091715253s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 40 out of 60 is failed (threshold=3) [..................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXXX.XX] duration: 30.00206907s trace: https://jaeger.dev.storj.io/trace/672241cb7c0a47f8 FAIL (2026-02-24 18:46:17 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 30.002096541s core uplink us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 10.535028ms remote: "tcp:185.244.226.3:443" response headers: Content-Length=274 Server=Storj X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 18:46:17 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1897431E9EEBD390 X-Request-Id=GM31uiGRBSt target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace: https://jaeger.dev.storj.io/trace/54cc969a1e267843 FAIL (2026-02-24 18:46:17 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897431E9EEBD390</RequestId><HostId></HostId></Error>" Duration: 10.560009ms edge gateway vhost bgp us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 40 out of 60 is failed (threshold=3) [...................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.] duration: 13.792302279s trace: https://jaeger.dev.storj.io/trace/10dc5f232dfe5501 FAIL (2026-02-24 18:46:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 13.792332599s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 31 out of 60 is failed (threshold=3) [..........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...] duration: 15.699354123s trace: https://jaeger.dev.storj.io/trace/7ebec86835c4464b FAIL (2026-02-24 18:46:00 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:43:06.746940362 (166h26m11.681394495s) [upload=146286]: Starting upload Feb 24 18:43:06.747106775 (166h26m11.681560915s) [upload=146286]: Done starting upload Feb 24 18:43:06.747390196 (166h26m11.681844318s) [upload=146286]: Uploading segments... Feb 24 18:43:06.747735916 (166h26m11.682190059s) [upload=146286]: Got next segment. Inline: true Feb 24 18:43:06.747744937 (166h26m11.682199074s) [upload=146286]: Waiting for error group managing segments... Feb 24 18:43:06.747919695 (166h26m11.682373826s) [upload=146286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 24 18:43:06.747926018 (166h26m11.68238015s) [upload=146286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Feb 24 18:43:06.747929848 (166h26m11.68238398s) [upload=146286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 24 18:43:47.388785505 (166h26m52.32323964s) [upload=146286]: Done uploading segments... Feb 24 18:43:47.388809684 (166h26m52.323263817s) [upload=146286]: Upload finished. err: <nil> Duration:* 15.699376153s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 30 out of 60 is failed (threshold=3) [..........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX....] duration: 10.932190497s trace: https://jaeger.dev.storj.io/trace/7fde6e39a6e83ecb FAIL (2026-02-24 18:45:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 10.932219081s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 8.346487ms remote: "tcp:185.244.226.3:443" response headers: X-Amz-Request-Id=18974319F6733AC7 X-Xss-Protection=1; mode=block Vary=Origin X-Request-Id=g33h8bYHf8A Date=Tue, 24 Feb 2026 18:45:57 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/441ac52e70534add FAIL (2026-02-24 18:45:57 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18974319F6733AC7</RequestId><HostId></HostId></Error>" Duration: 8.376056ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 18 out of 60 is failed (threshold=3) [.......................................XXXXXXXXXXXXXXXXXX...] duration: 9.216532237s trace: https://jaeger.dev.storj.io/trace/73cef0d4f8588a82 FAIL (2026-02-24 18:45:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Feb 24 18:42:40.331706604 (166h25m45.266160746s) [upload=146280]: Starting upload Feb 24 18:42:40.331826626 (166h25m45.266280764s) [upload=146280]: Done starting upload Feb 24 18:42:40.331904481 (166h25m45.266358598s) [upload=146280]: Uploading segments... Feb 24 18:42:40.332266211 (166h25m45.266720352s) [upload=146280]: Got next segment. Inline: false Feb 24 18:42:40.332351248 (166h25m45.266805381s) [upload=146280]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 24 18:42:40.332357321 (166h25m45.266811453s) [upload=146280]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 24 18:43:40.022165933 (166h26m44.956620058s) [upload=146280]: Next segment err: context deadline exceeded Feb 24 18:43:40.022586871 (166h26m44.957040994s) [upload=146280]: Done uploading segments... Feb 24 18:43:40.022728565 (166h26m44.957182691s) [upload=146280]: Upload finished. err: context deadline exceeded Duration: 9.216575647s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 307.615403ms remote: "tcp:45.38.24.2:443" response headers: Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=189743198D267679 X-Request-Id=GYVo5FvAovH X-Xss-Protection=1; mode=block Content-Length=284 Content-Type=application/xml Date=Tue, 24 Feb 2026 18:45:55 GMT target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace: https://jaeger.dev.storj.io/trace/9e1083bcb8be7ae FAIL (2026-02-24 18:45:55 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189743198D267679</RequestId><HostId></HostId></Error>" Duration: 307.68849ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 41 out of 60 is failed (threshold=3) [................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...] duration: 10.375262937s trace: https://jaeger.dev.storj.io/trace/55750a6cec7fc997 FAIL (2026-02-24 18:45:54 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 10.375294226s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 42 out of 60 is failed (threshold=3) [................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXX.] duration: 25.028550786s trace: https://jaeger.dev.storj.io/trace/7f0556b50233dcf FAIL (2026-02-24 18:45:53 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:44:38.736661269 (166h27m43.671115407s) [upload=146306]: Starting upload Feb 24 18:44:38.736789536 (166h27m43.67124368s) [upload=146306]: Done starting upload Feb 24 18:44:38.736870341 (166h27m43.671324482s) [upload=146306]: Uploading segments... Feb 24 18:44:38.737444496 (166h27m43.671898631s) [upload=146306]: Got next segment. Inline: true Feb 24 18:44:38.737459641 (166h27m43.671913778s) [upload=146306]: Waiting for error group managing segments... Feb 24 18:44:38.737569732 (166h27m43.672023869s) [upload=146306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 24 18:44:38.737603924 (166h27m43.672058062s) [upload=146306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Feb 24 18:44:38.737612113 (166h27m43.672066252s) [upload=146306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 24 18:44:55.029518776 (166h27m59.96397291s) [upload=146306]: Done uploading segments... Feb 24 18:44:55.029540622 (166h27m59.96399476s) [upload=146306]: Upload finished. err: <nil> Duration:* 25.02858217s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 31 out of 60 is failed (threshold=3) [...........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..] duration: 49.554350318s trace: https://jaeger.dev.storj.io/trace/7ebec86835c4464b FAIL (2026-02-24 18:45:44 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:43:06.746940362 (166h26m11.681394495s) [upload=146286]: Starting upload Feb 24 18:43:06.747106775 (166h26m11.681560915s) [upload=146286]: Done starting upload Feb 24 18:43:06.747390196 (166h26m11.681844318s) [upload=146286]: Uploading segments... Feb 24 18:43:06.747735916 (166h26m11.682190059s) [upload=146286]: Got next segment. Inline: true Feb 24 18:43:06.747744937 (166h26m11.682199074s) [upload=146286]: Waiting for error group managing segments... Feb 24 18:43:06.747919695 (166h26m11.682373826s) [upload=146286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 24 18:43:06.747926018 (166h26m11.68238015s) [upload=146286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Feb 24 18:43:06.747929848 (166h26m11.68238398s) [upload=146286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 24 18:43:47.388785505 (166h26m52.32323964s) [upload=146286]: Done uploading segments... Feb 24 18:43:47.388809684 (166h26m52.323263817s) [upload=146286]: Upload finished. err: <nil> Duration:* 49.554369646s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 19 out of 60 is failed (threshold=6) [...X....X..XX..X.................X...XX...X.XX.XXXX..XX.XX..] duration: 2.178153434s trace: https://jaeger.dev.storj.io/trace/735f4b0581be18ee FAIL (2026-02-24 18:45:43 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.178184036s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 7.600539ms remote: "tcp:185.244.226.3:443" response headers: Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18974315915B85B8 X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 18:45:38 GMT Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=9mYeKbpRyT1 target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace: https://jaeger.dev.storj.io/trace/769de909b783f6bb FAIL (2026-02-24 18:45:38 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18974315915B85B8</RequestId><HostId></HostId></Error>" Duration: 7.644401ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 41 out of 60 is failed (threshold=3) [.................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..] duration: 2.30960165s trace: https://jaeger.dev.storj.io/trace/55750a6cec7fc997 FAIL (2026-02-24 18:45:26 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 2.309634679s core uplink us1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 14 out of 60 is failed (threshold=6) [......................................XX.XX.XXXXX.XX.XXX....] duration: 4.192966635s remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/43ad6243e9f92940 FAIL (2026-02-24 18:45:26 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 4.192995393s edge linksharing bgp us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 39 out of 60 is failed (threshold=3) [...................XXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXX.] duration: 28.111943534s trace: https://jaeger.dev.storj.io/trace/30d8e2a6a3198912 FAIL (2026-02-24 18:45:26 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 28.111969048s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 36 out of 60 is failed (threshold=3) [.......................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.] duration: 30.002374052s trace: https://jaeger.dev.storj.io/trace/65d78979415e911b FAIL (2026-02-24 18:45:25 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:44:25.621738472 (166h27m30.55619262s) [upload=146303]: Starting upload Feb 24 18:44:25.621822744 (166h27m30.556276878s) [upload=146303]: Done starting upload Feb 24 18:44:25.621970435 (166h27m30.556424555s) [upload=146303]: Uploading segments... Feb 24 18:44:25.623351481 (166h27m30.557805646s) [upload=146303]: Got next segment. Inline: false Feb 24 18:44:25.623473970 (166h27m30.557928122s) [upload=146303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 24 18:44:25.623481806 (166h27m30.557935944s) [upload=146303]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 24 18:44:34.935332081 (166h27m39.869786223s) [seg_pos={0 0}, upload=146303]: Begin upload segment... Feb 24 18:44:34.935452908 (166h27m39.869907028s) [seg_pos={0 0}, upload=146303]: Done begin upload segment. Feb 24 18:44:34.935470940 (166h27m39.869925072s) [noise=true , address=45.91.116.9:4263 , piece_id=W6M2YGDXWXWYQVWNIWFABEZ723EHRB3BXZFNXTNKIBW3G4YOUWHQ, seg_pos={0 0}, upload=146303]: Uploading piece... Feb 24 18:44:34.935502977 (166h27m39.869957124s) [noise=true , address=145.79.227.6:4262 , piece_id=6TO6SW5M6ECKAW5HA227R3PJITUHDSBMQGYS2HJZ3K5OGW6W3QXA, seg_pos={0 0}, upload=146303]: Uploading piece... Feb 24 18:44:34.936238244 (166h27m39.870692385s) [noise=true , address=145.79.227.38:4977 , piece_id=Z3KNZ7DD2ALJGOGH3HXV4POOXOJKIXDRIABLWPG43BMFCEVCWFPQ, seg_pos={0 0}, upload=146303]: Uploading piece... Feb 24 18:44:34.936390553 (166h27m39.870844691s) [noise=true , address=145.79.227.41:4087 , piece_id=DAXOVZLTW6GDWIHBPIUJTWQOW4ALWS7VHZ4H7OQYXR5VNHBCHQGQ, seg_pos={0 0}, upload=146303]: Uploading piece... Feb 24 18:44:34.936869913 (166h27m39.871324045s) [noise=true , address=145.79.227.43:4159 , piece_id=XDH4GF7FZIISYRZC4ARULDMW63K6KGZWDV5DJDHEV4SG5I2N54HQ, seg_pos={0 0}, upload=146303]: Uploading piece... Feb 24 18:44:34.936916146 (166h27m39.871370306s) [noise=true , address=145.79.227.33:4871 , piece_id=4HDJKVWDUY3OH2ZMNKYMITP3XHKVO2LRDJG4PAI5X5X7CL2DZSUQ, seg_pos={0 0}, upload=146303]: Uploading piece... Feb 24 18:44:34.937428088 (166h27m39.871882221s) [noise=true , address=145.79.227.15:4878 , piece_id=AZWM4XRDHIZ66AKA6XHVIWYA6XV4VTQB6YBYLP4QUYU7OGH5S7MQ, seg_pos={0 0}, upload=146303]: Uploading piece... Feb 24 18:44:34.937598993 (166h27m39.872053131s) [noise=true , address=145.79.227.2:4114 , piece_id=PEEULOPECVYCZM6CAZWBUDPSR6M5BGZRQAAPO3TK4XTE27ZNM2JQ, seg_pos={0 0}, upload=146303]: Uploading piece... Feb 24 18:44:34.938045240 (166h27m39.872499373s) [noise=true , address=79.127.219.38:4817 , piece_id=MONZTSKXVUK266AQBTR3QISWFJN55MDFBZTQDGAU4QWDFQV3YOUQ, seg_pos={0 0}, upload=146303]: Uploading piece... Feb 24 18:44:34.938199591 (166h27m39.872653732s) [noise=true , address=145.79.227.20:4437 , piece_id=QC2U55FFJI2HPG2UAGGZWHWVP5ZHYVIQT5ZVGAJ4JTTYZCGCX7HA, seg_pos={0 0}, upload=146303]: Uploading piece... Feb 24 18:44:34.938498023 (166h27m39.872952159s) [noise=true , address=145.79.227.23:4551 , piece_id=GANBLEY3IY5TVSR45EAWWHW6XA5UEVD73JQAH4NRAHB5UWE3H3PQ, seg_pos={0 0}, upload=146303]: Uploading piece... Feb 24 18:44:34.938749086 (166h27m39.873203221s) [noise=true , address=145.79.227.27:4690 , piece_id=KKC2QAAHTWDDSJ5FGB57DOEU2RR4AJOBCEJOE4WHPPKC7NHQ4WGQ, seg_pos={0 0}, upload=146303]: Uploading piece... Feb 24 18:44:34.939305313 (166h27m39.873759451s) [noise=true , address=45.91.116.4:4939 , piece_id=NQVKAQSGIEVY4VJKNZGQYROXAVML2VXBWJIHCLSTAK5LD3KPXNDQ, seg_pos={0 0}, upload=146303]: Uploading piece... Feb 24 18:44:34.939770507 (166h27m39.874224651s) [noise=true , address=145.79.227.13:4806 , piece_id=XZX7DDIREJ3J4W56PQ6DYWW7UGL3LZMSZXMSESLL2OKBIDNERLVA, seg_pos={0 0}, upload=146303]: Uploading piece... Feb 24 18:44:34.940298761 (166h27m39.874752887s) [noise=true , address=145.79.227.39:4013 , piece_id=QCNEO6IABSQOOUVZBWOX36TJW3YGKK5AVK3GJ5MBHYKZJBQL5UHQ, seg_pos={0 0}, upload=146303]: Uploading piece... Feb 24 18:44:34.940508043 (166h27m39.874962175s) [noise=true , address=145.79.227.24:4584 , piece_id=RKS2O3PKXZ4S3HE2SBWPDAUO73EZTZMUQICLR5DBCLKO7OJJAHJQ, seg_pos={0 0}, upload=146303]: Uploading piece... Feb 24 18:44:35.548093229 (166h27m40.482547366s) [upload=146303]: Next returned nil segment Feb 24 18:44:35.548147298 (166h27m40.482601434s) [upload=146303]: Waiting for error group managing segments... Feb 24 18:44:35.683777399 (166h27m40.618231543s) [noise=true , address=145.79.227.24:4584 , piece_id=RKS2O3PKXZ4S3HE2SBWPDAUO73EZTZMUQICLR5DBCLKO7OJJAHJQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil> Feb 24 18:44:35.684454673 (166h27m40.618908805s) [noise=true , address=145.79.227.20:4437 , piece_id=QC2U55FFJI2HPG2UAGGZWHWVP5ZHYVIQT5ZVGAJ4JTTYZCGCX7HA, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil> Feb 24 18:44:35.687431523 (166h27m40.621885664s) [noise=true , address=145.79.227.2:4114 , piece_id=PEEULOPECVYCZM6CAZWBUDPSR6M5BGZRQAAPO3TK4XTE27ZNM2JQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil> Feb 24 18:44:35.688566587 (166h27m40.623020726s) [noise=true , address=145.79.227.39:4013 , piece_id=QCNEO6IABSQOOUVZBWOX36TJW3YGKK5AVK3GJ5MBHYKZJBQL5UHQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil> Feb 24 18:44:35.689228447 (166h27m40.623682598s) [noise=true , address=145.79.227.6:4262 , piece_id=6TO6SW5M6ECKAW5HA227R3PJITUHDSBMQGYS2HJZ3K5OGW6W3QXA, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil> Feb 24 18:44:35.691286463 (166h27m40.625740595s) [noise=true , address=45.91.116.4:4939 , piece_id=NQVKAQSGIEVY4VJKNZGQYROXAVML2VXBWJIHCLSTAK5LD3KPXNDQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil> Feb 24 18:44:35.691717184 (166h27m40.626171317s) [noise=true , address=45.91.116.9:4263 , piece_id=W6M2YGDXWXWYQVWNIWFABEZ723EHRB3BXZFNXTNKIBW3G4YOUWHQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil> Feb 24 18:44:35.694290576 (166h27m40.628744723s) [noise=true , address=145.79.227.13:4806 , piece_id=XZX7DDIREJ3J4W56PQ6DYWW7UGL3LZMSZXMSESLL2OKBIDNERLVA, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil> Feb 24 18:44:35.697227409 (166h27m40.631681548s) [noise=true , address=145.79.227.33:4871 , piece_id=4HDJKVWDUY3OH2ZMNKYMITP3XHKVO2LRDJG4PAI5X5X7CL2DZSUQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil> Feb 24 18:44:35.697288805 (166h27m40.631742946s) [noise=true , address=145.79.227.27:4690 , piece_id=KKC2QAAHTWDDSJ5FGB57DOEU2RR4AJOBCEJOE4WHPPKC7NHQ4WGQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil> Feb 24 18:44:35.699730434 (166h27m40.634184574s) [noise=true , address=145.79.227.23:4551 , piece_id=GANBLEY3IY5TVSR45EAWWHW6XA5UEVD73JQAH4NRAHB5UWE3H3PQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil> Feb 24 18:44:35.705833249 (166h27m40.640287381s) [noise=true , address=145.79.227.38:4977 , piece_id=Z3KNZ7DD2ALJGOGH3HXV4POOXOJKIXDRIABLWPG43BMFCEVCWFPQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil> Feb 24 18:44:35.754105230 (166h27m40.688559366s) [noise=true , address=145.79.227.15:4878 , piece_id=AZWM4XRDHIZ66AKA6XHVIWYA6XV4VTQB6YBYLP4QUYU7OGH5S7MQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: <nil> Feb 24 18:44:35.754141889 (166h27m40.688596025s) [seg_pos={0 0}, upload=146303]: Satisfied cohort requirements after 13 pieces Feb 24 18:44:35.754487434 (166h27m40.688941571s) [noise=true , address=145.79.227.43:4159 , piece_id=XDH4GF7FZIISYRZC4ARULDMW63K6KGZWDV5DJDHEV4SG5I2N54HQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ULUPKjJwZocjV1R6Dy7vmWSrZ4hKx3YAHLAihgtMKf8Uw2UgA): protocol: expected piece hash; context canceled; EOF Feb 24 18:44:35.754498469 (166h27m40.688952605s) [noise=true , address=145.79.227.43:4159 , piece_id=XDH4GF7FZIISYRZC4ARULDMW63K6KGZWDV5DJDHEV4SG5I2N54HQ, seg_pos={0 0}, upload=146303]: Long tail cancellation due to optimal threshold Feb 24 18:44:35.754536013 (166h27m40.688990157s) [noise=true , address=145.79.227.41:4087 , piece_id=DAXOVZLTW6GDWIHBPIUJTWQOW4ALWS7VHZ4H7OQYXR5VNHBCHQGQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BfeGD2MGRPqsBRGLioTiTAcPykpSTUUx2CBVSPQcz4LQqFdWR): protocol: expected piece hash; context canceled; EOF Feb 24 18:44:35.754552737 (166h27m40.689006877s) [noise=true , address=145.79.227.41:4087 , piece_id=DAXOVZLTW6GDWIHBPIUJTWQOW4ALWS7VHZ4H7OQYXR5VNHBCHQGQ, seg_pos={0 0}, upload=146303]: Long tail cancellation due to optimal threshold Feb 24 18:44:35.754742786 (166h27m40.689196928s) [noise=true , address=79.127.219.38:4817 , piece_id=MONZTSKXVUK266AQBTR3QISWFJN55MDFBZTQDGAU4QWDFQV3YOUQ, seg_pos={0 0}, upload=146303]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1io2wPA1rsWxYwkFhiYwiKSeXQAuNDjqSxAdzkdJCdFsNpQLHZ): protocol: expected piece hash; context canceled; EOF Feb 24 18:44:35.754754029 (166h27m40.689208167s) [noise=true , address=79.127.219.38:4817 , piece_id=MONZTSKXVUK266AQBTR3QISWFJN55MDFBZTQDGAU4QWDFQV3YOUQ, seg_pos={0 0}, upload=146303]: Long tail cancellation due to optimal threshold Feb 24 18:44:35.754783245 (166h27m40.689237379s) [seg_pos={0 0}, upload=146303]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 24 18:44:35.754901862 (166h27m40.689356004s) [upload=146303]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 24 18:44:35.754909251 (166h27m40.689363389s) [upload=146303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 24 18:44:48.936885953 (166h27m53.871340088s) [upload=146303]: Done uploading segments... Feb 24 18:44:48.936915118 (166h27m53.871369252s) [upload=146303]: Upload finished. err: <nil> Duration: 30.002414758s core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 10.701968ms remote: "tcp:185.244.226.3:443" response headers: Date=Tue, 24 Feb 2026 18:45:25 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=RQzyQtNaZxn X-Xss-Protection=1; mode=block Content-Type=application/xml Vary=Origin X-Amz-Request-Id=189743127EE5C8F4 target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/1a2a5327f43cbc65 FAIL (2026-02-24 18:45:25 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189743127EE5C8F4</RequestId><HostId></HostId></Error>" Duration: 10.73119ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 10.778643ms remote: "tcp:185.244.226.3:443" response headers: Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Request-Id=QekALf5J1Fu X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 18:45:24 GMT Content-Length=274 Vary=Origin X-Amz-Request-Id=189743126D0B2C4B target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/4c3871ab6ee21d5a FAIL (2026-02-24 18:45:24 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189743126D0B2C4B</RequestId><HostId></HostId></Error>" Duration: 10.800484ms edge gateway vhost bgp eu1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)