Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure

Orbiter Check History

Showing 50 of 458133 reports (Page 4408 of 9163)
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)
antiblip:
31 out of 60 is failed (threshold=3) [..............XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...............]
duration:
985.03337ms
trace:
https://jaeger.dev.storj.io/trace/7ebec86835c4464b
FAIL (2026-02-24 18:54:14 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:43:06.746940362 (166h26m11.681394495s) [upload=146286]: Starting upload
Feb 24 18:43:06.747106775 (166h26m11.681560915s) [upload=146286]: Done starting upload
Feb 24 18:43:06.747390196 (166h26m11.681844318s) [upload=146286]: Uploading segments...
Feb 24 18:43:06.747735916 (166h26m11.682190059s) [upload=146286]: Got next segment. Inline: true
Feb 24 18:43:06.747744937 (166h26m11.682199074s) [upload=146286]: Waiting for error group managing segments...
Feb 24 18:43:06.747919695 (166h26m11.682373826s) [upload=146286]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:43:06.747926018 (166h26m11.68238015s) [upload=146286]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Feb 24 18:43:06.747929848 (166h26m11.68238398s) [upload=146286]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:43:47.388785505 (166h26m52.32323964s) [upload=146286]: Done uploading segments...
Feb 24 18:43:47.388809684 (166h26m52.323263817s) [upload=146286]: Upload finished. err: <nil>
Duration: 985.060869ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
42 out of 60 is failed (threshold=3) [...XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...X............]
duration:
2.306775222s
trace:
https://jaeger.dev.storj.io/trace/5f0b31811a3a7df8
FAIL (2026-02-24 18:54:13 UTC)
orbiter warning: operation: DeleteObject
uplink: metaclient: context deadline exceeded
Duration: 2.306793929s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
37 out of 60 is failed (threshold=3) [...........XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X...........]
duration:
2.589543141s
trace:
https://jaeger.dev.storj.io/trace/34cb6d1b452f899e
FAIL (2026-02-24 18:54:10 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:46:10.298604913 (166h29m15.233059039s) [upload=146328]: Starting upload
Feb 24 18:46:10.298694572 (166h29m15.233148698s) [upload=146328]: Done starting upload
Feb 24 18:46:10.298808673 (166h29m15.2332628s) [upload=146328]: Uploading segments...
Feb 24 18:46:10.299060123 (166h29m15.233514248s) [upload=146328]: Got next segment. Inline: false
Feb 24 18:46:10.299127664 (166h29m15.233581869s) [upload=146328]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:46:10.299134965 (166h29m15.233589103s) [upload=146328]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 24 18:46:14.386535467 (166h29m19.320989591s) [seg_pos={0 0}, upload=146328]: Begin upload segment...
Feb 24 18:46:14.386609320 (166h29m19.321063443s) [seg_pos={0 0}, upload=146328]: Done begin upload segment.
Feb 24 18:46:14.386651770 (166h29m19.321105909s) [noise=true , address=79.127.219.41:4926   , piece_id=3MVRZCJRS4LCD5BCG2BNROH6YZLMY36KGVNGKZ3PR3662TMHGOHQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.386689137 (166h29m19.321143279s) [noise=true , address=145.79.227.9:4366    , piece_id=TP2ZYWRAS2TEU2DFFTCNMIZZLJ7ORZQJQ4YMFGKEIKTV5B2NDPZQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.387262604 (166h29m19.321716739s) [noise=true , address=145.79.227.26:4656   , piece_id=QWFLUSXVFYVWFFPC3KL5NUM325VJUF2G7L4VQ3MFVYQH5VOAKXQQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.387281978 (166h29m19.321736111s) [noise=true , address=145.79.227.13:4803   , piece_id=UHSHD5LU6FPNYTLJC7R2N47VODLCO6G4LBUSA24NK2HI4TQI7NNA, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.387684997 (166h29m19.322139139s) [noise=true , address=77.90.31.13:4626     , piece_id=SCL3JYHW2LTOHXBCMOS6XA7CIDK6UKFWDHDDACABM3IUVS4KJXPQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.387758959 (166h29m19.322213091s) [noise=true , address=145.79.227.7:4293    , piece_id=PUILSZ2JFEXXCQE3TXPLTM4RAUYEQ6WLQKUPPGFSDBKLEYVBUJVQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.388076578 (166h29m19.32253071s) [noise=true , address=145.79.227.17:4972   , piece_id=BK7RYKZEK43T6E5PDP4BQFU5FSD5GPFPDA6IFMLDBBK24IURPKRQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.388338636 (166h29m19.322792779s) [noise=true , address=145.79.227.19:4077   , piece_id=FUZVWTJIOR5X6NN5W53FSQSDCWZ7H7NTUP7QR7ZD77OLCMGNF3BQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.388522986 (166h29m19.322977124s) [noise=true , address=79.127.219.38:4817   , piece_id=VSDJRVJRSZRXKAGGXBPMCVUIJZR4OE3WFTQM44EG5QGCBYF6EKHA, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.388955917 (166h29m19.323410053s) [noise=true , address=145.79.227.39:4018   , piece_id=AEXOUAJGZBAHJQZGUQ54JLKQZTMYXNW55FPQUA2DDISFVRZLJWKA, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.388962547 (166h29m19.323416671s) [noise=true , address=145.79.227.42:4125   , piece_id=VW5NSROAUYOPDHQKBQAAOSZJVCBXX7MA5VZNDBBQHOC6WPJJO3TQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.389487579 (166h29m19.323941717s) [noise=true , address=145.79.227.3:4155    , piece_id=OGUK5XPPX6GJXKWJO4APHD2P2H6QLPCYGZKLYJGHNAFPJV3JBHAQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.389656635 (166h29m19.324110777s) [noise=true , address=145.79.227.45:4234   , piece_id=NIKILNGW7SNYD5G4FLW3MDGR36PR36OBUTWVXKHNX3PN3I7PDJXA, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.389904102 (166h29m19.324358239s) [noise=true , address=77.90.31.17:4770     , piece_id=G6GOXLZFNFPSOAOKUZ576KVWUH7VVGTUKP6YELJNYA6QKSQ6V43Q, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.390173491 (166h29m19.324627638s) [noise=true , address=45.91.116.10:4084    , piece_id=B3T4IS2GQGE3672YMZBH573JV5UNAXBH6MTMHBCQQDH6YRGDDSOQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.390680007 (166h29m19.325134143s) [noise=true , address=77.90.31.15:4700     , piece_id=RXMZF53ZHZARKQF5YXWLJT7TWQOJWVW3F4GT3OBS6FYG3BP2AANA, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.999552917 (166h29m19.934007055s) [upload=146328]: Next returned nil segment
Feb 24 18:46:14.999572659 (166h29m19.934026808s) [upload=146328]: Waiting for error group managing segments...
Feb 24 18:46:15.133573664 (166h29m20.068027806s) [noise=true , address=145.79.227.19:4077   , piece_id=FUZVWTJIOR5X6NN5W53FSQSDCWZ7H7NTUP7QR7ZD77OLCMGNF3BQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.135121334 (166h29m20.069575489s) [noise=true , address=145.79.227.13:4803   , piece_id=UHSHD5LU6FPNYTLJC7R2N47VODLCO6G4LBUSA24NK2HI4TQI7NNA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.135808911 (166h29m20.070263048s) [noise=true , address=145.79.227.3:4155    , piece_id=OGUK5XPPX6GJXKWJO4APHD2P2H6QLPCYGZKLYJGHNAFPJV3JBHAQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.136063429 (166h29m20.070517571s) [noise=true , address=45.91.116.10:4084    , piece_id=B3T4IS2GQGE3672YMZBH573JV5UNAXBH6MTMHBCQQDH6YRGDDSOQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.147571506 (166h29m20.08202564s) [noise=true , address=145.79.227.42:4125   , piece_id=VW5NSROAUYOPDHQKBQAAOSZJVCBXX7MA5VZNDBBQHOC6WPJJO3TQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.152125874 (166h29m20.086580008s) [noise=true , address=145.79.227.7:4293    , piece_id=PUILSZ2JFEXXCQE3TXPLTM4RAUYEQ6WLQKUPPGFSDBKLEYVBUJVQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.156384278 (166h29m20.090838414s) [noise=true , address=145.79.227.39:4018   , piece_id=AEXOUAJGZBAHJQZGUQ54JLKQZTMYXNW55FPQUA2DDISFVRZLJWKA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.156878029 (166h29m20.091332164s) [noise=true , address=145.79.227.9:4366    , piece_id=TP2ZYWRAS2TEU2DFFTCNMIZZLJ7ORZQJQ4YMFGKEIKTV5B2NDPZQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.158388008 (166h29m20.092842152s) [noise=true , address=145.79.227.45:4234   , piece_id=NIKILNGW7SNYD5G4FLW3MDGR36PR36OBUTWVXKHNX3PN3I7PDJXA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.158969175 (166h29m20.09342331s) [noise=true , address=145.79.227.17:4972   , piece_id=BK7RYKZEK43T6E5PDP4BQFU5FSD5GPFPDA6IFMLDBBK24IURPKRQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.161901086 (166h29m20.096355222s) [noise=true , address=79.127.219.41:4926   , piece_id=3MVRZCJRS4LCD5BCG2BNROH6YZLMY36KGVNGKZ3PR3662TMHGOHQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.167562010 (166h29m20.102016148s) [noise=true , address=79.127.219.38:4817   , piece_id=VSDJRVJRSZRXKAGGXBPMCVUIJZR4OE3WFTQM44EG5QGCBYF6EKHA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.197064489 (166h29m20.131518639s) [noise=true , address=77.90.31.13:4626     , piece_id=SCL3JYHW2LTOHXBCMOS6XA7CIDK6UKFWDHDDACABM3IUVS4KJXPQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.197191533 (166h29m20.131645675s) [seg_pos={0 0}, upload=146328]: Satisfied cohort requirements after 13 pieces
Feb 24 18:46:15.197465113 (166h29m20.131919257s) [noise=true , address=145.79.227.26:4656   , piece_id=QWFLUSXVFYVWFFPC3KL5NUM325VJUF2G7L4VQ3MFVYQH5VOAKXQQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u6e2ZjrPg2q3EDN2ZjDj9hzEmCAoRvt39HMeM79gcVmMVm53j): protocol: expected piece hash; context canceled; EOF
Feb 24 18:46:15.197478634 (166h29m20.131932777s) [noise=true , address=145.79.227.26:4656   , piece_id=QWFLUSXVFYVWFFPC3KL5NUM325VJUF2G7L4VQ3MFVYQH5VOAKXQQ, seg_pos={0 0}, upload=146328]: Long tail cancellation due to optimal threshold
Feb 24 18:46:15.197655516 (166h29m20.13210966s) [noise=true , address=77.90.31.17:4770     , piece_id=G6GOXLZFNFPSOAOKUZ576KVWUH7VVGTUKP6YELJNYA6QKSQ6V43Q, seg_pos={0 0}, upload=146328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Feb 24 18:46:15.197666194 (166h29m20.132120336s) [noise=true , address=77.90.31.17:4770     , piece_id=G6GOXLZFNFPSOAOKUZ576KVWUH7VVGTUKP6YELJNYA6QKSQ6V43Q, seg_pos={0 0}, upload=146328]: Long tail cancellation due to optimal threshold
Feb 24 18:46:15.197767092 (166h29m20.132221229s) [noise=true , address=77.90.31.15:4700     , piece_id=RXMZF53ZHZARKQF5YXWLJT7TWQOJWVW3F4GT3OBS6FYG3BP2AANA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q): protocol: expected piece hash; context canceled; EOF
Feb 24 18:46:15.197783861 (166h29m20.132237994s) [noise=true , address=77.90.31.15:4700     , piece_id=RXMZF53ZHZARKQF5YXWLJT7TWQOJWVW3F4GT3OBS6FYG3BP2AANA, seg_pos={0 0}, upload=146328]: Long tail cancellation due to optimal threshold
Feb 24 18:46:15.197815694 (166h29m20.132269813s) [seg_pos={0 0}, upload=146328]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 24 18:46:15.197905836 (166h29m20.132359971s) [upload=146328]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 24 18:46:15.197936276 (166h29m20.132390411s) [upload=146328]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:46:25.272856749 (166h29m30.207310871s) [upload=146328]: Done uploading segments...
Feb 24 18:46:25.272890825 (166h29m30.207344961s) [upload=146328]: Upload finished. err: <nil>
Duration: 2.589583127s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
42 out of 60 is failed (threshold=3) [....XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...X...........]
duration:
26.7828301s
trace:
https://jaeger.dev.storj.io/trace/5f0b31811a3a7df8
FAIL (2026-02-24 18:54:10 UTC)
orbiter warning: operation: DeleteObject
uplink: metaclient: context deadline exceeded
Duration: 26.782879809s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
18 out of 60 is failed (threshold=3) [...........................XXXXXXXXXXXXXXXXXX...............]
duration:
3.184053227s
trace:
https://jaeger.dev.storj.io/trace/73cef0d4f8588a82
FAIL (2026-02-24 18:54:06 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Feb 24 18:42:40.331706604 (166h25m45.266160746s) [upload=146280]: Starting upload
Feb 24 18:42:40.331826626 (166h25m45.266280764s) [upload=146280]: Done starting upload
Feb 24 18:42:40.331904481 (166h25m45.266358598s) [upload=146280]: Uploading segments...
Feb 24 18:42:40.332266211 (166h25m45.266720352s) [upload=146280]: Got next segment. Inline: false
Feb 24 18:42:40.332351248 (166h25m45.266805381s) [upload=146280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:42:40.332357321 (166h25m45.266811453s) [upload=146280]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 24 18:43:40.022165933 (166h26m44.956620058s) [upload=146280]: Next segment err: context deadline exceeded
Feb 24 18:43:40.022586871 (166h26m44.957040994s) [upload=146280]: Done uploading segments...
Feb 24 18:43:40.022728565 (166h26m44.957182691s) [upload=146280]: Upload finished. err: context deadline exceeded
Duration: 3.184093207s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
30 out of 60 is failed (threshold=3) [..............XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX................]
duration:
6.302050532s
trace:
https://jaeger.dev.storj.io/trace/7fde6e39a6e83ecb
FAIL (2026-02-24 18:53:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.3020822s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
43 out of 60 is failed (threshold=3) [......XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXX.X.........]
duration:
945.842961ms
trace:
https://jaeger.dev.storj.io/trace/c2303a2d8cc4559
FAIL (2026-02-24 18:53:55 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:46:25.455945314 (166h29m30.390399449s) [upload=146330]: Starting upload
Feb 24 18:46:25.456028421 (166h29m30.390482554s) [upload=146330]: Done starting upload
Feb 24 18:46:25.456183000 (166h29m30.390637123s) [upload=146330]: Uploading segments...
Feb 24 18:46:25.456241745 (166h29m30.390695879s) [upload=146330]: Got next segment. Inline: true
Feb 24 18:46:25.456248406 (166h29m30.390702538s) [upload=146330]: Waiting for error group managing segments...
Feb 24 18:46:25.456313221 (166h29m30.390767353s) [upload=146330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:46:25.456318913 (166h29m30.390773046s) [upload=146330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Feb 24 18:46:25.456322453 (166h29m30.390776585s) [upload=146330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:46:42.336159913 (166h29m47.270614055s) [upload=146330]: Done uploading segments...
Feb 24 18:46:42.336191328 (166h29m47.270645479s) [upload=146330]: Upload finished. err: <nil>
Duration: 945.87457ms core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
7.817555ms
remote:
"tcp:185.244.226.3:443"
response headers:
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Vary=Origin
X-Request-Id=J5wHcjCDqZr
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
Server=Storj
X-Amz-Request-Id=18974388D2EF6F0A
Date=Tue, 24 Feb 2026 18:53:53 GMT
Content-Length=274
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/60a858d6138b2414
FAIL (2026-02-24 18:53:53 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18974388D2EF6F0A</RequestId><HostId></HostId></Error>"
Duration: 7.902186ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
308.275635ms
remote:
"tcp:45.38.24.2:443"
response headers:
Accept-Ranges=bytes
Content-Length=284
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
X-Xss-Protection=1; mode=block
Date=Tue, 24 Feb 2026 18:53:50 GMT
Vary=Origin
X-Amz-Request-Id=18974388270F0304
X-Request-Id=B2C8ynpzd4G
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/76ab0b30d7011402
FAIL (2026-02-24 18:53:50 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18974388270F0304</RequestId><HostId></HostId></Error>"
Duration: 308.358378ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
7.435046ms
remote:
"tcp:185.244.226.3:443"
response headers:
X-Amz-Request-Id=18974387776B267D
X-Request-Id=MNSck7tCd4h
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Date=Tue, 24 Feb 2026 18:53:47 GMT
Content-Length=274
Server=Storj
Vary=Origin
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/cadbd8b9a7703f0
FAIL (2026-02-24 18:53:47 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18974387776B267D</RequestId><HostId></HostId></Error>"
Duration: 7.459524ms edge gateway vhost bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
18 out of 60 is failed (threshold=6) [..XX..X.................X...XX...X.XX.XXXX..XX.XX...X.......]
duration:
3.34142851s
trace:
https://jaeger.dev.storj.io/trace/10158e177ae245e5
FAIL (2026-02-24 18:53:46 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.341534706s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)
antiblip:
31 out of 60 is failed (threshold=3) [...............XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..............]
duration:
928.763214ms
trace:
https://jaeger.dev.storj.io/trace/7ebec86835c4464b
FAIL (2026-02-24 18:53:45 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:43:06.746940362 (166h26m11.681394495s) [upload=146286]: Starting upload
Feb 24 18:43:06.747106775 (166h26m11.681560915s) [upload=146286]: Done starting upload
Feb 24 18:43:06.747390196 (166h26m11.681844318s) [upload=146286]: Uploading segments...
Feb 24 18:43:06.747735916 (166h26m11.682190059s) [upload=146286]: Got next segment. Inline: true
Feb 24 18:43:06.747744937 (166h26m11.682199074s) [upload=146286]: Waiting for error group managing segments...
Feb 24 18:43:06.747919695 (166h26m11.682373826s) [upload=146286]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:43:06.747926018 (166h26m11.68238015s) [upload=146286]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Feb 24 18:43:06.747929848 (166h26m11.68238398s) [upload=146286]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:43:47.388785505 (166h26m52.32323964s) [upload=146286]: Done uploading segments...
Feb 24 18:43:47.388809684 (166h26m52.323263817s) [upload=146286]: Upload finished. err: <nil>
Duration: 928.794429ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
40 out of 60 is failed (threshold=3) [........XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXXX.XX..........]
duration:
913.505197ms
trace:
https://jaeger.dev.storj.io/trace/672241cb7c0a47f8
FAIL (2026-02-24 18:53:40 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 913.545416ms core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
39 out of 60 is failed (threshold=3) [........XXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXX............]
duration:
2.723531549s
trace:
https://jaeger.dev.storj.io/trace/30d8e2a6a3198912
FAIL (2026-02-24 18:53:38 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.723560892s edge gateway us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)
antiblip:
14 out of 60 is failed (threshold=6) [..........................XX.XX.XXXXX.XX.XXX................]
duration:
486.20467ms
remote:
"tcp:185.244.226.4:443"
target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt
trace:
https://jaeger.dev.storj.io/trace/43ad6243e9f92940
FAIL (2026-02-24 18:53:36 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 486.232937ms edge linksharing bgp us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
40 out of 60 is failed (threshold=3) [.........XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...........]
duration:
1.112041209s
trace:
https://jaeger.dev.storj.io/trace/10dc5f232dfe5501
FAIL (2026-02-24 18:53:33 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.112098722s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
30 out of 60 is failed (threshold=3) [...............XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...............]
duration:
3.398237572s
trace:
https://jaeger.dev.storj.io/trace/7fde6e39a6e83ecb
FAIL (2026-02-24 18:53:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.3982659s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
8.330147ms
remote:
"tcp:185.244.226.3:443"
response headers:
Vary=Origin
X-Amz-Request-Id=18974383BABB2088
X-Xss-Protection=1; mode=block
Date=Tue, 24 Feb 2026 18:53:31 GMT
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
X-Request-Id=5XMESMPnRuT
Accept-Ranges=bytes
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/6e914b224a38dd57
FAIL (2026-02-24 18:53:31 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18974383BABB2088</RequestId><HostId></HostId></Error>"
Duration: 8.358879ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
30.05041ms
remote:
"tcp:185.244.226.3:443"
response headers:
Date=Tue, 24 Feb 2026 18:53:26 GMT
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Amz-Request-Id=18974382831E233D
X-Xss-Protection=1; mode=block
Content-Length=274
X-Request-Id=ZoQNdjnHSdp
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/4c998c2d4b2f5b17
FAIL (2026-02-24 18:53:26 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18974382831E233D</RequestId><HostId></HostId></Error>"
Duration: 30.074739ms edge gateway vhost bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
19 out of 60 is failed (threshold=6) [X..XX..X.................X...XX...X.XX.XXXX..XX.XX...X......]
duration:
4.431251349s
trace:
https://jaeger.dev.storj.io/trace/10158e177ae245e5
FAIL (2026-02-24 18:53:17 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 4.431281685s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
43 out of 60 is failed (threshold=3) [.......XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXX.X........]
duration:
1.519811838s
trace:
https://jaeger.dev.storj.io/trace/c2303a2d8cc4559
FAIL (2026-02-24 18:53:16 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:46:25.455945314 (166h29m30.390399449s) [upload=146330]: Starting upload
Feb 24 18:46:25.456028421 (166h29m30.390482554s) [upload=146330]: Done starting upload
Feb 24 18:46:25.456183000 (166h29m30.390637123s) [upload=146330]: Uploading segments...
Feb 24 18:46:25.456241745 (166h29m30.390695879s) [upload=146330]: Got next segment. Inline: true
Feb 24 18:46:25.456248406 (166h29m30.390702538s) [upload=146330]: Waiting for error group managing segments...
Feb 24 18:46:25.456313221 (166h29m30.390767353s) [upload=146330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:46:25.456318913 (166h29m30.390773046s) [upload=146330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Feb 24 18:46:25.456322453 (166h29m30.390776585s) [upload=146330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:46:42.336159913 (166h29m47.270614055s) [upload=146330]: Done uploading segments...
Feb 24 18:46:42.336191328 (166h29m47.270645479s) [upload=146330]: Upload finished. err: <nil>
Duration: 1.519840416s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
39 out of 60 is failed (threshold=3) [.........XXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXX...........]
duration:
2.926998288s
trace:
https://jaeger.dev.storj.io/trace/30d8e2a6a3198912
FAIL (2026-02-24 18:53:16 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.927016144s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
8.458421ms
remote:
"tcp:185.244.226.3:443"
response headers:
X-Request-Id=ahhsCHWVsRf
Date=Tue, 24 Feb 2026 18:53:15 GMT
Accept-Ranges=bytes
Server=Storj
Vary=Origin
X-Amz-Request-Id=189743801EC80F80
X-Xss-Protection=1; mode=block
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/1840dfd8eda74610
FAIL (2026-02-24 18:53:15 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189743801EC80F80</RequestId><HostId></HostId></Error>"
Duration: 8.484336ms edge gateway vhost bgp ap1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
30 out of 60 is failed (threshold=3) [................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..............]
duration:
2.891010375s
trace:
https://jaeger.dev.storj.io/trace/7fde6e39a6e83ecb
FAIL (2026-02-24 18:53:12 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.891052532s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
40 out of 60 is failed (threshold=3) [..........XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..........]
duration:
1.084622602s
trace:
https://jaeger.dev.storj.io/trace/10dc5f232dfe5501
FAIL (2026-02-24 18:53:04 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.084848658s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
37 out of 60 is failed (threshold=3) [............XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X..........]
duration:
2.471465184s
trace:
https://jaeger.dev.storj.io/trace/34cb6d1b452f899e
FAIL (2026-02-24 18:53:01 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:46:10.298604913 (166h29m15.233059039s) [upload=146328]: Starting upload
Feb 24 18:46:10.298694572 (166h29m15.233148698s) [upload=146328]: Done starting upload
Feb 24 18:46:10.298808673 (166h29m15.2332628s) [upload=146328]: Uploading segments...
Feb 24 18:46:10.299060123 (166h29m15.233514248s) [upload=146328]: Got next segment. Inline: false
Feb 24 18:46:10.299127664 (166h29m15.233581869s) [upload=146328]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:46:10.299134965 (166h29m15.233589103s) [upload=146328]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 24 18:46:14.386535467 (166h29m19.320989591s) [seg_pos={0 0}, upload=146328]: Begin upload segment...
Feb 24 18:46:14.386609320 (166h29m19.321063443s) [seg_pos={0 0}, upload=146328]: Done begin upload segment.
Feb 24 18:46:14.386651770 (166h29m19.321105909s) [noise=true , address=79.127.219.41:4926   , piece_id=3MVRZCJRS4LCD5BCG2BNROH6YZLMY36KGVNGKZ3PR3662TMHGOHQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.386689137 (166h29m19.321143279s) [noise=true , address=145.79.227.9:4366    , piece_id=TP2ZYWRAS2TEU2DFFTCNMIZZLJ7ORZQJQ4YMFGKEIKTV5B2NDPZQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.387262604 (166h29m19.321716739s) [noise=true , address=145.79.227.26:4656   , piece_id=QWFLUSXVFYVWFFPC3KL5NUM325VJUF2G7L4VQ3MFVYQH5VOAKXQQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.387281978 (166h29m19.321736111s) [noise=true , address=145.79.227.13:4803   , piece_id=UHSHD5LU6FPNYTLJC7R2N47VODLCO6G4LBUSA24NK2HI4TQI7NNA, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.387684997 (166h29m19.322139139s) [noise=true , address=77.90.31.13:4626     , piece_id=SCL3JYHW2LTOHXBCMOS6XA7CIDK6UKFWDHDDACABM3IUVS4KJXPQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.387758959 (166h29m19.322213091s) [noise=true , address=145.79.227.7:4293    , piece_id=PUILSZ2JFEXXCQE3TXPLTM4RAUYEQ6WLQKUPPGFSDBKLEYVBUJVQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.388076578 (166h29m19.32253071s) [noise=true , address=145.79.227.17:4972   , piece_id=BK7RYKZEK43T6E5PDP4BQFU5FSD5GPFPDA6IFMLDBBK24IURPKRQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.388338636 (166h29m19.322792779s) [noise=true , address=145.79.227.19:4077   , piece_id=FUZVWTJIOR5X6NN5W53FSQSDCWZ7H7NTUP7QR7ZD77OLCMGNF3BQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.388522986 (166h29m19.322977124s) [noise=true , address=79.127.219.38:4817   , piece_id=VSDJRVJRSZRXKAGGXBPMCVUIJZR4OE3WFTQM44EG5QGCBYF6EKHA, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.388955917 (166h29m19.323410053s) [noise=true , address=145.79.227.39:4018   , piece_id=AEXOUAJGZBAHJQZGUQ54JLKQZTMYXNW55FPQUA2DDISFVRZLJWKA, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.388962547 (166h29m19.323416671s) [noise=true , address=145.79.227.42:4125   , piece_id=VW5NSROAUYOPDHQKBQAAOSZJVCBXX7MA5VZNDBBQHOC6WPJJO3TQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.389487579 (166h29m19.323941717s) [noise=true , address=145.79.227.3:4155    , piece_id=OGUK5XPPX6GJXKWJO4APHD2P2H6QLPCYGZKLYJGHNAFPJV3JBHAQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.389656635 (166h29m19.324110777s) [noise=true , address=145.79.227.45:4234   , piece_id=NIKILNGW7SNYD5G4FLW3MDGR36PR36OBUTWVXKHNX3PN3I7PDJXA, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.389904102 (166h29m19.324358239s) [noise=true , address=77.90.31.17:4770     , piece_id=G6GOXLZFNFPSOAOKUZ576KVWUH7VVGTUKP6YELJNYA6QKSQ6V43Q, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.390173491 (166h29m19.324627638s) [noise=true , address=45.91.116.10:4084    , piece_id=B3T4IS2GQGE3672YMZBH573JV5UNAXBH6MTMHBCQQDH6YRGDDSOQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.390680007 (166h29m19.325134143s) [noise=true , address=77.90.31.15:4700     , piece_id=RXMZF53ZHZARKQF5YXWLJT7TWQOJWVW3F4GT3OBS6FYG3BP2AANA, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.999552917 (166h29m19.934007055s) [upload=146328]: Next returned nil segment
Feb 24 18:46:14.999572659 (166h29m19.934026808s) [upload=146328]: Waiting for error group managing segments...
Feb 24 18:46:15.133573664 (166h29m20.068027806s) [noise=true , address=145.79.227.19:4077   , piece_id=FUZVWTJIOR5X6NN5W53FSQSDCWZ7H7NTUP7QR7ZD77OLCMGNF3BQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.135121334 (166h29m20.069575489s) [noise=true , address=145.79.227.13:4803   , piece_id=UHSHD5LU6FPNYTLJC7R2N47VODLCO6G4LBUSA24NK2HI4TQI7NNA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.135808911 (166h29m20.070263048s) [noise=true , address=145.79.227.3:4155    , piece_id=OGUK5XPPX6GJXKWJO4APHD2P2H6QLPCYGZKLYJGHNAFPJV3JBHAQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.136063429 (166h29m20.070517571s) [noise=true , address=45.91.116.10:4084    , piece_id=B3T4IS2GQGE3672YMZBH573JV5UNAXBH6MTMHBCQQDH6YRGDDSOQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.147571506 (166h29m20.08202564s) [noise=true , address=145.79.227.42:4125   , piece_id=VW5NSROAUYOPDHQKBQAAOSZJVCBXX7MA5VZNDBBQHOC6WPJJO3TQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.152125874 (166h29m20.086580008s) [noise=true , address=145.79.227.7:4293    , piece_id=PUILSZ2JFEXXCQE3TXPLTM4RAUYEQ6WLQKUPPGFSDBKLEYVBUJVQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.156384278 (166h29m20.090838414s) [noise=true , address=145.79.227.39:4018   , piece_id=AEXOUAJGZBAHJQZGUQ54JLKQZTMYXNW55FPQUA2DDISFVRZLJWKA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.156878029 (166h29m20.091332164s) [noise=true , address=145.79.227.9:4366    , piece_id=TP2ZYWRAS2TEU2DFFTCNMIZZLJ7ORZQJQ4YMFGKEIKTV5B2NDPZQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.158388008 (166h29m20.092842152s) [noise=true , address=145.79.227.45:4234   , piece_id=NIKILNGW7SNYD5G4FLW3MDGR36PR36OBUTWVXKHNX3PN3I7PDJXA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.158969175 (166h29m20.09342331s) [noise=true , address=145.79.227.17:4972   , piece_id=BK7RYKZEK43T6E5PDP4BQFU5FSD5GPFPDA6IFMLDBBK24IURPKRQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.161901086 (166h29m20.096355222s) [noise=true , address=79.127.219.41:4926   , piece_id=3MVRZCJRS4LCD5BCG2BNROH6YZLMY36KGVNGKZ3PR3662TMHGOHQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.167562010 (166h29m20.102016148s) [noise=true , address=79.127.219.38:4817   , piece_id=VSDJRVJRSZRXKAGGXBPMCVUIJZR4OE3WFTQM44EG5QGCBYF6EKHA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.197064489 (166h29m20.131518639s) [noise=true , address=77.90.31.13:4626     , piece_id=SCL3JYHW2LTOHXBCMOS6XA7CIDK6UKFWDHDDACABM3IUVS4KJXPQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.197191533 (166h29m20.131645675s) [seg_pos={0 0}, upload=146328]: Satisfied cohort requirements after 13 pieces
Feb 24 18:46:15.197465113 (166h29m20.131919257s) [noise=true , address=145.79.227.26:4656   , piece_id=QWFLUSXVFYVWFFPC3KL5NUM325VJUF2G7L4VQ3MFVYQH5VOAKXQQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u6e2ZjrPg2q3EDN2ZjDj9hzEmCAoRvt39HMeM79gcVmMVm53j): protocol: expected piece hash; context canceled; EOF
Feb 24 18:46:15.197478634 (166h29m20.131932777s) [noise=true , address=145.79.227.26:4656   , piece_id=QWFLUSXVFYVWFFPC3KL5NUM325VJUF2G7L4VQ3MFVYQH5VOAKXQQ, seg_pos={0 0}, upload=146328]: Long tail cancellation due to optimal threshold
Feb 24 18:46:15.197655516 (166h29m20.13210966s) [noise=true , address=77.90.31.17:4770     , piece_id=G6GOXLZFNFPSOAOKUZ576KVWUH7VVGTUKP6YELJNYA6QKSQ6V43Q, seg_pos={0 0}, upload=146328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Feb 24 18:46:15.197666194 (166h29m20.132120336s) [noise=true , address=77.90.31.17:4770     , piece_id=G6GOXLZFNFPSOAOKUZ576KVWUH7VVGTUKP6YELJNYA6QKSQ6V43Q, seg_pos={0 0}, upload=146328]: Long tail cancellation due to optimal threshold
Feb 24 18:46:15.197767092 (166h29m20.132221229s) [noise=true , address=77.90.31.15:4700     , piece_id=RXMZF53ZHZARKQF5YXWLJT7TWQOJWVW3F4GT3OBS6FYG3BP2AANA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q): protocol: expected piece hash; context canceled; EOF
Feb 24 18:46:15.197783861 (166h29m20.132237994s) [noise=true , address=77.90.31.15:4700     , piece_id=RXMZF53ZHZARKQF5YXWLJT7TWQOJWVW3F4GT3OBS6FYG3BP2AANA, seg_pos={0 0}, upload=146328]: Long tail cancellation due to optimal threshold
Feb 24 18:46:15.197815694 (166h29m20.132269813s) [seg_pos={0 0}, upload=146328]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 24 18:46:15.197905836 (166h29m20.132359971s) [upload=146328]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 24 18:46:15.197936276 (166h29m20.132390411s) [upload=146328]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:46:25.272856749 (166h29m30.207310871s) [upload=146328]: Done uploading segments...
Feb 24 18:46:25.272890825 (166h29m30.207344961s) [upload=146328]: Upload finished. err: <nil>
Duration: 2.471501689s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
19 out of 60 is failed (threshold=6) [.X..XX..X.................X...XX...X.XX.XXXX..XX.XX...X.....]
duration:
1.770815397s
trace:
https://jaeger.dev.storj.io/trace/10158e177ae245e5
FAIL (2026-02-24 18:52:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.770873435s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
10.828139ms
remote:
"tcp:185.244.226.3:443"
response headers:
Accept-Ranges=bytes
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Vary=Origin
X-Amz-Request-Id=1897437BD36BA6D8
X-Request-Id=bNq8VS17RdS
Server=Storj
X-Xss-Protection=1; mode=block
Date=Tue, 24 Feb 2026 18:52:57 GMT
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/639631610c325e7d
FAIL (2026-02-24 18:52:57 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897437BD36BA6D8</RequestId><HostId></HostId></Error>"
Duration: 10.844385ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
42 out of 60 is failed (threshold=3) [.....XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...X..........]
duration:
2.281352869s
trace:
https://jaeger.dev.storj.io/trace/5f0b31811a3a7df8
FAIL (2026-02-24 18:52:51 UTC)
orbiter warning: operation: DeleteObject
uplink: metaclient: context deadline exceeded
Duration: 2.281482765s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
18 out of 60 is failed (threshold=3) [............................XXXXXXXXXXXXXXXXXX..............]
duration:
3.159468095s
trace:
https://jaeger.dev.storj.io/trace/73cef0d4f8588a82
FAIL (2026-02-24 18:52:51 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Feb 24 18:42:40.331706604 (166h25m45.266160746s) [upload=146280]: Starting upload
Feb 24 18:42:40.331826626 (166h25m45.266280764s) [upload=146280]: Done starting upload
Feb 24 18:42:40.331904481 (166h25m45.266358598s) [upload=146280]: Uploading segments...
Feb 24 18:42:40.332266211 (166h25m45.266720352s) [upload=146280]: Got next segment. Inline: false
Feb 24 18:42:40.332351248 (166h25m45.266805381s) [upload=146280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:42:40.332357321 (166h25m45.266811453s) [upload=146280]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 24 18:43:40.022165933 (166h26m44.956620058s) [upload=146280]: Next segment err: context deadline exceeded
Feb 24 18:43:40.022586871 (166h26m44.957040994s) [upload=146280]: Done uploading segments...
Feb 24 18:43:40.022728565 (166h26m44.957182691s) [upload=146280]: Upload finished. err: context deadline exceeded
Duration: 3.159499209s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)
antiblip:
14 out of 60 is failed (threshold=6) [...........................XX.XX.XXXXX.XX.XXX...............]
duration:
113.172611ms
remote:
"tcp:185.244.226.4:443"
target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt
trace:
https://jaeger.dev.storj.io/trace/43ad6243e9f92940
FAIL (2026-02-24 18:52:50 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 113.200502ms edge linksharing bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
9.02537ms
remote:
"tcp:185.244.226.3:443"
response headers:
Accept-Ranges=bytes
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Vary=Origin
X-Xss-Protection=1; mode=block
Date=Tue, 24 Feb 2026 18:52:48 GMT
Content-Type=application/xml
Server=Storj
X-Amz-Request-Id=18974379C2690785
X-Request-Id=QfqLMWLJ4Mj
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/4719ac4efa3e3e60
FAIL (2026-02-24 18:52:48 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18974379C2690785</RequestId><HostId></HostId></Error>"
Duration: 9.082275ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
9.037293ms
remote:
"tcp:185.244.226.3:443"
response headers:
X-Xss-Protection=1; mode=block
Date=Tue, 24 Feb 2026 18:52:44 GMT
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
X-Request-Id=MKoxGGWD6qw
Accept-Ranges=bytes
Vary=Origin
X-Amz-Request-Id=18974378C72B412C
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/63a55ffd7e93bd62
FAIL (2026-02-24 18:52:44 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18974378C72B412C</RequestId><HostId></HostId></Error>"
Duration: 9.146156ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
286.988001ms
remote:
"tcp:45.38.24.2:443"
response headers:
Content-Length=284
Content-Security-Policy=block-all-mixed-content
Server=Storj
Vary=Origin
Accept-Ranges=bytes
Content-Type=application/xml
X-Amz-Request-Id=189743778CA6B7CF
X-Request-Id=CS2TgePwJG1
X-Xss-Protection=1; mode=block
Date=Tue, 24 Feb 2026 18:52:39 GMT
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/6bc5bc3ea81afc8a
FAIL (2026-02-24 18:52:39 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189743778CA6B7CF</RequestId><HostId></HostId></Error>"
Duration: 287.012712ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
9.046552ms
remote:
"tcp:185.244.226.3:443"
response headers:
Accept-Ranges=bytes
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
X-Amz-Request-Id=189743779D14BBB9
X-Request-Id=VhdLujeoBNV
X-Xss-Protection=1; mode=block
Vary=Origin
Date=Tue, 24 Feb 2026 18:52:39 GMT
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/39c4d62066f3ac90
FAIL (2026-02-24 18:52:39 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189743779D14BBB9</RequestId><HostId></HostId></Error>"
Duration: 9.08665ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
40 out of 60 is failed (threshold=3) [.........XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXXX.XX.........]
duration:
946.608281ms
trace:
https://jaeger.dev.storj.io/trace/672241cb7c0a47f8
FAIL (2026-02-24 18:52:37 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 946.643617ms core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
30 out of 60 is failed (threshold=3) [.................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.............]
duration:
2.910838273s
trace:
https://jaeger.dev.storj.io/trace/7fde6e39a6e83ecb
FAIL (2026-02-24 18:52:36 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.910867002s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
43 out of 60 is failed (threshold=3) [........XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXX.X.......]
duration:
1.167697517s
trace:
https://jaeger.dev.storj.io/trace/c2303a2d8cc4559
FAIL (2026-02-24 18:52:34 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:46:25.455945314 (166h29m30.390399449s) [upload=146330]: Starting upload
Feb 24 18:46:25.456028421 (166h29m30.390482554s) [upload=146330]: Done starting upload
Feb 24 18:46:25.456183000 (166h29m30.390637123s) [upload=146330]: Uploading segments...
Feb 24 18:46:25.456241745 (166h29m30.390695879s) [upload=146330]: Got next segment. Inline: true
Feb 24 18:46:25.456248406 (166h29m30.390702538s) [upload=146330]: Waiting for error group managing segments...
Feb 24 18:46:25.456313221 (166h29m30.390767353s) [upload=146330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:46:25.456318913 (166h29m30.390773046s) [upload=146330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Feb 24 18:46:25.456322453 (166h29m30.390776585s) [upload=146330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:46:42.336159913 (166h29m47.270614055s) [upload=146330]: Done uploading segments...
Feb 24 18:46:42.336191328 (166h29m47.270645479s) [upload=146330]: Upload finished. err: <nil>
Duration: 1.167726507s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
37 out of 60 is failed (threshold=3) [.............XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X.........]
duration:
3.297547852s
trace:
https://jaeger.dev.storj.io/trace/34cb6d1b452f899e
FAIL (2026-02-24 18:52:32 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:46:10.298604913 (166h29m15.233059039s) [upload=146328]: Starting upload
Feb 24 18:46:10.298694572 (166h29m15.233148698s) [upload=146328]: Done starting upload
Feb 24 18:46:10.298808673 (166h29m15.2332628s) [upload=146328]: Uploading segments...
Feb 24 18:46:10.299060123 (166h29m15.233514248s) [upload=146328]: Got next segment. Inline: false
Feb 24 18:46:10.299127664 (166h29m15.233581869s) [upload=146328]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:46:10.299134965 (166h29m15.233589103s) [upload=146328]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 24 18:46:14.386535467 (166h29m19.320989591s) [seg_pos={0 0}, upload=146328]: Begin upload segment...
Feb 24 18:46:14.386609320 (166h29m19.321063443s) [seg_pos={0 0}, upload=146328]: Done begin upload segment.
Feb 24 18:46:14.386651770 (166h29m19.321105909s) [noise=true , address=79.127.219.41:4926   , piece_id=3MVRZCJRS4LCD5BCG2BNROH6YZLMY36KGVNGKZ3PR3662TMHGOHQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.386689137 (166h29m19.321143279s) [noise=true , address=145.79.227.9:4366    , piece_id=TP2ZYWRAS2TEU2DFFTCNMIZZLJ7ORZQJQ4YMFGKEIKTV5B2NDPZQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.387262604 (166h29m19.321716739s) [noise=true , address=145.79.227.26:4656   , piece_id=QWFLUSXVFYVWFFPC3KL5NUM325VJUF2G7L4VQ3MFVYQH5VOAKXQQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.387281978 (166h29m19.321736111s) [noise=true , address=145.79.227.13:4803   , piece_id=UHSHD5LU6FPNYTLJC7R2N47VODLCO6G4LBUSA24NK2HI4TQI7NNA, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.387684997 (166h29m19.322139139s) [noise=true , address=77.90.31.13:4626     , piece_id=SCL3JYHW2LTOHXBCMOS6XA7CIDK6UKFWDHDDACABM3IUVS4KJXPQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.387758959 (166h29m19.322213091s) [noise=true , address=145.79.227.7:4293    , piece_id=PUILSZ2JFEXXCQE3TXPLTM4RAUYEQ6WLQKUPPGFSDBKLEYVBUJVQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.388076578 (166h29m19.32253071s) [noise=true , address=145.79.227.17:4972   , piece_id=BK7RYKZEK43T6E5PDP4BQFU5FSD5GPFPDA6IFMLDBBK24IURPKRQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.388338636 (166h29m19.322792779s) [noise=true , address=145.79.227.19:4077   , piece_id=FUZVWTJIOR5X6NN5W53FSQSDCWZ7H7NTUP7QR7ZD77OLCMGNF3BQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.388522986 (166h29m19.322977124s) [noise=true , address=79.127.219.38:4817   , piece_id=VSDJRVJRSZRXKAGGXBPMCVUIJZR4OE3WFTQM44EG5QGCBYF6EKHA, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.388955917 (166h29m19.323410053s) [noise=true , address=145.79.227.39:4018   , piece_id=AEXOUAJGZBAHJQZGUQ54JLKQZTMYXNW55FPQUA2DDISFVRZLJWKA, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.388962547 (166h29m19.323416671s) [noise=true , address=145.79.227.42:4125   , piece_id=VW5NSROAUYOPDHQKBQAAOSZJVCBXX7MA5VZNDBBQHOC6WPJJO3TQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.389487579 (166h29m19.323941717s) [noise=true , address=145.79.227.3:4155    , piece_id=OGUK5XPPX6GJXKWJO4APHD2P2H6QLPCYGZKLYJGHNAFPJV3JBHAQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.389656635 (166h29m19.324110777s) [noise=true , address=145.79.227.45:4234   , piece_id=NIKILNGW7SNYD5G4FLW3MDGR36PR36OBUTWVXKHNX3PN3I7PDJXA, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.389904102 (166h29m19.324358239s) [noise=true , address=77.90.31.17:4770     , piece_id=G6GOXLZFNFPSOAOKUZ576KVWUH7VVGTUKP6YELJNYA6QKSQ6V43Q, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.390173491 (166h29m19.324627638s) [noise=true , address=45.91.116.10:4084    , piece_id=B3T4IS2GQGE3672YMZBH573JV5UNAXBH6MTMHBCQQDH6YRGDDSOQ, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.390680007 (166h29m19.325134143s) [noise=true , address=77.90.31.15:4700     , piece_id=RXMZF53ZHZARKQF5YXWLJT7TWQOJWVW3F4GT3OBS6FYG3BP2AANA, seg_pos={0 0}, upload=146328]: Uploading piece...
Feb 24 18:46:14.999552917 (166h29m19.934007055s) [upload=146328]: Next returned nil segment
Feb 24 18:46:14.999572659 (166h29m19.934026808s) [upload=146328]: Waiting for error group managing segments...
Feb 24 18:46:15.133573664 (166h29m20.068027806s) [noise=true , address=145.79.227.19:4077   , piece_id=FUZVWTJIOR5X6NN5W53FSQSDCWZ7H7NTUP7QR7ZD77OLCMGNF3BQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.135121334 (166h29m20.069575489s) [noise=true , address=145.79.227.13:4803   , piece_id=UHSHD5LU6FPNYTLJC7R2N47VODLCO6G4LBUSA24NK2HI4TQI7NNA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.135808911 (166h29m20.070263048s) [noise=true , address=145.79.227.3:4155    , piece_id=OGUK5XPPX6GJXKWJO4APHD2P2H6QLPCYGZKLYJGHNAFPJV3JBHAQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.136063429 (166h29m20.070517571s) [noise=true , address=45.91.116.10:4084    , piece_id=B3T4IS2GQGE3672YMZBH573JV5UNAXBH6MTMHBCQQDH6YRGDDSOQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.147571506 (166h29m20.08202564s) [noise=true , address=145.79.227.42:4125   , piece_id=VW5NSROAUYOPDHQKBQAAOSZJVCBXX7MA5VZNDBBQHOC6WPJJO3TQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.152125874 (166h29m20.086580008s) [noise=true , address=145.79.227.7:4293    , piece_id=PUILSZ2JFEXXCQE3TXPLTM4RAUYEQ6WLQKUPPGFSDBKLEYVBUJVQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.156384278 (166h29m20.090838414s) [noise=true , address=145.79.227.39:4018   , piece_id=AEXOUAJGZBAHJQZGUQ54JLKQZTMYXNW55FPQUA2DDISFVRZLJWKA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.156878029 (166h29m20.091332164s) [noise=true , address=145.79.227.9:4366    , piece_id=TP2ZYWRAS2TEU2DFFTCNMIZZLJ7ORZQJQ4YMFGKEIKTV5B2NDPZQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.158388008 (166h29m20.092842152s) [noise=true , address=145.79.227.45:4234   , piece_id=NIKILNGW7SNYD5G4FLW3MDGR36PR36OBUTWVXKHNX3PN3I7PDJXA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.158969175 (166h29m20.09342331s) [noise=true , address=145.79.227.17:4972   , piece_id=BK7RYKZEK43T6E5PDP4BQFU5FSD5GPFPDA6IFMLDBBK24IURPKRQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.161901086 (166h29m20.096355222s) [noise=true , address=79.127.219.41:4926   , piece_id=3MVRZCJRS4LCD5BCG2BNROH6YZLMY36KGVNGKZ3PR3662TMHGOHQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.167562010 (166h29m20.102016148s) [noise=true , address=79.127.219.38:4817   , piece_id=VSDJRVJRSZRXKAGGXBPMCVUIJZR4OE3WFTQM44EG5QGCBYF6EKHA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.197064489 (166h29m20.131518639s) [noise=true , address=77.90.31.13:4626     , piece_id=SCL3JYHW2LTOHXBCMOS6XA7CIDK6UKFWDHDDACABM3IUVS4KJXPQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: <nil>
Feb 24 18:46:15.197191533 (166h29m20.131645675s) [seg_pos={0 0}, upload=146328]: Satisfied cohort requirements after 13 pieces
Feb 24 18:46:15.197465113 (166h29m20.131919257s) [noise=true , address=145.79.227.26:4656   , piece_id=QWFLUSXVFYVWFFPC3KL5NUM325VJUF2G7L4VQ3MFVYQH5VOAKXQQ, seg_pos={0 0}, upload=146328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u6e2ZjrPg2q3EDN2ZjDj9hzEmCAoRvt39HMeM79gcVmMVm53j): protocol: expected piece hash; context canceled; EOF
Feb 24 18:46:15.197478634 (166h29m20.131932777s) [noise=true , address=145.79.227.26:4656   , piece_id=QWFLUSXVFYVWFFPC3KL5NUM325VJUF2G7L4VQ3MFVYQH5VOAKXQQ, seg_pos={0 0}, upload=146328]: Long tail cancellation due to optimal threshold
Feb 24 18:46:15.197655516 (166h29m20.13210966s) [noise=true , address=77.90.31.17:4770     , piece_id=G6GOXLZFNFPSOAOKUZ576KVWUH7VVGTUKP6YELJNYA6QKSQ6V43Q, seg_pos={0 0}, upload=146328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF
Feb 24 18:46:15.197666194 (166h29m20.132120336s) [noise=true , address=77.90.31.17:4770     , piece_id=G6GOXLZFNFPSOAOKUZ576KVWUH7VVGTUKP6YELJNYA6QKSQ6V43Q, seg_pos={0 0}, upload=146328]: Long tail cancellation due to optimal threshold
Feb 24 18:46:15.197767092 (166h29m20.132221229s) [noise=true , address=77.90.31.15:4700     , piece_id=RXMZF53ZHZARKQF5YXWLJT7TWQOJWVW3F4GT3OBS6FYG3BP2AANA, seg_pos={0 0}, upload=146328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q): protocol: expected piece hash; context canceled; EOF
Feb 24 18:46:15.197783861 (166h29m20.132237994s) [noise=true , address=77.90.31.15:4700     , piece_id=RXMZF53ZHZARKQF5YXWLJT7TWQOJWVW3F4GT3OBS6FYG3BP2AANA, seg_pos={0 0}, upload=146328]: Long tail cancellation due to optimal threshold
Feb 24 18:46:15.197815694 (166h29m20.132269813s) [seg_pos={0 0}, upload=146328]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 24 18:46:15.197905836 (166h29m20.132359971s) [upload=146328]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 24 18:46:15.197936276 (166h29m20.132390411s) [upload=146328]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:46:25.272856749 (166h29m30.207310871s) [upload=146328]: Done uploading segments...
Feb 24 18:46:25.272890825 (166h29m30.207344961s) [upload=146328]: Upload finished. err: <nil>
Duration: 3.297659931s core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
12.172374ms
remote:
"tcp:185.244.226.3:443"
response headers:
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Amz-Request-Id=18974375E393553A
X-Request-Id=HHmPaxmyVxR
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Date=Tue, 24 Feb 2026 18:52:32 GMT
Content-Length=274
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/58c766cade81cd28
FAIL (2026-02-24 18:52:32 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18974375E393553A</RequestId><HostId></HostId></Error>"
Duration: 12.197488ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
42 out of 60 is failed (threshold=3) [......XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...X.........]
duration:
2.341114938s
trace:
https://jaeger.dev.storj.io/trace/5f0b31811a3a7df8
FAIL (2026-02-24 18:52:31 UTC)
orbiter warning: operation: DeleteObject
uplink: metaclient: context deadline exceeded
Duration: 2.341145728s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)
antiblip:
31 out of 60 is failed (threshold=3) [................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.............]
duration:
1.009467347s
trace:
https://jaeger.dev.storj.io/trace/7ebec86835c4464b
FAIL (2026-02-24 18:52:31 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:43:06.746940362 (166h26m11.681394495s) [upload=146286]: Starting upload
Feb 24 18:43:06.747106775 (166h26m11.681560915s) [upload=146286]: Done starting upload
Feb 24 18:43:06.747390196 (166h26m11.681844318s) [upload=146286]: Uploading segments...
Feb 24 18:43:06.747735916 (166h26m11.682190059s) [upload=146286]: Got next segment. Inline: true
Feb 24 18:43:06.747744937 (166h26m11.682199074s) [upload=146286]: Waiting for error group managing segments...
Feb 24 18:43:06.747919695 (166h26m11.682373826s) [upload=146286]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:43:06.747926018 (166h26m11.68238015s) [upload=146286]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Feb 24 18:43:06.747929848 (166h26m11.68238398s) [upload=146286]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:43:47.388785505 (166h26m52.32323964s) [upload=146286]: Done uploading segments...
Feb 24 18:43:47.388809684 (166h26m52.323263817s) [upload=146286]: Upload finished. err: <nil>
Duration: 1.009493788s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
40 out of 60 is failed (threshold=3) [...........XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.........]
duration:
1.141575002s
trace:
https://jaeger.dev.storj.io/trace/10dc5f232dfe5501
FAIL (2026-02-24 18:52:30 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.141593846s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
39 out of 60 is failed (threshold=3) [..........XXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXX..........]
duration:
2.965653344s
trace:
https://jaeger.dev.storj.io/trace/30d8e2a6a3198912
FAIL (2026-02-24 18:52:20 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.965680843s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
287.381925ms
remote:
"tcp:45.38.24.2:443"
response headers:
Vary=Origin
X-Amz-Request-Id=18974372E04A93EF
Date=Tue, 24 Feb 2026 18:52:19 GMT
Accept-Ranges=bytes
Content-Length=284
Content-Security-Policy=block-all-mixed-content
Server=Storj
X-Request-Id=F2HoLguKhhC
X-Xss-Protection=1; mode=block
Content-Type=application/xml
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/2b71f4468833cdf
FAIL (2026-02-24 18:52:19 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18974372E04A93EF</RequestId><HostId></HostId></Error>"
Duration: 287.409144ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
40 out of 60 is failed (threshold=3) [............XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX........]
duration:
1.361206347s
trace:
https://jaeger.dev.storj.io/trace/10dc5f232dfe5501
FAIL (2026-02-24 18:52:12 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.361233236s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
42 out of 60 is failed (threshold=3) [.......XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...X........]
duration:
2.335318888s
trace:
https://jaeger.dev.storj.io/trace/5f0b31811a3a7df8
FAIL (2026-02-24 18:52:11 UTC)
orbiter warning: operation: DeleteObject
uplink: metaclient: context deadline exceeded
Duration: 2.335353128s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
18 out of 60 is failed (threshold=3) [.............................XXXXXXXXXXXXXXXXXX.............]
duration:
3.053111256s
trace:
https://jaeger.dev.storj.io/trace/73cef0d4f8588a82
FAIL (2026-02-24 18:52:11 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Feb 24 18:42:40.331706604 (166h25m45.266160746s) [upload=146280]: Starting upload
Feb 24 18:42:40.331826626 (166h25m45.266280764s) [upload=146280]: Done starting upload
Feb 24 18:42:40.331904481 (166h25m45.266358598s) [upload=146280]: Uploading segments...
Feb 24 18:42:40.332266211 (166h25m45.266720352s) [upload=146280]: Got next segment. Inline: false
Feb 24 18:42:40.332351248 (166h25m45.266805381s) [upload=146280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:42:40.332357321 (166h25m45.266811453s) [upload=146280]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 24 18:43:40.022165933 (166h26m44.956620058s) [upload=146280]: Next segment err: context deadline exceeded
Feb 24 18:43:40.022586871 (166h26m44.957040994s) [upload=146280]: Done uploading segments...
Feb 24 18:43:40.022728565 (166h26m44.957182691s) [upload=146280]: Upload finished. err: context deadline exceeded
Duration: 3.053156014s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
43 out of 60 is failed (threshold=3) [.........XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXX.X......]
duration:
953.667895ms
trace:
https://jaeger.dev.storj.io/trace/c2303a2d8cc4559
FAIL (2026-02-24 18:52:05 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:46:25.455945314 (166h29m30.390399449s) [upload=146330]: Starting upload
Feb 24 18:46:25.456028421 (166h29m30.390482554s) [upload=146330]: Done starting upload
Feb 24 18:46:25.456183000 (166h29m30.390637123s) [upload=146330]: Uploading segments...
Feb 24 18:46:25.456241745 (166h29m30.390695879s) [upload=146330]: Got next segment. Inline: true
Feb 24 18:46:25.456248406 (166h29m30.390702538s) [upload=146330]: Waiting for error group managing segments...
Feb 24 18:46:25.456313221 (166h29m30.390767353s) [upload=146330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:46:25.456318913 (166h29m30.390773046s) [upload=146330]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Feb 24 18:46:25.456322453 (166h29m30.390776585s) [upload=146330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:46:42.336159913 (166h29m47.270614055s) [upload=146330]: Done uploading segments...
Feb 24 18:46:42.336191328 (166h29m47.270645479s) [upload=146330]: Upload finished. err: <nil>
Duration: 953.713203ms core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
8.06533ms
remote:
"tcp:185.244.226.3:443"
response headers:
Content-Length=274
Vary=Origin
X-Amz-Request-Id=1897436FA0006C12
X-Request-Id=fiA1H2MwSZF
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
Date=Tue, 24 Feb 2026 18:52:05 GMT
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/533c44be8cf5ed60
FAIL (2026-02-24 18:52:05 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897436FA0006C12</RequestId><HostId></HostId></Error>"
Duration: 8.09296ms edge gateway vhost bgp us1