Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
3.360502854s
FAIL (2025-09-30 06:04:24 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.360613577s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................................XX..................] duration:
1.162027087s
FAIL (2025-09-30 06:04:24 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 1.162056229s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.84263411s
FAIL (2025-09-30 06:03:57 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.842721548s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.........................................XXX................] duration:
927.044866ms
FAIL (2025-09-30 06:03:46 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 26 but got 0)
======LOGS======
[noise=true , address=81.171.14.70:4045 , piece_id=DD53MUKF24OCOLISJNN4F2ESSJSAM6KTBCIHF4UJVOYLKPOLANEA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648490545 (160h22m57.451955126s) [noise=true , address=89.149.201.147:4013 , piece_id=RSPYSYOBACSJ4OKRGV7NQNNQT5ORQJNX4RZVVPHHHM63DYN4KCIQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: rpc: dial tcp 89.149.201.147:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648635402 (160h22m57.452099988s) [noise=true , address=185.167.204.206:4050 , piece_id=DHS3HOFXUBK4BKB5NVZVLDMNI2ZKTP6RVK4KJ2MVL67V47IL2Z3A, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648822212 (160h22m57.452286803s) [noise=true , address=81.171.14.70:4038 , piece_id=T5H2PB2PIPPCGVEDBD4PN5K7VI6TDMKXP6QW242EA6LMFJCAS4OQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: rpc: dial tcp 81.171.14.70:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648970309 (160h22m57.452434895s) [noise=true , address=89.149.201.147:4005 , piece_id=5UJBQPRPDDKVBMIPOZNSE2ZD5TL2KQFP7BNIHXYDW7XFTUCZ4KNA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649153071 (160h22m57.452617658s) [noise=true , address=89.149.201.147:4016 , piece_id=UUNTWX7FB4I7YG2LDN2Y2WP7BHXHZHYKNQROUVFRAMHEKEJQF6VA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649337300 (160h22m57.452801882s) [noise=true , address=185.167.204.205:4027 , piece_id=WTCV2L3SLOFED6725FQ46U3JEO2LE76LH2N4W767PMAFZ4DNGTWA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649489850 (160h22m57.45295445s) [noise=true , address=185.167.204.205:4025 , piece_id=KFG5MK4RB57N2XF4ZLMTAJ7HCCBSJUIGRFQRA3QOFEAHYRRZEUKQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649644940 (160h22m57.453109528s) [noise=true , address=81.171.14.70:4047 , piece_id=O6W5TPWL24YQCYKT7GWQ7T3GA55DIBTFU5HL244L6ZYXYMQQYMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: rpc: dial tcp 81.171.14.70:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649837367 (160h22m57.453301961s) [noise=true , address=89.149.201.147:4022 , piece_id=BLOGBOXX6FBANQXXBUN3BQWRWAH3PC43VZCIDRIXROQM2ZAV7NOA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: rpc: dial tcp 89.149.201.147:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650055408 (160h22m57.453519984s) [noise=true , address=185.167.204.206:4064 , piece_id=MAC6XEQNR2UYDLEDIPXR3VYLH4SR7VEI3RCJ27E24EIMIF4DSSGA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650229995 (160h22m57.453694573s) [noise=true , address=185.167.204.205:4012 , piece_id=X4IQFROU2Y2GCPBFNFIGBIV54LWLFY7UGPZ2YOB34ZZHAEQ3MBEQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650390416 (160h22m57.453855007s) [noise=true , address=89.149.201.147:4021 , piece_id=MAEF5F7L3C47ZSOTPF2Z5PWHXMTYUTFIZ6Z756MONBCQDDAF5BYQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: rpc: dial tcp 89.149.201.147:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650549336 (160h22m57.454013931s) [noise=true , address=185.167.204.205:4011 , piece_id=TTQHENFBPMCI3PZQEKV52IO3OUBDS5ACHCV2K34UHCSQRCQXZRVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650715583 (160h22m57.454180175s) [noise=true , address=185.167.204.205:4008 , piece_id=TG5PNUZMD6HB7AYOWQM6LAJIC4DFSGSWPPOLWD42ZLZQIA7TFOFA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650879777 (160h22m57.454344374s) [noise=true , address=185.167.204.206:4049 , piece_id=JJL2EE4FSKLKYNZIQC4DPZICJBM2V7T6FUIJKNOZVPXY3FCK4GLQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651037802 (160h22m57.454502453s) [noise=true , address=185.167.204.205:4014 , piece_id=MJELQYF2MKIHI6UX2AFF7NTABPPTZ7NYEZN5GQNKOFBBAQ4XOKAA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651306523 (160h22m57.454771119s) [noise=true , address=81.171.14.70:4029 , piece_id=PMDZH27BZU52YWCVRUHLQB7K6CFGWK2UQKVFYMWJZMT53R5T3IVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651476372 (160h22m57.45494095s) [noise=true , address=81.171.14.70:4048 , piece_id=UYAQIALBK6OGIZU7UFRJRWLTSQFMQRJU5A6PKWFF7QQ5VB3H4LXQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651648406 (160h22m57.455113002s) [noise=true , address=89.149.201.147:4003 , piece_id=VCVV5WC5Q7YJFQZ3LTJQZ2WHWF5ISWELC2IPX6NJTCLSCRUF4L6Q, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: rpc: dial tcp 89.149.201.147:4003: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651820843 (160h22m57.455285449s) [noise=true , address=89.149.201.147:4019 , piece_id=JOQH7YYR52QRAXMXC35XHHDHIYU57AGBD4DE4AJROTHXDNY5CMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: rpc: dial tcp 89.149.201.147:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651991651 (160h22m57.455456234s) [noise=true , address=185.167.204.205:4031 , piece_id=YHTTQIWCH2YB7HLEUVV5P2AK5OWRB52KZBKKERQBQPGRD4JSMNOQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 139.59.144.22:36174->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.652019889 (160h22m57.455484483s) [seg_pos={0 0}, upload=141188]: Done waiting for segment. successful: 0 optimal: 26 errs: <nil>
Duration: 927.078883ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................................XX.................] duration:
1.136097422s
FAIL (2025-09-30 06:03:46 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 1.136123172s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [X..............] duration:
198.745389ms target:
https://www.storj.io/
FAIL (2025-09-30 06:03:37 UTC)
orbiter warning: Get "https://www.storj.io/": dial tcp 35.152.117.67:443: i/o timeout
Duration: 198.780955ms
core
website
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........................................XXX...............] duration:
2.832570911s
FAIL (2025-09-30 06:03:28 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.832598605s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [..........................................XXX...............] duration:
905.10081ms
FAIL (2025-09-30 06:03:25 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 26 but got 0)
======LOGS======
[noise=true , address=81.171.14.70:4045 , piece_id=DD53MUKF24OCOLISJNN4F2ESSJSAM6KTBCIHF4UJVOYLKPOLANEA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648490545 (160h22m57.451955126s) [noise=true , address=89.149.201.147:4013 , piece_id=RSPYSYOBACSJ4OKRGV7NQNNQT5ORQJNX4RZVVPHHHM63DYN4KCIQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: rpc: dial tcp 89.149.201.147:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648635402 (160h22m57.452099988s) [noise=true , address=185.167.204.206:4050 , piece_id=DHS3HOFXUBK4BKB5NVZVLDMNI2ZKTP6RVK4KJ2MVL67V47IL2Z3A, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648822212 (160h22m57.452286803s) [noise=true , address=81.171.14.70:4038 , piece_id=T5H2PB2PIPPCGVEDBD4PN5K7VI6TDMKXP6QW242EA6LMFJCAS4OQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: rpc: dial tcp 81.171.14.70:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648970309 (160h22m57.452434895s) [noise=true , address=89.149.201.147:4005 , piece_id=5UJBQPRPDDKVBMIPOZNSE2ZD5TL2KQFP7BNIHXYDW7XFTUCZ4KNA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649153071 (160h22m57.452617658s) [noise=true , address=89.149.201.147:4016 , piece_id=UUNTWX7FB4I7YG2LDN2Y2WP7BHXHZHYKNQROUVFRAMHEKEJQF6VA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649337300 (160h22m57.452801882s) [noise=true , address=185.167.204.205:4027 , piece_id=WTCV2L3SLOFED6725FQ46U3JEO2LE76LH2N4W767PMAFZ4DNGTWA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649489850 (160h22m57.45295445s) [noise=true , address=185.167.204.205:4025 , piece_id=KFG5MK4RB57N2XF4ZLMTAJ7HCCBSJUIGRFQRA3QOFEAHYRRZEUKQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649644940 (160h22m57.453109528s) [noise=true , address=81.171.14.70:4047 , piece_id=O6W5TPWL24YQCYKT7GWQ7T3GA55DIBTFU5HL244L6ZYXYMQQYMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: rpc: dial tcp 81.171.14.70:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649837367 (160h22m57.453301961s) [noise=true , address=89.149.201.147:4022 , piece_id=BLOGBOXX6FBANQXXBUN3BQWRWAH3PC43VZCIDRIXROQM2ZAV7NOA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: rpc: dial tcp 89.149.201.147:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650055408 (160h22m57.453519984s) [noise=true , address=185.167.204.206:4064 , piece_id=MAC6XEQNR2UYDLEDIPXR3VYLH4SR7VEI3RCJ27E24EIMIF4DSSGA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650229995 (160h22m57.453694573s) [noise=true , address=185.167.204.205:4012 , piece_id=X4IQFROU2Y2GCPBFNFIGBIV54LWLFY7UGPZ2YOB34ZZHAEQ3MBEQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650390416 (160h22m57.453855007s) [noise=true , address=89.149.201.147:4021 , piece_id=MAEF5F7L3C47ZSOTPF2Z5PWHXMTYUTFIZ6Z756MONBCQDDAF5BYQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: rpc: dial tcp 89.149.201.147:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650549336 (160h22m57.454013931s) [noise=true , address=185.167.204.205:4011 , piece_id=TTQHENFBPMCI3PZQEKV52IO3OUBDS5ACHCV2K34UHCSQRCQXZRVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650715583 (160h22m57.454180175s) [noise=true , address=185.167.204.205:4008 , piece_id=TG5PNUZMD6HB7AYOWQM6LAJIC4DFSGSWPPOLWD42ZLZQIA7TFOFA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650879777 (160h22m57.454344374s) [noise=true , address=185.167.204.206:4049 , piece_id=JJL2EE4FSKLKYNZIQC4DPZICJBM2V7T6FUIJKNOZVPXY3FCK4GLQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651037802 (160h22m57.454502453s) [noise=true , address=185.167.204.205:4014 , piece_id=MJELQYF2MKIHI6UX2AFF7NTABPPTZ7NYEZN5GQNKOFBBAQ4XOKAA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651306523 (160h22m57.454771119s) [noise=true , address=81.171.14.70:4029 , piece_id=PMDZH27BZU52YWCVRUHLQB7K6CFGWK2UQKVFYMWJZMT53R5T3IVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651476372 (160h22m57.45494095s) [noise=true , address=81.171.14.70:4048 , piece_id=UYAQIALBK6OGIZU7UFRJRWLTSQFMQRJU5A6PKWFF7QQ5VB3H4LXQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651648406 (160h22m57.455113002s) [noise=true , address=89.149.201.147:4003 , piece_id=VCVV5WC5Q7YJFQZ3LTJQZ2WHWF5ISWELC2IPX6NJTCLSCRUF4L6Q, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: rpc: dial tcp 89.149.201.147:4003: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651820843 (160h22m57.455285449s) [noise=true , address=89.149.201.147:4019 , piece_id=JOQH7YYR52QRAXMXC35XHHDHIYU57AGBD4DE4AJROTHXDNY5CMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: rpc: dial tcp 89.149.201.147:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651991651 (160h22m57.455456234s) [noise=true , address=185.167.204.205:4031 , piece_id=YHTTQIWCH2YB7HLEUVV5P2AK5OWRB52KZBKKERQBQPGRD4JSMNOQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 139.59.144.22:36174->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.652019889 (160h22m57.455484483s) [seg_pos={0 0}, upload=141188]: Done waiting for segment. successful: 0 optimal: 26 errs: <nil>
Duration: 905.145904ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................................XX................] duration:
1.144321321s
FAIL (2025-09-30 06:03:13 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 1.144345059s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.978284063s
FAIL (2025-09-30 06:02:46 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.978322513s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [...........................................XXX..............] duration:
935.027049ms
FAIL (2025-09-30 06:02:44 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 26 but got 0)
======LOGS======
[noise=true , address=81.171.14.70:4045 , piece_id=DD53MUKF24OCOLISJNN4F2ESSJSAM6KTBCIHF4UJVOYLKPOLANEA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648490545 (160h22m57.451955126s) [noise=true , address=89.149.201.147:4013 , piece_id=RSPYSYOBACSJ4OKRGV7NQNNQT5ORQJNX4RZVVPHHHM63DYN4KCIQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: rpc: dial tcp 89.149.201.147:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648635402 (160h22m57.452099988s) [noise=true , address=185.167.204.206:4050 , piece_id=DHS3HOFXUBK4BKB5NVZVLDMNI2ZKTP6RVK4KJ2MVL67V47IL2Z3A, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648822212 (160h22m57.452286803s) [noise=true , address=81.171.14.70:4038 , piece_id=T5H2PB2PIPPCGVEDBD4PN5K7VI6TDMKXP6QW242EA6LMFJCAS4OQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: rpc: dial tcp 81.171.14.70:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648970309 (160h22m57.452434895s) [noise=true , address=89.149.201.147:4005 , piece_id=5UJBQPRPDDKVBMIPOZNSE2ZD5TL2KQFP7BNIHXYDW7XFTUCZ4KNA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649153071 (160h22m57.452617658s) [noise=true , address=89.149.201.147:4016 , piece_id=UUNTWX7FB4I7YG2LDN2Y2WP7BHXHZHYKNQROUVFRAMHEKEJQF6VA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649337300 (160h22m57.452801882s) [noise=true , address=185.167.204.205:4027 , piece_id=WTCV2L3SLOFED6725FQ46U3JEO2LE76LH2N4W767PMAFZ4DNGTWA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649489850 (160h22m57.45295445s) [noise=true , address=185.167.204.205:4025 , piece_id=KFG5MK4RB57N2XF4ZLMTAJ7HCCBSJUIGRFQRA3QOFEAHYRRZEUKQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649644940 (160h22m57.453109528s) [noise=true , address=81.171.14.70:4047 , piece_id=O6W5TPWL24YQCYKT7GWQ7T3GA55DIBTFU5HL244L6ZYXYMQQYMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: rpc: dial tcp 81.171.14.70:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649837367 (160h22m57.453301961s) [noise=true , address=89.149.201.147:4022 , piece_id=BLOGBOXX6FBANQXXBUN3BQWRWAH3PC43VZCIDRIXROQM2ZAV7NOA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: rpc: dial tcp 89.149.201.147:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650055408 (160h22m57.453519984s) [noise=true , address=185.167.204.206:4064 , piece_id=MAC6XEQNR2UYDLEDIPXR3VYLH4SR7VEI3RCJ27E24EIMIF4DSSGA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650229995 (160h22m57.453694573s) [noise=true , address=185.167.204.205:4012 , piece_id=X4IQFROU2Y2GCPBFNFIGBIV54LWLFY7UGPZ2YOB34ZZHAEQ3MBEQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650390416 (160h22m57.453855007s) [noise=true , address=89.149.201.147:4021 , piece_id=MAEF5F7L3C47ZSOTPF2Z5PWHXMTYUTFIZ6Z756MONBCQDDAF5BYQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: rpc: dial tcp 89.149.201.147:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650549336 (160h22m57.454013931s) [noise=true , address=185.167.204.205:4011 , piece_id=TTQHENFBPMCI3PZQEKV52IO3OUBDS5ACHCV2K34UHCSQRCQXZRVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650715583 (160h22m57.454180175s) [noise=true , address=185.167.204.205:4008 , piece_id=TG5PNUZMD6HB7AYOWQM6LAJIC4DFSGSWPPOLWD42ZLZQIA7TFOFA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650879777 (160h22m57.454344374s) [noise=true , address=185.167.204.206:4049 , piece_id=JJL2EE4FSKLKYNZIQC4DPZICJBM2V7T6FUIJKNOZVPXY3FCK4GLQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651037802 (160h22m57.454502453s) [noise=true , address=185.167.204.205:4014 , piece_id=MJELQYF2MKIHI6UX2AFF7NTABPPTZ7NYEZN5GQNKOFBBAQ4XOKAA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651306523 (160h22m57.454771119s) [noise=true , address=81.171.14.70:4029 , piece_id=PMDZH27BZU52YWCVRUHLQB7K6CFGWK2UQKVFYMWJZMT53R5T3IVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651476372 (160h22m57.45494095s) [noise=true , address=81.171.14.70:4048 , piece_id=UYAQIALBK6OGIZU7UFRJRWLTSQFMQRJU5A6PKWFF7QQ5VB3H4LXQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651648406 (160h22m57.455113002s) [noise=true , address=89.149.201.147:4003 , piece_id=VCVV5WC5Q7YJFQZ3LTJQZ2WHWF5ISWELC2IPX6NJTCLSCRUF4L6Q, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: rpc: dial tcp 89.149.201.147:4003: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651820843 (160h22m57.455285449s) [noise=true , address=89.149.201.147:4019 , piece_id=JOQH7YYR52QRAXMXC35XHHDHIYU57AGBD4DE4AJROTHXDNY5CMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: rpc: dial tcp 89.149.201.147:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651991651 (160h22m57.455456234s) [noise=true , address=185.167.204.205:4031 , piece_id=YHTTQIWCH2YB7HLEUVV5P2AK5OWRB52KZBKKERQBQPGRD4JSMNOQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 139.59.144.22:36174->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.652019889 (160h22m57.455484483s) [seg_pos={0 0}, upload=141188]: Done waiting for segment. successful: 0 optimal: 26 errs: <nil>
Duration: 935.137816ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........................................XXX..............] duration:
2.734629695s
FAIL (2025-09-30 06:02:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.734661777s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................................XX...............] duration:
1.270916822s
FAIL (2025-09-30 06:02:34 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 1.270983565s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [XX.............] duration:
135.524167ms target:
https://www.storj.io/
FAIL (2025-09-30 06:02:28 UTC)
orbiter warning: Get "https://www.storj.io/": dial tcp 35.152.117.67:443: i/o timeout
Duration: 135.550699ms
core
website
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................................XX..............] duration:
1.190159075s
FAIL (2025-09-30 06:02:13 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 1.190204225s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [............................................XXX.............] duration:
2.983307914s
FAIL (2025-09-30 06:02:10 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.983349612s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [............................................XXX.............] duration:
654.595834ms
FAIL (2025-09-30 06:02:01 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 26 but got 0)
======LOGS======
[noise=true , address=81.171.14.70:4045 , piece_id=DD53MUKF24OCOLISJNN4F2ESSJSAM6KTBCIHF4UJVOYLKPOLANEA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648490545 (160h22m57.451955126s) [noise=true , address=89.149.201.147:4013 , piece_id=RSPYSYOBACSJ4OKRGV7NQNNQT5ORQJNX4RZVVPHHHM63DYN4KCIQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: rpc: dial tcp 89.149.201.147:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648635402 (160h22m57.452099988s) [noise=true , address=185.167.204.206:4050 , piece_id=DHS3HOFXUBK4BKB5NVZVLDMNI2ZKTP6RVK4KJ2MVL67V47IL2Z3A, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648822212 (160h22m57.452286803s) [noise=true , address=81.171.14.70:4038 , piece_id=T5H2PB2PIPPCGVEDBD4PN5K7VI6TDMKXP6QW242EA6LMFJCAS4OQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: rpc: dial tcp 81.171.14.70:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648970309 (160h22m57.452434895s) [noise=true , address=89.149.201.147:4005 , piece_id=5UJBQPRPDDKVBMIPOZNSE2ZD5TL2KQFP7BNIHXYDW7XFTUCZ4KNA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649153071 (160h22m57.452617658s) [noise=true , address=89.149.201.147:4016 , piece_id=UUNTWX7FB4I7YG2LDN2Y2WP7BHXHZHYKNQROUVFRAMHEKEJQF6VA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649337300 (160h22m57.452801882s) [noise=true , address=185.167.204.205:4027 , piece_id=WTCV2L3SLOFED6725FQ46U3JEO2LE76LH2N4W767PMAFZ4DNGTWA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649489850 (160h22m57.45295445s) [noise=true , address=185.167.204.205:4025 , piece_id=KFG5MK4RB57N2XF4ZLMTAJ7HCCBSJUIGRFQRA3QOFEAHYRRZEUKQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649644940 (160h22m57.453109528s) [noise=true , address=81.171.14.70:4047 , piece_id=O6W5TPWL24YQCYKT7GWQ7T3GA55DIBTFU5HL244L6ZYXYMQQYMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: rpc: dial tcp 81.171.14.70:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649837367 (160h22m57.453301961s) [noise=true , address=89.149.201.147:4022 , piece_id=BLOGBOXX6FBANQXXBUN3BQWRWAH3PC43VZCIDRIXROQM2ZAV7NOA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: rpc: dial tcp 89.149.201.147:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650055408 (160h22m57.453519984s) [noise=true , address=185.167.204.206:4064 , piece_id=MAC6XEQNR2UYDLEDIPXR3VYLH4SR7VEI3RCJ27E24EIMIF4DSSGA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650229995 (160h22m57.453694573s) [noise=true , address=185.167.204.205:4012 , piece_id=X4IQFROU2Y2GCPBFNFIGBIV54LWLFY7UGPZ2YOB34ZZHAEQ3MBEQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650390416 (160h22m57.453855007s) [noise=true , address=89.149.201.147:4021 , piece_id=MAEF5F7L3C47ZSOTPF2Z5PWHXMTYUTFIZ6Z756MONBCQDDAF5BYQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: rpc: dial tcp 89.149.201.147:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650549336 (160h22m57.454013931s) [noise=true , address=185.167.204.205:4011 , piece_id=TTQHENFBPMCI3PZQEKV52IO3OUBDS5ACHCV2K34UHCSQRCQXZRVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650715583 (160h22m57.454180175s) [noise=true , address=185.167.204.205:4008 , piece_id=TG5PNUZMD6HB7AYOWQM6LAJIC4DFSGSWPPOLWD42ZLZQIA7TFOFA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650879777 (160h22m57.454344374s) [noise=true , address=185.167.204.206:4049 , piece_id=JJL2EE4FSKLKYNZIQC4DPZICJBM2V7T6FUIJKNOZVPXY3FCK4GLQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651037802 (160h22m57.454502453s) [noise=true , address=185.167.204.205:4014 , piece_id=MJELQYF2MKIHI6UX2AFF7NTABPPTZ7NYEZN5GQNKOFBBAQ4XOKAA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651306523 (160h22m57.454771119s) [noise=true , address=81.171.14.70:4029 , piece_id=PMDZH27BZU52YWCVRUHLQB7K6CFGWK2UQKVFYMWJZMT53R5T3IVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651476372 (160h22m57.45494095s) [noise=true , address=81.171.14.70:4048 , piece_id=UYAQIALBK6OGIZU7UFRJRWLTSQFMQRJU5A6PKWFF7QQ5VB3H4LXQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651648406 (160h22m57.455113002s) [noise=true , address=89.149.201.147:4003 , piece_id=VCVV5WC5Q7YJFQZ3LTJQZ2WHWF5ISWELC2IPX6NJTCLSCRUF4L6Q, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: rpc: dial tcp 89.149.201.147:4003: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651820843 (160h22m57.455285449s) [noise=true , address=89.149.201.147:4019 , piece_id=JOQH7YYR52QRAXMXC35XHHDHIYU57AGBD4DE4AJROTHXDNY5CMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: rpc: dial tcp 89.149.201.147:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651991651 (160h22m57.455456234s) [noise=true , address=185.167.204.205:4031 , piece_id=YHTTQIWCH2YB7HLEUVV5P2AK5OWRB52KZBKKERQBQPGRD4JSMNOQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 139.59.144.22:36174->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.652019889 (160h22m57.455484483s) [seg_pos={0 0}, upload=141188]: Done waiting for segment. successful: 0 optimal: 26 errs: <nil>
Duration: 654.631553ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [X..............] duration:
196.238572ms target:
https://www.storj.io/dcs-satellites
FAIL (2025-09-30 06:01:53 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": dial tcp 15.161.34.42:443: i/o timeout
Duration: 196.375884ms
core
website
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................................XX.............] duration:
1.123753292s
FAIL (2025-09-30 06:01:45 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 1.123777686s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.976824859s
FAIL (2025-09-30 06:01:44 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.976852578s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
3 out of 15 is failed (threshold=6) [XXX............] duration:
139.627195ms target:
https://www.storj.io/
FAIL (2025-09-30 06:01:20 UTC)
orbiter warning: Get "https://www.storj.io/": dial tcp 35.152.117.67:443: i/o timeout
Duration: 139.72539ms
core
website
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.............................................XXX............] duration:
1.079217764s
FAIL (2025-09-30 06:01:15 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 26 but got 0)
======LOGS======
[noise=true , address=81.171.14.70:4045 , piece_id=DD53MUKF24OCOLISJNN4F2ESSJSAM6KTBCIHF4UJVOYLKPOLANEA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648490545 (160h22m57.451955126s) [noise=true , address=89.149.201.147:4013 , piece_id=RSPYSYOBACSJ4OKRGV7NQNNQT5ORQJNX4RZVVPHHHM63DYN4KCIQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: rpc: dial tcp 89.149.201.147:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648635402 (160h22m57.452099988s) [noise=true , address=185.167.204.206:4050 , piece_id=DHS3HOFXUBK4BKB5NVZVLDMNI2ZKTP6RVK4KJ2MVL67V47IL2Z3A, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648822212 (160h22m57.452286803s) [noise=true , address=81.171.14.70:4038 , piece_id=T5H2PB2PIPPCGVEDBD4PN5K7VI6TDMKXP6QW242EA6LMFJCAS4OQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: rpc: dial tcp 81.171.14.70:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648970309 (160h22m57.452434895s) [noise=true , address=89.149.201.147:4005 , piece_id=5UJBQPRPDDKVBMIPOZNSE2ZD5TL2KQFP7BNIHXYDW7XFTUCZ4KNA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649153071 (160h22m57.452617658s) [noise=true , address=89.149.201.147:4016 , piece_id=UUNTWX7FB4I7YG2LDN2Y2WP7BHXHZHYKNQROUVFRAMHEKEJQF6VA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649337300 (160h22m57.452801882s) [noise=true , address=185.167.204.205:4027 , piece_id=WTCV2L3SLOFED6725FQ46U3JEO2LE76LH2N4W767PMAFZ4DNGTWA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649489850 (160h22m57.45295445s) [noise=true , address=185.167.204.205:4025 , piece_id=KFG5MK4RB57N2XF4ZLMTAJ7HCCBSJUIGRFQRA3QOFEAHYRRZEUKQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649644940 (160h22m57.453109528s) [noise=true , address=81.171.14.70:4047 , piece_id=O6W5TPWL24YQCYKT7GWQ7T3GA55DIBTFU5HL244L6ZYXYMQQYMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: rpc: dial tcp 81.171.14.70:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649837367 (160h22m57.453301961s) [noise=true , address=89.149.201.147:4022 , piece_id=BLOGBOXX6FBANQXXBUN3BQWRWAH3PC43VZCIDRIXROQM2ZAV7NOA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: rpc: dial tcp 89.149.201.147:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650055408 (160h22m57.453519984s) [noise=true , address=185.167.204.206:4064 , piece_id=MAC6XEQNR2UYDLEDIPXR3VYLH4SR7VEI3RCJ27E24EIMIF4DSSGA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650229995 (160h22m57.453694573s) [noise=true , address=185.167.204.205:4012 , piece_id=X4IQFROU2Y2GCPBFNFIGBIV54LWLFY7UGPZ2YOB34ZZHAEQ3MBEQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650390416 (160h22m57.453855007s) [noise=true , address=89.149.201.147:4021 , piece_id=MAEF5F7L3C47ZSOTPF2Z5PWHXMTYUTFIZ6Z756MONBCQDDAF5BYQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: rpc: dial tcp 89.149.201.147:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650549336 (160h22m57.454013931s) [noise=true , address=185.167.204.205:4011 , piece_id=TTQHENFBPMCI3PZQEKV52IO3OUBDS5ACHCV2K34UHCSQRCQXZRVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650715583 (160h22m57.454180175s) [noise=true , address=185.167.204.205:4008 , piece_id=TG5PNUZMD6HB7AYOWQM6LAJIC4DFSGSWPPOLWD42ZLZQIA7TFOFA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650879777 (160h22m57.454344374s) [noise=true , address=185.167.204.206:4049 , piece_id=JJL2EE4FSKLKYNZIQC4DPZICJBM2V7T6FUIJKNOZVPXY3FCK4GLQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651037802 (160h22m57.454502453s) [noise=true , address=185.167.204.205:4014 , piece_id=MJELQYF2MKIHI6UX2AFF7NTABPPTZ7NYEZN5GQNKOFBBAQ4XOKAA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651306523 (160h22m57.454771119s) [noise=true , address=81.171.14.70:4029 , piece_id=PMDZH27BZU52YWCVRUHLQB7K6CFGWK2UQKVFYMWJZMT53R5T3IVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651476372 (160h22m57.45494095s) [noise=true , address=81.171.14.70:4048 , piece_id=UYAQIALBK6OGIZU7UFRJRWLTSQFMQRJU5A6PKWFF7QQ5VB3H4LXQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651648406 (160h22m57.455113002s) [noise=true , address=89.149.201.147:4003 , piece_id=VCVV5WC5Q7YJFQZ3LTJQZ2WHWF5ISWELC2IPX6NJTCLSCRUF4L6Q, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: rpc: dial tcp 89.149.201.147:4003: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651820843 (160h22m57.455285449s) [noise=true , address=89.149.201.147:4019 , piece_id=JOQH7YYR52QRAXMXC35XHHDHIYU57AGBD4DE4AJROTHXDNY5CMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: rpc: dial tcp 89.149.201.147:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651991651 (160h22m57.455456234s) [noise=true , address=185.167.204.205:4031 , piece_id=YHTTQIWCH2YB7HLEUVV5P2AK5OWRB52KZBKKERQBQPGRD4JSMNOQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 139.59.144.22:36174->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.652019889 (160h22m57.455484483s) [seg_pos={0 0}, upload=141188]: Done waiting for segment. successful: 0 optimal: 26 errs: <nil>
Duration: 1.079250582s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............................................XXX............] duration:
3.021288052s
FAIL (2025-09-30 06:01:05 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.021314s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [XX.............] duration:
201.226704ms target:
https://www.storj.io/dcs-satellites
FAIL (2025-09-30 06:01:03 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": dial tcp 15.161.34.42:443: i/o timeout
Duration: 201.251982ms
core
website
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.83558554s
FAIL (2025-09-30 06:00:44 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.835619975s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................................XX............] duration:
1.103098503s
FAIL (2025-09-30 06:00:40 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 1.103171413s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
3 out of 15 is failed (threshold=6) [.XXX...........] duration:
135.232744ms target:
https://www.storj.io/
FAIL (2025-09-30 06:00:34 UTC)
orbiter warning: Get "https://www.storj.io/": dial tcp 35.152.117.67:443: i/o timeout
Duration: 135.266146ms
core
website
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............................................XXX...........] duration:
2.61894374s
FAIL (2025-09-30 06:00:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.618985344s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [..............................................XXX...........] duration:
468.96479ms
FAIL (2025-09-30 06:00:08 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 26 but got 0)
======LOGS======
[noise=true , address=81.171.14.70:4045 , piece_id=DD53MUKF24OCOLISJNN4F2ESSJSAM6KTBCIHF4UJVOYLKPOLANEA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648490545 (160h22m57.451955126s) [noise=true , address=89.149.201.147:4013 , piece_id=RSPYSYOBACSJ4OKRGV7NQNNQT5ORQJNX4RZVVPHHHM63DYN4KCIQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: rpc: dial tcp 89.149.201.147:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648635402 (160h22m57.452099988s) [noise=true , address=185.167.204.206:4050 , piece_id=DHS3HOFXUBK4BKB5NVZVLDMNI2ZKTP6RVK4KJ2MVL67V47IL2Z3A, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648822212 (160h22m57.452286803s) [noise=true , address=81.171.14.70:4038 , piece_id=T5H2PB2PIPPCGVEDBD4PN5K7VI6TDMKXP6QW242EA6LMFJCAS4OQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: rpc: dial tcp 81.171.14.70:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648970309 (160h22m57.452434895s) [noise=true , address=89.149.201.147:4005 , piece_id=5UJBQPRPDDKVBMIPOZNSE2ZD5TL2KQFP7BNIHXYDW7XFTUCZ4KNA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649153071 (160h22m57.452617658s) [noise=true , address=89.149.201.147:4016 , piece_id=UUNTWX7FB4I7YG2LDN2Y2WP7BHXHZHYKNQROUVFRAMHEKEJQF6VA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649337300 (160h22m57.452801882s) [noise=true , address=185.167.204.205:4027 , piece_id=WTCV2L3SLOFED6725FQ46U3JEO2LE76LH2N4W767PMAFZ4DNGTWA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649489850 (160h22m57.45295445s) [noise=true , address=185.167.204.205:4025 , piece_id=KFG5MK4RB57N2XF4ZLMTAJ7HCCBSJUIGRFQRA3QOFEAHYRRZEUKQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649644940 (160h22m57.453109528s) [noise=true , address=81.171.14.70:4047 , piece_id=O6W5TPWL24YQCYKT7GWQ7T3GA55DIBTFU5HL244L6ZYXYMQQYMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: rpc: dial tcp 81.171.14.70:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649837367 (160h22m57.453301961s) [noise=true , address=89.149.201.147:4022 , piece_id=BLOGBOXX6FBANQXXBUN3BQWRWAH3PC43VZCIDRIXROQM2ZAV7NOA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: rpc: dial tcp 89.149.201.147:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650055408 (160h22m57.453519984s) [noise=true , address=185.167.204.206:4064 , piece_id=MAC6XEQNR2UYDLEDIPXR3VYLH4SR7VEI3RCJ27E24EIMIF4DSSGA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650229995 (160h22m57.453694573s) [noise=true , address=185.167.204.205:4012 , piece_id=X4IQFROU2Y2GCPBFNFIGBIV54LWLFY7UGPZ2YOB34ZZHAEQ3MBEQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650390416 (160h22m57.453855007s) [noise=true , address=89.149.201.147:4021 , piece_id=MAEF5F7L3C47ZSOTPF2Z5PWHXMTYUTFIZ6Z756MONBCQDDAF5BYQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: rpc: dial tcp 89.149.201.147:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650549336 (160h22m57.454013931s) [noise=true , address=185.167.204.205:4011 , piece_id=TTQHENFBPMCI3PZQEKV52IO3OUBDS5ACHCV2K34UHCSQRCQXZRVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650715583 (160h22m57.454180175s) [noise=true , address=185.167.204.205:4008 , piece_id=TG5PNUZMD6HB7AYOWQM6LAJIC4DFSGSWPPOLWD42ZLZQIA7TFOFA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650879777 (160h22m57.454344374s) [noise=true , address=185.167.204.206:4049 , piece_id=JJL2EE4FSKLKYNZIQC4DPZICJBM2V7T6FUIJKNOZVPXY3FCK4GLQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651037802 (160h22m57.454502453s) [noise=true , address=185.167.204.205:4014 , piece_id=MJELQYF2MKIHI6UX2AFF7NTABPPTZ7NYEZN5GQNKOFBBAQ4XOKAA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651306523 (160h22m57.454771119s) [noise=true , address=81.171.14.70:4029 , piece_id=PMDZH27BZU52YWCVRUHLQB7K6CFGWK2UQKVFYMWJZMT53R5T3IVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651476372 (160h22m57.45494095s) [noise=true , address=81.171.14.70:4048 , piece_id=UYAQIALBK6OGIZU7UFRJRWLTSQFMQRJU5A6PKWFF7QQ5VB3H4LXQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651648406 (160h22m57.455113002s) [noise=true , address=89.149.201.147:4003 , piece_id=VCVV5WC5Q7YJFQZ3LTJQZ2WHWF5ISWELC2IPX6NJTCLSCRUF4L6Q, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: rpc: dial tcp 89.149.201.147:4003: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651820843 (160h22m57.455285449s) [noise=true , address=89.149.201.147:4019 , piece_id=JOQH7YYR52QRAXMXC35XHHDHIYU57AGBD4DE4AJROTHXDNY5CMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: rpc: dial tcp 89.149.201.147:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651991651 (160h22m57.455456234s) [noise=true , address=185.167.204.205:4031 , piece_id=YHTTQIWCH2YB7HLEUVV5P2AK5OWRB52KZBKKERQBQPGRD4JSMNOQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 139.59.144.22:36174->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.652019889 (160h22m57.455484483s) [seg_pos={0 0}, upload=141188]: Done waiting for segment. successful: 0 optimal: 26 errs: <nil>
Duration: 469.075144ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
3 out of 15 is failed (threshold=6) [..XXX..........] duration:
143.921164ms target:
https://www.storj.io/
FAIL (2025-09-30 06:00:08 UTC)
orbiter warning: Get "https://www.storj.io/": dial tcp 35.152.117.67:443: i/o timeout
Duration: 143.949531ms
core
website
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
3.494951623s
FAIL (2025-09-30 06:00:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.494983259s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [.XX............] duration:
243.253036ms target:
https://www.storj.io/dcs-satellites
FAIL (2025-09-30 06:00:04 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": dial tcp 15.161.34.42:443: i/o timeout
Duration: 243.306751ms
core
website
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............................................XXX..........] duration:
2.994150949s
FAIL (2025-09-30 06:00:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.994191753s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.892135803s
FAIL (2025-09-30 05:59:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.89216897s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................................XX...........] duration:
1.112155138s
FAIL (2025-09-30 05:59:48 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 1.112178402s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [...............................................XXX..........] duration:
966.015684ms
FAIL (2025-09-30 05:59:45 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 26 but got 0)
======LOGS======
[noise=true , address=81.171.14.70:4045 , piece_id=DD53MUKF24OCOLISJNN4F2ESSJSAM6KTBCIHF4UJVOYLKPOLANEA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648490545 (160h22m57.451955126s) [noise=true , address=89.149.201.147:4013 , piece_id=RSPYSYOBACSJ4OKRGV7NQNNQT5ORQJNX4RZVVPHHHM63DYN4KCIQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: rpc: dial tcp 89.149.201.147:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648635402 (160h22m57.452099988s) [noise=true , address=185.167.204.206:4050 , piece_id=DHS3HOFXUBK4BKB5NVZVLDMNI2ZKTP6RVK4KJ2MVL67V47IL2Z3A, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648822212 (160h22m57.452286803s) [noise=true , address=81.171.14.70:4038 , piece_id=T5H2PB2PIPPCGVEDBD4PN5K7VI6TDMKXP6QW242EA6LMFJCAS4OQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: rpc: dial tcp 81.171.14.70:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648970309 (160h22m57.452434895s) [noise=true , address=89.149.201.147:4005 , piece_id=5UJBQPRPDDKVBMIPOZNSE2ZD5TL2KQFP7BNIHXYDW7XFTUCZ4KNA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649153071 (160h22m57.452617658s) [noise=true , address=89.149.201.147:4016 , piece_id=UUNTWX7FB4I7YG2LDN2Y2WP7BHXHZHYKNQROUVFRAMHEKEJQF6VA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649337300 (160h22m57.452801882s) [noise=true , address=185.167.204.205:4027 , piece_id=WTCV2L3SLOFED6725FQ46U3JEO2LE76LH2N4W767PMAFZ4DNGTWA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649489850 (160h22m57.45295445s) [noise=true , address=185.167.204.205:4025 , piece_id=KFG5MK4RB57N2XF4ZLMTAJ7HCCBSJUIGRFQRA3QOFEAHYRRZEUKQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649644940 (160h22m57.453109528s) [noise=true , address=81.171.14.70:4047 , piece_id=O6W5TPWL24YQCYKT7GWQ7T3GA55DIBTFU5HL244L6ZYXYMQQYMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: rpc: dial tcp 81.171.14.70:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649837367 (160h22m57.453301961s) [noise=true , address=89.149.201.147:4022 , piece_id=BLOGBOXX6FBANQXXBUN3BQWRWAH3PC43VZCIDRIXROQM2ZAV7NOA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: rpc: dial tcp 89.149.201.147:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650055408 (160h22m57.453519984s) [noise=true , address=185.167.204.206:4064 , piece_id=MAC6XEQNR2UYDLEDIPXR3VYLH4SR7VEI3RCJ27E24EIMIF4DSSGA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650229995 (160h22m57.453694573s) [noise=true , address=185.167.204.205:4012 , piece_id=X4IQFROU2Y2GCPBFNFIGBIV54LWLFY7UGPZ2YOB34ZZHAEQ3MBEQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650390416 (160h22m57.453855007s) [noise=true , address=89.149.201.147:4021 , piece_id=MAEF5F7L3C47ZSOTPF2Z5PWHXMTYUTFIZ6Z756MONBCQDDAF5BYQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: rpc: dial tcp 89.149.201.147:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650549336 (160h22m57.454013931s) [noise=true , address=185.167.204.205:4011 , piece_id=TTQHENFBPMCI3PZQEKV52IO3OUBDS5ACHCV2K34UHCSQRCQXZRVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650715583 (160h22m57.454180175s) [noise=true , address=185.167.204.205:4008 , piece_id=TG5PNUZMD6HB7AYOWQM6LAJIC4DFSGSWPPOLWD42ZLZQIA7TFOFA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650879777 (160h22m57.454344374s) [noise=true , address=185.167.204.206:4049 , piece_id=JJL2EE4FSKLKYNZIQC4DPZICJBM2V7T6FUIJKNOZVPXY3FCK4GLQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651037802 (160h22m57.454502453s) [noise=true , address=185.167.204.205:4014 , piece_id=MJELQYF2MKIHI6UX2AFF7NTABPPTZ7NYEZN5GQNKOFBBAQ4XOKAA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651306523 (160h22m57.454771119s) [noise=true , address=81.171.14.70:4029 , piece_id=PMDZH27BZU52YWCVRUHLQB7K6CFGWK2UQKVFYMWJZMT53R5T3IVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651476372 (160h22m57.45494095s) [noise=true , address=81.171.14.70:4048 , piece_id=UYAQIALBK6OGIZU7UFRJRWLTSQFMQRJU5A6PKWFF7QQ5VB3H4LXQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651648406 (160h22m57.455113002s) [noise=true , address=89.149.201.147:4003 , piece_id=VCVV5WC5Q7YJFQZ3LTJQZ2WHWF5ISWELC2IPX6NJTCLSCRUF4L6Q, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: rpc: dial tcp 89.149.201.147:4003: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651820843 (160h22m57.455285449s) [noise=true , address=89.149.201.147:4019 , piece_id=JOQH7YYR52QRAXMXC35XHHDHIYU57AGBD4DE4AJROTHXDNY5CMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: rpc: dial tcp 89.149.201.147:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651991651 (160h22m57.455456234s) [noise=true , address=185.167.204.205:4031 , piece_id=YHTTQIWCH2YB7HLEUVV5P2AK5OWRB52KZBKKERQBQPGRD4JSMNOQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 139.59.144.22:36174->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.652019889 (160h22m57.455484483s) [seg_pos={0 0}, upload=141188]: Done waiting for segment. successful: 0 optimal: 26 errs: <nil>
Duration: 966.060314ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [..XX...........] duration:
429.528513ms target:
https://www.storj.io/dcs-satellites
FAIL (2025-09-30 05:59:41 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": dial tcp 15.161.34.42:443: i/o timeout
Duration: 429.560494ms
core
website
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [................................................XXX.........] duration:
864.773887ms
FAIL (2025-09-30 05:59:19 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 26 but got 0)
======LOGS======
[noise=true , address=81.171.14.70:4045 , piece_id=DD53MUKF24OCOLISJNN4F2ESSJSAM6KTBCIHF4UJVOYLKPOLANEA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648490545 (160h22m57.451955126s) [noise=true , address=89.149.201.147:4013 , piece_id=RSPYSYOBACSJ4OKRGV7NQNNQT5ORQJNX4RZVVPHHHM63DYN4KCIQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: rpc: dial tcp 89.149.201.147:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648635402 (160h22m57.452099988s) [noise=true , address=185.167.204.206:4050 , piece_id=DHS3HOFXUBK4BKB5NVZVLDMNI2ZKTP6RVK4KJ2MVL67V47IL2Z3A, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648822212 (160h22m57.452286803s) [noise=true , address=81.171.14.70:4038 , piece_id=T5H2PB2PIPPCGVEDBD4PN5K7VI6TDMKXP6QW242EA6LMFJCAS4OQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: rpc: dial tcp 81.171.14.70:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648970309 (160h22m57.452434895s) [noise=true , address=89.149.201.147:4005 , piece_id=5UJBQPRPDDKVBMIPOZNSE2ZD5TL2KQFP7BNIHXYDW7XFTUCZ4KNA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649153071 (160h22m57.452617658s) [noise=true , address=89.149.201.147:4016 , piece_id=UUNTWX7FB4I7YG2LDN2Y2WP7BHXHZHYKNQROUVFRAMHEKEJQF6VA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649337300 (160h22m57.452801882s) [noise=true , address=185.167.204.205:4027 , piece_id=WTCV2L3SLOFED6725FQ46U3JEO2LE76LH2N4W767PMAFZ4DNGTWA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649489850 (160h22m57.45295445s) [noise=true , address=185.167.204.205:4025 , piece_id=KFG5MK4RB57N2XF4ZLMTAJ7HCCBSJUIGRFQRA3QOFEAHYRRZEUKQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649644940 (160h22m57.453109528s) [noise=true , address=81.171.14.70:4047 , piece_id=O6W5TPWL24YQCYKT7GWQ7T3GA55DIBTFU5HL244L6ZYXYMQQYMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: rpc: dial tcp 81.171.14.70:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649837367 (160h22m57.453301961s) [noise=true , address=89.149.201.147:4022 , piece_id=BLOGBOXX6FBANQXXBUN3BQWRWAH3PC43VZCIDRIXROQM2ZAV7NOA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: rpc: dial tcp 89.149.201.147:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650055408 (160h22m57.453519984s) [noise=true , address=185.167.204.206:4064 , piece_id=MAC6XEQNR2UYDLEDIPXR3VYLH4SR7VEI3RCJ27E24EIMIF4DSSGA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650229995 (160h22m57.453694573s) [noise=true , address=185.167.204.205:4012 , piece_id=X4IQFROU2Y2GCPBFNFIGBIV54LWLFY7UGPZ2YOB34ZZHAEQ3MBEQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650390416 (160h22m57.453855007s) [noise=true , address=89.149.201.147:4021 , piece_id=MAEF5F7L3C47ZSOTPF2Z5PWHXMTYUTFIZ6Z756MONBCQDDAF5BYQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: rpc: dial tcp 89.149.201.147:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650549336 (160h22m57.454013931s) [noise=true , address=185.167.204.205:4011 , piece_id=TTQHENFBPMCI3PZQEKV52IO3OUBDS5ACHCV2K34UHCSQRCQXZRVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650715583 (160h22m57.454180175s) [noise=true , address=185.167.204.205:4008 , piece_id=TG5PNUZMD6HB7AYOWQM6LAJIC4DFSGSWPPOLWD42ZLZQIA7TFOFA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650879777 (160h22m57.454344374s) [noise=true , address=185.167.204.206:4049 , piece_id=JJL2EE4FSKLKYNZIQC4DPZICJBM2V7T6FUIJKNOZVPXY3FCK4GLQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651037802 (160h22m57.454502453s) [noise=true , address=185.167.204.205:4014 , piece_id=MJELQYF2MKIHI6UX2AFF7NTABPPTZ7NYEZN5GQNKOFBBAQ4XOKAA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651306523 (160h22m57.454771119s) [noise=true , address=81.171.14.70:4029 , piece_id=PMDZH27BZU52YWCVRUHLQB7K6CFGWK2UQKVFYMWJZMT53R5T3IVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651476372 (160h22m57.45494095s) [noise=true , address=81.171.14.70:4048 , piece_id=UYAQIALBK6OGIZU7UFRJRWLTSQFMQRJU5A6PKWFF7QQ5VB3H4LXQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651648406 (160h22m57.455113002s) [noise=true , address=89.149.201.147:4003 , piece_id=VCVV5WC5Q7YJFQZ3LTJQZ2WHWF5ISWELC2IPX6NJTCLSCRUF4L6Q, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: rpc: dial tcp 89.149.201.147:4003: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651820843 (160h22m57.455285449s) [noise=true , address=89.149.201.147:4019 , piece_id=JOQH7YYR52QRAXMXC35XHHDHIYU57AGBD4DE4AJROTHXDNY5CMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: rpc: dial tcp 89.149.201.147:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651991651 (160h22m57.455456234s) [noise=true , address=185.167.204.205:4031 , piece_id=YHTTQIWCH2YB7HLEUVV5P2AK5OWRB52KZBKKERQBQPGRD4JSMNOQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 139.59.144.22:36174->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.652019889 (160h22m57.455484483s) [seg_pos={0 0}, upload=141188]: Done waiting for segment. successful: 0 optimal: 26 errs: <nil>
Duration: 864.859244ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
3 out of 15 is failed (threshold=6) [...XXX.........] duration:
101.077167ms target:
https://www.storj.io/
FAIL (2025-09-30 05:59:13 UTC)
orbiter warning: Get "https://www.storj.io/": dial tcp 35.152.117.67:443: i/o timeout
Duration: 101.106742ms
core
website
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [................................................XXX.........] duration:
2.793196627s
FAIL (2025-09-30 05:59:12 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.793224549s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [...XX..........] duration:
206.686377ms target:
https://www.storj.io/dcs-satellites
FAIL (2025-09-30 05:59:06 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": dial tcp 15.161.34.42:443: i/o timeout
Duration: 206.712162ms
core
website
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
3.329622705s
FAIL (2025-09-30 05:59:01 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.329651766s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.................................................XXX........] duration:
421.070551ms
FAIL (2025-09-30 05:58:59 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 26 but got 0)
======LOGS======
[noise=true , address=81.171.14.70:4045 , piece_id=DD53MUKF24OCOLISJNN4F2ESSJSAM6KTBCIHF4UJVOYLKPOLANEA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648490545 (160h22m57.451955126s) [noise=true , address=89.149.201.147:4013 , piece_id=RSPYSYOBACSJ4OKRGV7NQNNQT5ORQJNX4RZVVPHHHM63DYN4KCIQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: rpc: dial tcp 89.149.201.147:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648635402 (160h22m57.452099988s) [noise=true , address=185.167.204.206:4050 , piece_id=DHS3HOFXUBK4BKB5NVZVLDMNI2ZKTP6RVK4KJ2MVL67V47IL2Z3A, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648822212 (160h22m57.452286803s) [noise=true , address=81.171.14.70:4038 , piece_id=T5H2PB2PIPPCGVEDBD4PN5K7VI6TDMKXP6QW242EA6LMFJCAS4OQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: rpc: dial tcp 81.171.14.70:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648970309 (160h22m57.452434895s) [noise=true , address=89.149.201.147:4005 , piece_id=5UJBQPRPDDKVBMIPOZNSE2ZD5TL2KQFP7BNIHXYDW7XFTUCZ4KNA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649153071 (160h22m57.452617658s) [noise=true , address=89.149.201.147:4016 , piece_id=UUNTWX7FB4I7YG2LDN2Y2WP7BHXHZHYKNQROUVFRAMHEKEJQF6VA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649337300 (160h22m57.452801882s) [noise=true , address=185.167.204.205:4027 , piece_id=WTCV2L3SLOFED6725FQ46U3JEO2LE76LH2N4W767PMAFZ4DNGTWA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649489850 (160h22m57.45295445s) [noise=true , address=185.167.204.205:4025 , piece_id=KFG5MK4RB57N2XF4ZLMTAJ7HCCBSJUIGRFQRA3QOFEAHYRRZEUKQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649644940 (160h22m57.453109528s) [noise=true , address=81.171.14.70:4047 , piece_id=O6W5TPWL24YQCYKT7GWQ7T3GA55DIBTFU5HL244L6ZYXYMQQYMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: rpc: dial tcp 81.171.14.70:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649837367 (160h22m57.453301961s) [noise=true , address=89.149.201.147:4022 , piece_id=BLOGBOXX6FBANQXXBUN3BQWRWAH3PC43VZCIDRIXROQM2ZAV7NOA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: rpc: dial tcp 89.149.201.147:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650055408 (160h22m57.453519984s) [noise=true , address=185.167.204.206:4064 , piece_id=MAC6XEQNR2UYDLEDIPXR3VYLH4SR7VEI3RCJ27E24EIMIF4DSSGA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650229995 (160h22m57.453694573s) [noise=true , address=185.167.204.205:4012 , piece_id=X4IQFROU2Y2GCPBFNFIGBIV54LWLFY7UGPZ2YOB34ZZHAEQ3MBEQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650390416 (160h22m57.453855007s) [noise=true , address=89.149.201.147:4021 , piece_id=MAEF5F7L3C47ZSOTPF2Z5PWHXMTYUTFIZ6Z756MONBCQDDAF5BYQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: rpc: dial tcp 89.149.201.147:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650549336 (160h22m57.454013931s) [noise=true , address=185.167.204.205:4011 , piece_id=TTQHENFBPMCI3PZQEKV52IO3OUBDS5ACHCV2K34UHCSQRCQXZRVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650715583 (160h22m57.454180175s) [noise=true , address=185.167.204.205:4008 , piece_id=TG5PNUZMD6HB7AYOWQM6LAJIC4DFSGSWPPOLWD42ZLZQIA7TFOFA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650879777 (160h22m57.454344374s) [noise=true , address=185.167.204.206:4049 , piece_id=JJL2EE4FSKLKYNZIQC4DPZICJBM2V7T6FUIJKNOZVPXY3FCK4GLQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651037802 (160h22m57.454502453s) [noise=true , address=185.167.204.205:4014 , piece_id=MJELQYF2MKIHI6UX2AFF7NTABPPTZ7NYEZN5GQNKOFBBAQ4XOKAA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651306523 (160h22m57.454771119s) [noise=true , address=81.171.14.70:4029 , piece_id=PMDZH27BZU52YWCVRUHLQB7K6CFGWK2UQKVFYMWJZMT53R5T3IVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651476372 (160h22m57.45494095s) [noise=true , address=81.171.14.70:4048 , piece_id=UYAQIALBK6OGIZU7UFRJRWLTSQFMQRJU5A6PKWFF7QQ5VB3H4LXQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651648406 (160h22m57.455113002s) [noise=true , address=89.149.201.147:4003 , piece_id=VCVV5WC5Q7YJFQZ3LTJQZ2WHWF5ISWELC2IPX6NJTCLSCRUF4L6Q, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: rpc: dial tcp 89.149.201.147:4003: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651820843 (160h22m57.455285449s) [noise=true , address=89.149.201.147:4019 , piece_id=JOQH7YYR52QRAXMXC35XHHDHIYU57AGBD4DE4AJROTHXDNY5CMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: rpc: dial tcp 89.149.201.147:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651991651 (160h22m57.455456234s) [noise=true , address=185.167.204.205:4031 , piece_id=YHTTQIWCH2YB7HLEUVV5P2AK5OWRB52KZBKKERQBQPGRD4JSMNOQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 139.59.144.22:36174->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.652019889 (160h22m57.455484483s) [seg_pos={0 0}, upload=141188]: Done waiting for segment. successful: 0 optimal: 26 errs: <nil>
Duration: 421.105129ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
3 out of 15 is failed (threshold=6) [....XXX........] duration:
161.347714ms target:
https://www.storj.io/
FAIL (2025-09-30 05:58:56 UTC)
orbiter warning: Get "https://www.storj.io/": dial tcp 35.152.117.67:443: i/o timeout
Duration: 161.371772ms
core
website
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................................XX..........] duration:
1.129152197s
FAIL (2025-09-30 05:58:48 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 1.12917576s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [....XX.........] duration:
214.724984ms target:
https://www.storj.io/dcs-satellites
FAIL (2025-09-30 05:58:39 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": dial tcp 15.161.34.42:443: i/o timeout
Duration: 214.75278ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
3 out of 15 is failed (threshold=6) [.....XXX.......] duration:
99.103284ms target:
https://www.storj.io/
FAIL (2025-09-30 05:58:15 UTC)
orbiter warning: Get "https://www.storj.io/": dial tcp 35.152.117.67:443: i/o timeout
Duration: 99.128451ms
core
website
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.651987208s
FAIL (2025-09-30 05:58:13 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.65205196s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [.....XX........] duration:
427.747338ms target:
https://www.storj.io/dcs-satellites
FAIL (2025-09-30 05:58:12 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": dial tcp 15.161.34.42:443: i/o timeout
Duration: 427.775629ms
core
website
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................................................XXX........] duration:
3.011726291s
FAIL (2025-09-30 05:58:10 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.011786577s
edge
gateway
us-select-1
|