Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.852064004s
FAIL (2025-09-30 06:22:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.853205795s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [................XXX.........................................] duration:
2.650743411s
FAIL (2025-09-30 06:22:38 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.650765526s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
2.839291425s
FAIL (2025-09-30 06:22:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.839315797s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................XX........................................] duration:
1.199017093s
FAIL (2025-09-30 06:22:16 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 1.199092267s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
2.690639373s
FAIL (2025-09-30 06:21:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.690666555s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [...............XXX..........................................] duration:
866.235992ms
FAIL (2025-09-30 06:21:52 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 26 but got 0)
======LOGS======
[noise=true , address=81.171.14.70:4045 , piece_id=DD53MUKF24OCOLISJNN4F2ESSJSAM6KTBCIHF4UJVOYLKPOLANEA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648490545 (160h22m57.451955126s) [noise=true , address=89.149.201.147:4013 , piece_id=RSPYSYOBACSJ4OKRGV7NQNNQT5ORQJNX4RZVVPHHHM63DYN4KCIQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: rpc: dial tcp 89.149.201.147:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648635402 (160h22m57.452099988s) [noise=true , address=185.167.204.206:4050 , piece_id=DHS3HOFXUBK4BKB5NVZVLDMNI2ZKTP6RVK4KJ2MVL67V47IL2Z3A, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648822212 (160h22m57.452286803s) [noise=true , address=81.171.14.70:4038 , piece_id=T5H2PB2PIPPCGVEDBD4PN5K7VI6TDMKXP6QW242EA6LMFJCAS4OQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: rpc: dial tcp 81.171.14.70:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648970309 (160h22m57.452434895s) [noise=true , address=89.149.201.147:4005 , piece_id=5UJBQPRPDDKVBMIPOZNSE2ZD5TL2KQFP7BNIHXYDW7XFTUCZ4KNA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649153071 (160h22m57.452617658s) [noise=true , address=89.149.201.147:4016 , piece_id=UUNTWX7FB4I7YG2LDN2Y2WP7BHXHZHYKNQROUVFRAMHEKEJQF6VA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649337300 (160h22m57.452801882s) [noise=true , address=185.167.204.205:4027 , piece_id=WTCV2L3SLOFED6725FQ46U3JEO2LE76LH2N4W767PMAFZ4DNGTWA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649489850 (160h22m57.45295445s) [noise=true , address=185.167.204.205:4025 , piece_id=KFG5MK4RB57N2XF4ZLMTAJ7HCCBSJUIGRFQRA3QOFEAHYRRZEUKQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649644940 (160h22m57.453109528s) [noise=true , address=81.171.14.70:4047 , piece_id=O6W5TPWL24YQCYKT7GWQ7T3GA55DIBTFU5HL244L6ZYXYMQQYMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: rpc: dial tcp 81.171.14.70:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649837367 (160h22m57.453301961s) [noise=true , address=89.149.201.147:4022 , piece_id=BLOGBOXX6FBANQXXBUN3BQWRWAH3PC43VZCIDRIXROQM2ZAV7NOA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: rpc: dial tcp 89.149.201.147:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650055408 (160h22m57.453519984s) [noise=true , address=185.167.204.206:4064 , piece_id=MAC6XEQNR2UYDLEDIPXR3VYLH4SR7VEI3RCJ27E24EIMIF4DSSGA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650229995 (160h22m57.453694573s) [noise=true , address=185.167.204.205:4012 , piece_id=X4IQFROU2Y2GCPBFNFIGBIV54LWLFY7UGPZ2YOB34ZZHAEQ3MBEQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650390416 (160h22m57.453855007s) [noise=true , address=89.149.201.147:4021 , piece_id=MAEF5F7L3C47ZSOTPF2Z5PWHXMTYUTFIZ6Z756MONBCQDDAF5BYQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: rpc: dial tcp 89.149.201.147:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650549336 (160h22m57.454013931s) [noise=true , address=185.167.204.205:4011 , piece_id=TTQHENFBPMCI3PZQEKV52IO3OUBDS5ACHCV2K34UHCSQRCQXZRVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650715583 (160h22m57.454180175s) [noise=true , address=185.167.204.205:4008 , piece_id=TG5PNUZMD6HB7AYOWQM6LAJIC4DFSGSWPPOLWD42ZLZQIA7TFOFA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650879777 (160h22m57.454344374s) [noise=true , address=185.167.204.206:4049 , piece_id=JJL2EE4FSKLKYNZIQC4DPZICJBM2V7T6FUIJKNOZVPXY3FCK4GLQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651037802 (160h22m57.454502453s) [noise=true , address=185.167.204.205:4014 , piece_id=MJELQYF2MKIHI6UX2AFF7NTABPPTZ7NYEZN5GQNKOFBBAQ4XOKAA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651306523 (160h22m57.454771119s) [noise=true , address=81.171.14.70:4029 , piece_id=PMDZH27BZU52YWCVRUHLQB7K6CFGWK2UQKVFYMWJZMT53R5T3IVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651476372 (160h22m57.45494095s) [noise=true , address=81.171.14.70:4048 , piece_id=UYAQIALBK6OGIZU7UFRJRWLTSQFMQRJU5A6PKWFF7QQ5VB3H4LXQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651648406 (160h22m57.455113002s) [noise=true , address=89.149.201.147:4003 , piece_id=VCVV5WC5Q7YJFQZ3LTJQZ2WHWF5ISWELC2IPX6NJTCLSCRUF4L6Q, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: rpc: dial tcp 89.149.201.147:4003: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651820843 (160h22m57.455285449s) [noise=true , address=89.149.201.147:4019 , piece_id=JOQH7YYR52QRAXMXC35XHHDHIYU57AGBD4DE4AJROTHXDNY5CMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: rpc: dial tcp 89.149.201.147:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651991651 (160h22m57.455456234s) [noise=true , address=185.167.204.205:4031 , piece_id=YHTTQIWCH2YB7HLEUVV5P2AK5OWRB52KZBKKERQBQPGRD4JSMNOQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 139.59.144.22:36174->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.652019889 (160h22m57.455484483s) [seg_pos={0 0}, upload=141188]: Done waiting for segment. successful: 0 optimal: 26 errs: <nil>
Duration: 866.270016ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [................XXX.........................................] duration:
917.63752ms
FAIL (2025-09-30 06:21:34 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 26 but got 0)
======LOGS======
[noise=true , address=81.171.14.70:4045 , piece_id=DD53MUKF24OCOLISJNN4F2ESSJSAM6KTBCIHF4UJVOYLKPOLANEA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648490545 (160h22m57.451955126s) [noise=true , address=89.149.201.147:4013 , piece_id=RSPYSYOBACSJ4OKRGV7NQNNQT5ORQJNX4RZVVPHHHM63DYN4KCIQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: rpc: dial tcp 89.149.201.147:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648635402 (160h22m57.452099988s) [noise=true , address=185.167.204.206:4050 , piece_id=DHS3HOFXUBK4BKB5NVZVLDMNI2ZKTP6RVK4KJ2MVL67V47IL2Z3A, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648822212 (160h22m57.452286803s) [noise=true , address=81.171.14.70:4038 , piece_id=T5H2PB2PIPPCGVEDBD4PN5K7VI6TDMKXP6QW242EA6LMFJCAS4OQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: rpc: dial tcp 81.171.14.70:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648970309 (160h22m57.452434895s) [noise=true , address=89.149.201.147:4005 , piece_id=5UJBQPRPDDKVBMIPOZNSE2ZD5TL2KQFP7BNIHXYDW7XFTUCZ4KNA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649153071 (160h22m57.452617658s) [noise=true , address=89.149.201.147:4016 , piece_id=UUNTWX7FB4I7YG2LDN2Y2WP7BHXHZHYKNQROUVFRAMHEKEJQF6VA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649337300 (160h22m57.452801882s) [noise=true , address=185.167.204.205:4027 , piece_id=WTCV2L3SLOFED6725FQ46U3JEO2LE76LH2N4W767PMAFZ4DNGTWA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649489850 (160h22m57.45295445s) [noise=true , address=185.167.204.205:4025 , piece_id=KFG5MK4RB57N2XF4ZLMTAJ7HCCBSJUIGRFQRA3QOFEAHYRRZEUKQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649644940 (160h22m57.453109528s) [noise=true , address=81.171.14.70:4047 , piece_id=O6W5TPWL24YQCYKT7GWQ7T3GA55DIBTFU5HL244L6ZYXYMQQYMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: rpc: dial tcp 81.171.14.70:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649837367 (160h22m57.453301961s) [noise=true , address=89.149.201.147:4022 , piece_id=BLOGBOXX6FBANQXXBUN3BQWRWAH3PC43VZCIDRIXROQM2ZAV7NOA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: rpc: dial tcp 89.149.201.147:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650055408 (160h22m57.453519984s) [noise=true , address=185.167.204.206:4064 , piece_id=MAC6XEQNR2UYDLEDIPXR3VYLH4SR7VEI3RCJ27E24EIMIF4DSSGA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650229995 (160h22m57.453694573s) [noise=true , address=185.167.204.205:4012 , piece_id=X4IQFROU2Y2GCPBFNFIGBIV54LWLFY7UGPZ2YOB34ZZHAEQ3MBEQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650390416 (160h22m57.453855007s) [noise=true , address=89.149.201.147:4021 , piece_id=MAEF5F7L3C47ZSOTPF2Z5PWHXMTYUTFIZ6Z756MONBCQDDAF5BYQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: rpc: dial tcp 89.149.201.147:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650549336 (160h22m57.454013931s) [noise=true , address=185.167.204.205:4011 , piece_id=TTQHENFBPMCI3PZQEKV52IO3OUBDS5ACHCV2K34UHCSQRCQXZRVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650715583 (160h22m57.454180175s) [noise=true , address=185.167.204.205:4008 , piece_id=TG5PNUZMD6HB7AYOWQM6LAJIC4DFSGSWPPOLWD42ZLZQIA7TFOFA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650879777 (160h22m57.454344374s) [noise=true , address=185.167.204.206:4049 , piece_id=JJL2EE4FSKLKYNZIQC4DPZICJBM2V7T6FUIJKNOZVPXY3FCK4GLQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651037802 (160h22m57.454502453s) [noise=true , address=185.167.204.205:4014 , piece_id=MJELQYF2MKIHI6UX2AFF7NTABPPTZ7NYEZN5GQNKOFBBAQ4XOKAA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651306523 (160h22m57.454771119s) [noise=true , address=81.171.14.70:4029 , piece_id=PMDZH27BZU52YWCVRUHLQB7K6CFGWK2UQKVFYMWJZMT53R5T3IVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651476372 (160h22m57.45494095s) [noise=true , address=81.171.14.70:4048 , piece_id=UYAQIALBK6OGIZU7UFRJRWLTSQFMQRJU5A6PKWFF7QQ5VB3H4LXQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651648406 (160h22m57.455113002s) [noise=true , address=89.149.201.147:4003 , piece_id=VCVV5WC5Q7YJFQZ3LTJQZ2WHWF5ISWELC2IPX6NJTCLSCRUF4L6Q, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: rpc: dial tcp 89.149.201.147:4003: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651820843 (160h22m57.455285449s) [noise=true , address=89.149.201.147:4019 , piece_id=JOQH7YYR52QRAXMXC35XHHDHIYU57AGBD4DE4AJROTHXDNY5CMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: rpc: dial tcp 89.149.201.147:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651991651 (160h22m57.455456234s) [noise=true , address=185.167.204.205:4031 , piece_id=YHTTQIWCH2YB7HLEUVV5P2AK5OWRB52KZBKKERQBQPGRD4JSMNOQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 139.59.144.22:36174->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.652019889 (160h22m57.455484483s) [seg_pos={0 0}, upload=141188]: Done waiting for segment. successful: 0 optimal: 26 errs: <nil>
Duration: 917.681757ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................XXX........................................] duration:
2.769874463s
FAIL (2025-09-30 06:21:26 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.769972622s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................XX.......................................] duration:
1.126531275s
FAIL (2025-09-30 06:21:25 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 1.126558966s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
2.807386661s
FAIL (2025-09-30 06:21:11 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.80748308s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................XXX.......................................] duration:
2.671224182s
FAIL (2025-09-30 06:21:00 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.671318116s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.................XXX........................................] duration:
409.407922ms
FAIL (2025-09-30 06:20:59 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 26 but got 0)
======LOGS======
[noise=true , address=81.171.14.70:4045 , piece_id=DD53MUKF24OCOLISJNN4F2ESSJSAM6KTBCIHF4UJVOYLKPOLANEA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648490545 (160h22m57.451955126s) [noise=true , address=89.149.201.147:4013 , piece_id=RSPYSYOBACSJ4OKRGV7NQNNQT5ORQJNX4RZVVPHHHM63DYN4KCIQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: rpc: dial tcp 89.149.201.147:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648635402 (160h22m57.452099988s) [noise=true , address=185.167.204.206:4050 , piece_id=DHS3HOFXUBK4BKB5NVZVLDMNI2ZKTP6RVK4KJ2MVL67V47IL2Z3A, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648822212 (160h22m57.452286803s) [noise=true , address=81.171.14.70:4038 , piece_id=T5H2PB2PIPPCGVEDBD4PN5K7VI6TDMKXP6QW242EA6LMFJCAS4OQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: rpc: dial tcp 81.171.14.70:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648970309 (160h22m57.452434895s) [noise=true , address=89.149.201.147:4005 , piece_id=5UJBQPRPDDKVBMIPOZNSE2ZD5TL2KQFP7BNIHXYDW7XFTUCZ4KNA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649153071 (160h22m57.452617658s) [noise=true , address=89.149.201.147:4016 , piece_id=UUNTWX7FB4I7YG2LDN2Y2WP7BHXHZHYKNQROUVFRAMHEKEJQF6VA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649337300 (160h22m57.452801882s) [noise=true , address=185.167.204.205:4027 , piece_id=WTCV2L3SLOFED6725FQ46U3JEO2LE76LH2N4W767PMAFZ4DNGTWA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649489850 (160h22m57.45295445s) [noise=true , address=185.167.204.205:4025 , piece_id=KFG5MK4RB57N2XF4ZLMTAJ7HCCBSJUIGRFQRA3QOFEAHYRRZEUKQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649644940 (160h22m57.453109528s) [noise=true , address=81.171.14.70:4047 , piece_id=O6W5TPWL24YQCYKT7GWQ7T3GA55DIBTFU5HL244L6ZYXYMQQYMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: rpc: dial tcp 81.171.14.70:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649837367 (160h22m57.453301961s) [noise=true , address=89.149.201.147:4022 , piece_id=BLOGBOXX6FBANQXXBUN3BQWRWAH3PC43VZCIDRIXROQM2ZAV7NOA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: rpc: dial tcp 89.149.201.147:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650055408 (160h22m57.453519984s) [noise=true , address=185.167.204.206:4064 , piece_id=MAC6XEQNR2UYDLEDIPXR3VYLH4SR7VEI3RCJ27E24EIMIF4DSSGA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650229995 (160h22m57.453694573s) [noise=true , address=185.167.204.205:4012 , piece_id=X4IQFROU2Y2GCPBFNFIGBIV54LWLFY7UGPZ2YOB34ZZHAEQ3MBEQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650390416 (160h22m57.453855007s) [noise=true , address=89.149.201.147:4021 , piece_id=MAEF5F7L3C47ZSOTPF2Z5PWHXMTYUTFIZ6Z756MONBCQDDAF5BYQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: rpc: dial tcp 89.149.201.147:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650549336 (160h22m57.454013931s) [noise=true , address=185.167.204.205:4011 , piece_id=TTQHENFBPMCI3PZQEKV52IO3OUBDS5ACHCV2K34UHCSQRCQXZRVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650715583 (160h22m57.454180175s) [noise=true , address=185.167.204.205:4008 , piece_id=TG5PNUZMD6HB7AYOWQM6LAJIC4DFSGSWPPOLWD42ZLZQIA7TFOFA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650879777 (160h22m57.454344374s) [noise=true , address=185.167.204.206:4049 , piece_id=JJL2EE4FSKLKYNZIQC4DPZICJBM2V7T6FUIJKNOZVPXY3FCK4GLQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651037802 (160h22m57.454502453s) [noise=true , address=185.167.204.205:4014 , piece_id=MJELQYF2MKIHI6UX2AFF7NTABPPTZ7NYEZN5GQNKOFBBAQ4XOKAA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651306523 (160h22m57.454771119s) [noise=true , address=81.171.14.70:4029 , piece_id=PMDZH27BZU52YWCVRUHLQB7K6CFGWK2UQKVFYMWJZMT53R5T3IVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651476372 (160h22m57.45494095s) [noise=true , address=81.171.14.70:4048 , piece_id=UYAQIALBK6OGIZU7UFRJRWLTSQFMQRJU5A6PKWFF7QQ5VB3H4LXQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651648406 (160h22m57.455113002s) [noise=true , address=89.149.201.147:4003 , piece_id=VCVV5WC5Q7YJFQZ3LTJQZ2WHWF5ISWELC2IPX6NJTCLSCRUF4L6Q, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: rpc: dial tcp 89.149.201.147:4003: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651820843 (160h22m57.455285449s) [noise=true , address=89.149.201.147:4019 , piece_id=JOQH7YYR52QRAXMXC35XHHDHIYU57AGBD4DE4AJROTHXDNY5CMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: rpc: dial tcp 89.149.201.147:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651991651 (160h22m57.455456234s) [noise=true , address=185.167.204.205:4031 , piece_id=YHTTQIWCH2YB7HLEUVV5P2AK5OWRB52KZBKKERQBQPGRD4JSMNOQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 139.59.144.22:36174->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.652019889 (160h22m57.455484483s) [seg_pos={0 0}, upload=141188]: Done waiting for segment. successful: 0 optimal: 26 errs: <nil>
Duration: 409.521066ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................XX......................................] duration:
1.083510713s
FAIL (2025-09-30 06:20:35 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 1.083532504s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [...................XXX......................................] duration:
2.763332357s
FAIL (2025-09-30 06:20:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.763359709s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [..................XXX.......................................] duration:
1.174154456s
FAIL (2025-09-30 06:20:30 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 26 but got 0)
======LOGS======
[noise=true , address=81.171.14.70:4045 , piece_id=DD53MUKF24OCOLISJNN4F2ESSJSAM6KTBCIHF4UJVOYLKPOLANEA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648490545 (160h22m57.451955126s) [noise=true , address=89.149.201.147:4013 , piece_id=RSPYSYOBACSJ4OKRGV7NQNNQT5ORQJNX4RZVVPHHHM63DYN4KCIQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: rpc: dial tcp 89.149.201.147:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648635402 (160h22m57.452099988s) [noise=true , address=185.167.204.206:4050 , piece_id=DHS3HOFXUBK4BKB5NVZVLDMNI2ZKTP6RVK4KJ2MVL67V47IL2Z3A, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648822212 (160h22m57.452286803s) [noise=true , address=81.171.14.70:4038 , piece_id=T5H2PB2PIPPCGVEDBD4PN5K7VI6TDMKXP6QW242EA6LMFJCAS4OQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: rpc: dial tcp 81.171.14.70:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648970309 (160h22m57.452434895s) [noise=true , address=89.149.201.147:4005 , piece_id=5UJBQPRPDDKVBMIPOZNSE2ZD5TL2KQFP7BNIHXYDW7XFTUCZ4KNA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649153071 (160h22m57.452617658s) [noise=true , address=89.149.201.147:4016 , piece_id=UUNTWX7FB4I7YG2LDN2Y2WP7BHXHZHYKNQROUVFRAMHEKEJQF6VA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649337300 (160h22m57.452801882s) [noise=true , address=185.167.204.205:4027 , piece_id=WTCV2L3SLOFED6725FQ46U3JEO2LE76LH2N4W767PMAFZ4DNGTWA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649489850 (160h22m57.45295445s) [noise=true , address=185.167.204.205:4025 , piece_id=KFG5MK4RB57N2XF4ZLMTAJ7HCCBSJUIGRFQRA3QOFEAHYRRZEUKQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649644940 (160h22m57.453109528s) [noise=true , address=81.171.14.70:4047 , piece_id=O6W5TPWL24YQCYKT7GWQ7T3GA55DIBTFU5HL244L6ZYXYMQQYMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: rpc: dial tcp 81.171.14.70:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649837367 (160h22m57.453301961s) [noise=true , address=89.149.201.147:4022 , piece_id=BLOGBOXX6FBANQXXBUN3BQWRWAH3PC43VZCIDRIXROQM2ZAV7NOA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: rpc: dial tcp 89.149.201.147:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650055408 (160h22m57.453519984s) [noise=true , address=185.167.204.206:4064 , piece_id=MAC6XEQNR2UYDLEDIPXR3VYLH4SR7VEI3RCJ27E24EIMIF4DSSGA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650229995 (160h22m57.453694573s) [noise=true , address=185.167.204.205:4012 , piece_id=X4IQFROU2Y2GCPBFNFIGBIV54LWLFY7UGPZ2YOB34ZZHAEQ3MBEQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650390416 (160h22m57.453855007s) [noise=true , address=89.149.201.147:4021 , piece_id=MAEF5F7L3C47ZSOTPF2Z5PWHXMTYUTFIZ6Z756MONBCQDDAF5BYQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: rpc: dial tcp 89.149.201.147:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650549336 (160h22m57.454013931s) [noise=true , address=185.167.204.205:4011 , piece_id=TTQHENFBPMCI3PZQEKV52IO3OUBDS5ACHCV2K34UHCSQRCQXZRVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650715583 (160h22m57.454180175s) [noise=true , address=185.167.204.205:4008 , piece_id=TG5PNUZMD6HB7AYOWQM6LAJIC4DFSGSWPPOLWD42ZLZQIA7TFOFA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650879777 (160h22m57.454344374s) [noise=true , address=185.167.204.206:4049 , piece_id=JJL2EE4FSKLKYNZIQC4DPZICJBM2V7T6FUIJKNOZVPXY3FCK4GLQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651037802 (160h22m57.454502453s) [noise=true , address=185.167.204.205:4014 , piece_id=MJELQYF2MKIHI6UX2AFF7NTABPPTZ7NYEZN5GQNKOFBBAQ4XOKAA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651306523 (160h22m57.454771119s) [noise=true , address=81.171.14.70:4029 , piece_id=PMDZH27BZU52YWCVRUHLQB7K6CFGWK2UQKVFYMWJZMT53R5T3IVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651476372 (160h22m57.45494095s) [noise=true , address=81.171.14.70:4048 , piece_id=UYAQIALBK6OGIZU7UFRJRWLTSQFMQRJU5A6PKWFF7QQ5VB3H4LXQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651648406 (160h22m57.455113002s) [noise=true , address=89.149.201.147:4003 , piece_id=VCVV5WC5Q7YJFQZ3LTJQZ2WHWF5ISWELC2IPX6NJTCLSCRUF4L6Q, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: rpc: dial tcp 89.149.201.147:4003: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651820843 (160h22m57.455285449s) [noise=true , address=89.149.201.147:4019 , piece_id=JOQH7YYR52QRAXMXC35XHHDHIYU57AGBD4DE4AJROTHXDNY5CMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: rpc: dial tcp 89.149.201.147:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651991651 (160h22m57.455456234s) [noise=true , address=185.167.204.205:4031 , piece_id=YHTTQIWCH2YB7HLEUVV5P2AK5OWRB52KZBKKERQBQPGRD4JSMNOQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 139.59.144.22:36174->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.652019889 (160h22m57.455484483s) [seg_pos={0 0}, upload=141188]: Done waiting for segment. successful: 0 optimal: 26 errs: <nil>
Duration: 1.17419432s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
2.932849266s
FAIL (2025-09-30 06:20:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.932904189s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [....................XXX.....................................] duration:
3.014633953s
FAIL (2025-09-30 06:19:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.014657014s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................XX.....................................] duration:
1.32583991s
FAIL (2025-09-30 06:19:34 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 1.325866263s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [...................XXX......................................] duration:
1.12156988s
FAIL (2025-09-30 06:19:20 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 26 but got 0)
======LOGS======
[noise=true , address=81.171.14.70:4045 , piece_id=DD53MUKF24OCOLISJNN4F2ESSJSAM6KTBCIHF4UJVOYLKPOLANEA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648490545 (160h22m57.451955126s) [noise=true , address=89.149.201.147:4013 , piece_id=RSPYSYOBACSJ4OKRGV7NQNNQT5ORQJNX4RZVVPHHHM63DYN4KCIQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: rpc: dial tcp 89.149.201.147:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648635402 (160h22m57.452099988s) [noise=true , address=185.167.204.206:4050 , piece_id=DHS3HOFXUBK4BKB5NVZVLDMNI2ZKTP6RVK4KJ2MVL67V47IL2Z3A, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648822212 (160h22m57.452286803s) [noise=true , address=81.171.14.70:4038 , piece_id=T5H2PB2PIPPCGVEDBD4PN5K7VI6TDMKXP6QW242EA6LMFJCAS4OQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: rpc: dial tcp 81.171.14.70:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648970309 (160h22m57.452434895s) [noise=true , address=89.149.201.147:4005 , piece_id=5UJBQPRPDDKVBMIPOZNSE2ZD5TL2KQFP7BNIHXYDW7XFTUCZ4KNA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649153071 (160h22m57.452617658s) [noise=true , address=89.149.201.147:4016 , piece_id=UUNTWX7FB4I7YG2LDN2Y2WP7BHXHZHYKNQROUVFRAMHEKEJQF6VA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649337300 (160h22m57.452801882s) [noise=true , address=185.167.204.205:4027 , piece_id=WTCV2L3SLOFED6725FQ46U3JEO2LE76LH2N4W767PMAFZ4DNGTWA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649489850 (160h22m57.45295445s) [noise=true , address=185.167.204.205:4025 , piece_id=KFG5MK4RB57N2XF4ZLMTAJ7HCCBSJUIGRFQRA3QOFEAHYRRZEUKQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649644940 (160h22m57.453109528s) [noise=true , address=81.171.14.70:4047 , piece_id=O6W5TPWL24YQCYKT7GWQ7T3GA55DIBTFU5HL244L6ZYXYMQQYMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: rpc: dial tcp 81.171.14.70:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649837367 (160h22m57.453301961s) [noise=true , address=89.149.201.147:4022 , piece_id=BLOGBOXX6FBANQXXBUN3BQWRWAH3PC43VZCIDRIXROQM2ZAV7NOA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: rpc: dial tcp 89.149.201.147:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650055408 (160h22m57.453519984s) [noise=true , address=185.167.204.206:4064 , piece_id=MAC6XEQNR2UYDLEDIPXR3VYLH4SR7VEI3RCJ27E24EIMIF4DSSGA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650229995 (160h22m57.453694573s) [noise=true , address=185.167.204.205:4012 , piece_id=X4IQFROU2Y2GCPBFNFIGBIV54LWLFY7UGPZ2YOB34ZZHAEQ3MBEQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650390416 (160h22m57.453855007s) [noise=true , address=89.149.201.147:4021 , piece_id=MAEF5F7L3C47ZSOTPF2Z5PWHXMTYUTFIZ6Z756MONBCQDDAF5BYQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: rpc: dial tcp 89.149.201.147:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650549336 (160h22m57.454013931s) [noise=true , address=185.167.204.205:4011 , piece_id=TTQHENFBPMCI3PZQEKV52IO3OUBDS5ACHCV2K34UHCSQRCQXZRVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650715583 (160h22m57.454180175s) [noise=true , address=185.167.204.205:4008 , piece_id=TG5PNUZMD6HB7AYOWQM6LAJIC4DFSGSWPPOLWD42ZLZQIA7TFOFA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650879777 (160h22m57.454344374s) [noise=true , address=185.167.204.206:4049 , piece_id=JJL2EE4FSKLKYNZIQC4DPZICJBM2V7T6FUIJKNOZVPXY3FCK4GLQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651037802 (160h22m57.454502453s) [noise=true , address=185.167.204.205:4014 , piece_id=MJELQYF2MKIHI6UX2AFF7NTABPPTZ7NYEZN5GQNKOFBBAQ4XOKAA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651306523 (160h22m57.454771119s) [noise=true , address=81.171.14.70:4029 , piece_id=PMDZH27BZU52YWCVRUHLQB7K6CFGWK2UQKVFYMWJZMT53R5T3IVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651476372 (160h22m57.45494095s) [noise=true , address=81.171.14.70:4048 , piece_id=UYAQIALBK6OGIZU7UFRJRWLTSQFMQRJU5A6PKWFF7QQ5VB3H4LXQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651648406 (160h22m57.455113002s) [noise=true , address=89.149.201.147:4003 , piece_id=VCVV5WC5Q7YJFQZ3LTJQZ2WHWF5ISWELC2IPX6NJTCLSCRUF4L6Q, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: rpc: dial tcp 89.149.201.147:4003: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651820843 (160h22m57.455285449s) [noise=true , address=89.149.201.147:4019 , piece_id=JOQH7YYR52QRAXMXC35XHHDHIYU57AGBD4DE4AJROTHXDNY5CMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: rpc: dial tcp 89.149.201.147:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651991651 (160h22m57.455456234s) [noise=true , address=185.167.204.205:4031 , piece_id=YHTTQIWCH2YB7HLEUVV5P2AK5OWRB52KZBKKERQBQPGRD4JSMNOQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 139.59.144.22:36174->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.652019889 (160h22m57.455484483s) [seg_pos={0 0}, upload=141188]: Done waiting for segment. successful: 0 optimal: 26 errs: <nil>
Duration: 1.121605344s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
2.94944443s
FAIL (2025-09-30 06:18:53 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.949473668s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....................XXX....................................] duration:
2.617221165s
FAIL (2025-09-30 06:18:46 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.617241294s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [....................XXX.....................................] duration:
895.160993ms
FAIL (2025-09-30 06:18:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 26 but got 0)
======LOGS======
[noise=true , address=81.171.14.70:4045 , piece_id=DD53MUKF24OCOLISJNN4F2ESSJSAM6KTBCIHF4UJVOYLKPOLANEA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648490545 (160h22m57.451955126s) [noise=true , address=89.149.201.147:4013 , piece_id=RSPYSYOBACSJ4OKRGV7NQNNQT5ORQJNX4RZVVPHHHM63DYN4KCIQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: rpc: dial tcp 89.149.201.147:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648635402 (160h22m57.452099988s) [noise=true , address=185.167.204.206:4050 , piece_id=DHS3HOFXUBK4BKB5NVZVLDMNI2ZKTP6RVK4KJ2MVL67V47IL2Z3A, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648822212 (160h22m57.452286803s) [noise=true , address=81.171.14.70:4038 , piece_id=T5H2PB2PIPPCGVEDBD4PN5K7VI6TDMKXP6QW242EA6LMFJCAS4OQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: rpc: dial tcp 81.171.14.70:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648970309 (160h22m57.452434895s) [noise=true , address=89.149.201.147:4005 , piece_id=5UJBQPRPDDKVBMIPOZNSE2ZD5TL2KQFP7BNIHXYDW7XFTUCZ4KNA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649153071 (160h22m57.452617658s) [noise=true , address=89.149.201.147:4016 , piece_id=UUNTWX7FB4I7YG2LDN2Y2WP7BHXHZHYKNQROUVFRAMHEKEJQF6VA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649337300 (160h22m57.452801882s) [noise=true , address=185.167.204.205:4027 , piece_id=WTCV2L3SLOFED6725FQ46U3JEO2LE76LH2N4W767PMAFZ4DNGTWA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649489850 (160h22m57.45295445s) [noise=true , address=185.167.204.205:4025 , piece_id=KFG5MK4RB57N2XF4ZLMTAJ7HCCBSJUIGRFQRA3QOFEAHYRRZEUKQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649644940 (160h22m57.453109528s) [noise=true , address=81.171.14.70:4047 , piece_id=O6W5TPWL24YQCYKT7GWQ7T3GA55DIBTFU5HL244L6ZYXYMQQYMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: rpc: dial tcp 81.171.14.70:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649837367 (160h22m57.453301961s) [noise=true , address=89.149.201.147:4022 , piece_id=BLOGBOXX6FBANQXXBUN3BQWRWAH3PC43VZCIDRIXROQM2ZAV7NOA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: rpc: dial tcp 89.149.201.147:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650055408 (160h22m57.453519984s) [noise=true , address=185.167.204.206:4064 , piece_id=MAC6XEQNR2UYDLEDIPXR3VYLH4SR7VEI3RCJ27E24EIMIF4DSSGA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650229995 (160h22m57.453694573s) [noise=true , address=185.167.204.205:4012 , piece_id=X4IQFROU2Y2GCPBFNFIGBIV54LWLFY7UGPZ2YOB34ZZHAEQ3MBEQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650390416 (160h22m57.453855007s) [noise=true , address=89.149.201.147:4021 , piece_id=MAEF5F7L3C47ZSOTPF2Z5PWHXMTYUTFIZ6Z756MONBCQDDAF5BYQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: rpc: dial tcp 89.149.201.147:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650549336 (160h22m57.454013931s) [noise=true , address=185.167.204.205:4011 , piece_id=TTQHENFBPMCI3PZQEKV52IO3OUBDS5ACHCV2K34UHCSQRCQXZRVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650715583 (160h22m57.454180175s) [noise=true , address=185.167.204.205:4008 , piece_id=TG5PNUZMD6HB7AYOWQM6LAJIC4DFSGSWPPOLWD42ZLZQIA7TFOFA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650879777 (160h22m57.454344374s) [noise=true , address=185.167.204.206:4049 , piece_id=JJL2EE4FSKLKYNZIQC4DPZICJBM2V7T6FUIJKNOZVPXY3FCK4GLQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651037802 (160h22m57.454502453s) [noise=true , address=185.167.204.205:4014 , piece_id=MJELQYF2MKIHI6UX2AFF7NTABPPTZ7NYEZN5GQNKOFBBAQ4XOKAA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651306523 (160h22m57.454771119s) [noise=true , address=81.171.14.70:4029 , piece_id=PMDZH27BZU52YWCVRUHLQB7K6CFGWK2UQKVFYMWJZMT53R5T3IVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651476372 (160h22m57.45494095s) [noise=true , address=81.171.14.70:4048 , piece_id=UYAQIALBK6OGIZU7UFRJRWLTSQFMQRJU5A6PKWFF7QQ5VB3H4LXQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651648406 (160h22m57.455113002s) [noise=true , address=89.149.201.147:4003 , piece_id=VCVV5WC5Q7YJFQZ3LTJQZ2WHWF5ISWELC2IPX6NJTCLSCRUF4L6Q, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: rpc: dial tcp 89.149.201.147:4003: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651820843 (160h22m57.455285449s) [noise=true , address=89.149.201.147:4019 , piece_id=JOQH7YYR52QRAXMXC35XHHDHIYU57AGBD4DE4AJROTHXDNY5CMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: rpc: dial tcp 89.149.201.147:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651991651 (160h22m57.455456234s) [noise=true , address=185.167.204.205:4031 , piece_id=YHTTQIWCH2YB7HLEUVV5P2AK5OWRB52KZBKKERQBQPGRD4JSMNOQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 139.59.144.22:36174->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.652019889 (160h22m57.455484483s) [seg_pos={0 0}, upload=141188]: Done waiting for segment. successful: 0 optimal: 26 errs: <nil>
Duration: 895.259156ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................XX....................................] duration:
1.08893998s
FAIL (2025-09-30 06:18:28 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 1.088970827s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.....................XXX....................................] duration:
870.819777ms
FAIL (2025-09-30 06:18:08 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 26 but got 0)
======LOGS======
[noise=true , address=81.171.14.70:4045 , piece_id=DD53MUKF24OCOLISJNN4F2ESSJSAM6KTBCIHF4UJVOYLKPOLANEA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648490545 (160h22m57.451955126s) [noise=true , address=89.149.201.147:4013 , piece_id=RSPYSYOBACSJ4OKRGV7NQNNQT5ORQJNX4RZVVPHHHM63DYN4KCIQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: rpc: dial tcp 89.149.201.147:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648635402 (160h22m57.452099988s) [noise=true , address=185.167.204.206:4050 , piece_id=DHS3HOFXUBK4BKB5NVZVLDMNI2ZKTP6RVK4KJ2MVL67V47IL2Z3A, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648822212 (160h22m57.452286803s) [noise=true , address=81.171.14.70:4038 , piece_id=T5H2PB2PIPPCGVEDBD4PN5K7VI6TDMKXP6QW242EA6LMFJCAS4OQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: rpc: dial tcp 81.171.14.70:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648970309 (160h22m57.452434895s) [noise=true , address=89.149.201.147:4005 , piece_id=5UJBQPRPDDKVBMIPOZNSE2ZD5TL2KQFP7BNIHXYDW7XFTUCZ4KNA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649153071 (160h22m57.452617658s) [noise=true , address=89.149.201.147:4016 , piece_id=UUNTWX7FB4I7YG2LDN2Y2WP7BHXHZHYKNQROUVFRAMHEKEJQF6VA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649337300 (160h22m57.452801882s) [noise=true , address=185.167.204.205:4027 , piece_id=WTCV2L3SLOFED6725FQ46U3JEO2LE76LH2N4W767PMAFZ4DNGTWA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649489850 (160h22m57.45295445s) [noise=true , address=185.167.204.205:4025 , piece_id=KFG5MK4RB57N2XF4ZLMTAJ7HCCBSJUIGRFQRA3QOFEAHYRRZEUKQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649644940 (160h22m57.453109528s) [noise=true , address=81.171.14.70:4047 , piece_id=O6W5TPWL24YQCYKT7GWQ7T3GA55DIBTFU5HL244L6ZYXYMQQYMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: rpc: dial tcp 81.171.14.70:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649837367 (160h22m57.453301961s) [noise=true , address=89.149.201.147:4022 , piece_id=BLOGBOXX6FBANQXXBUN3BQWRWAH3PC43VZCIDRIXROQM2ZAV7NOA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: rpc: dial tcp 89.149.201.147:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650055408 (160h22m57.453519984s) [noise=true , address=185.167.204.206:4064 , piece_id=MAC6XEQNR2UYDLEDIPXR3VYLH4SR7VEI3RCJ27E24EIMIF4DSSGA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650229995 (160h22m57.453694573s) [noise=true , address=185.167.204.205:4012 , piece_id=X4IQFROU2Y2GCPBFNFIGBIV54LWLFY7UGPZ2YOB34ZZHAEQ3MBEQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650390416 (160h22m57.453855007s) [noise=true , address=89.149.201.147:4021 , piece_id=MAEF5F7L3C47ZSOTPF2Z5PWHXMTYUTFIZ6Z756MONBCQDDAF5BYQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: rpc: dial tcp 89.149.201.147:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650549336 (160h22m57.454013931s) [noise=true , address=185.167.204.205:4011 , piece_id=TTQHENFBPMCI3PZQEKV52IO3OUBDS5ACHCV2K34UHCSQRCQXZRVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650715583 (160h22m57.454180175s) [noise=true , address=185.167.204.205:4008 , piece_id=TG5PNUZMD6HB7AYOWQM6LAJIC4DFSGSWPPOLWD42ZLZQIA7TFOFA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650879777 (160h22m57.454344374s) [noise=true , address=185.167.204.206:4049 , piece_id=JJL2EE4FSKLKYNZIQC4DPZICJBM2V7T6FUIJKNOZVPXY3FCK4GLQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651037802 (160h22m57.454502453s) [noise=true , address=185.167.204.205:4014 , piece_id=MJELQYF2MKIHI6UX2AFF7NTABPPTZ7NYEZN5GQNKOFBBAQ4XOKAA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651306523 (160h22m57.454771119s) [noise=true , address=81.171.14.70:4029 , piece_id=PMDZH27BZU52YWCVRUHLQB7K6CFGWK2UQKVFYMWJZMT53R5T3IVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651476372 (160h22m57.45494095s) [noise=true , address=81.171.14.70:4048 , piece_id=UYAQIALBK6OGIZU7UFRJRWLTSQFMQRJU5A6PKWFF7QQ5VB3H4LXQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651648406 (160h22m57.455113002s) [noise=true , address=89.149.201.147:4003 , piece_id=VCVV5WC5Q7YJFQZ3LTJQZ2WHWF5ISWELC2IPX6NJTCLSCRUF4L6Q, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: rpc: dial tcp 89.149.201.147:4003: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651820843 (160h22m57.455285449s) [noise=true , address=89.149.201.147:4019 , piece_id=JOQH7YYR52QRAXMXC35XHHDHIYU57AGBD4DE4AJROTHXDNY5CMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: rpc: dial tcp 89.149.201.147:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651991651 (160h22m57.455456234s) [noise=true , address=185.167.204.205:4031 , piece_id=YHTTQIWCH2YB7HLEUVV5P2AK5OWRB52KZBKKERQBQPGRD4JSMNOQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 139.59.144.22:36174->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.652019889 (160h22m57.455484483s) [seg_pos={0 0}, upload=141188]: Done waiting for segment. successful: 0 optimal: 26 errs: <nil>
Duration: 870.902078ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [......................XXX...................................] duration:
2.98096087s
FAIL (2025-09-30 06:18:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.980988349s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
2.828622558s
FAIL (2025-09-30 06:17:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.828647873s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......................XXX..................................] duration:
2.92151564s
FAIL (2025-09-30 06:17:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.921544619s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................XX...................................] duration:
1.412665158s
FAIL (2025-09-30 06:17:21 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 1.412726897s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [......................XXX...................................] duration:
891.705671ms
FAIL (2025-09-30 06:17:02 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 26 but got 0)
======LOGS======
[noise=true , address=81.171.14.70:4045 , piece_id=DD53MUKF24OCOLISJNN4F2ESSJSAM6KTBCIHF4UJVOYLKPOLANEA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648490545 (160h22m57.451955126s) [noise=true , address=89.149.201.147:4013 , piece_id=RSPYSYOBACSJ4OKRGV7NQNNQT5ORQJNX4RZVVPHHHM63DYN4KCIQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: rpc: dial tcp 89.149.201.147:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648635402 (160h22m57.452099988s) [noise=true , address=185.167.204.206:4050 , piece_id=DHS3HOFXUBK4BKB5NVZVLDMNI2ZKTP6RVK4KJ2MVL67V47IL2Z3A, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648822212 (160h22m57.452286803s) [noise=true , address=81.171.14.70:4038 , piece_id=T5H2PB2PIPPCGVEDBD4PN5K7VI6TDMKXP6QW242EA6LMFJCAS4OQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: rpc: dial tcp 81.171.14.70:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648970309 (160h22m57.452434895s) [noise=true , address=89.149.201.147:4005 , piece_id=5UJBQPRPDDKVBMIPOZNSE2ZD5TL2KQFP7BNIHXYDW7XFTUCZ4KNA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649153071 (160h22m57.452617658s) [noise=true , address=89.149.201.147:4016 , piece_id=UUNTWX7FB4I7YG2LDN2Y2WP7BHXHZHYKNQROUVFRAMHEKEJQF6VA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649337300 (160h22m57.452801882s) [noise=true , address=185.167.204.205:4027 , piece_id=WTCV2L3SLOFED6725FQ46U3JEO2LE76LH2N4W767PMAFZ4DNGTWA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649489850 (160h22m57.45295445s) [noise=true , address=185.167.204.205:4025 , piece_id=KFG5MK4RB57N2XF4ZLMTAJ7HCCBSJUIGRFQRA3QOFEAHYRRZEUKQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649644940 (160h22m57.453109528s) [noise=true , address=81.171.14.70:4047 , piece_id=O6W5TPWL24YQCYKT7GWQ7T3GA55DIBTFU5HL244L6ZYXYMQQYMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: rpc: dial tcp 81.171.14.70:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649837367 (160h22m57.453301961s) [noise=true , address=89.149.201.147:4022 , piece_id=BLOGBOXX6FBANQXXBUN3BQWRWAH3PC43VZCIDRIXROQM2ZAV7NOA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: rpc: dial tcp 89.149.201.147:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650055408 (160h22m57.453519984s) [noise=true , address=185.167.204.206:4064 , piece_id=MAC6XEQNR2UYDLEDIPXR3VYLH4SR7VEI3RCJ27E24EIMIF4DSSGA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650229995 (160h22m57.453694573s) [noise=true , address=185.167.204.205:4012 , piece_id=X4IQFROU2Y2GCPBFNFIGBIV54LWLFY7UGPZ2YOB34ZZHAEQ3MBEQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650390416 (160h22m57.453855007s) [noise=true , address=89.149.201.147:4021 , piece_id=MAEF5F7L3C47ZSOTPF2Z5PWHXMTYUTFIZ6Z756MONBCQDDAF5BYQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: rpc: dial tcp 89.149.201.147:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650549336 (160h22m57.454013931s) [noise=true , address=185.167.204.205:4011 , piece_id=TTQHENFBPMCI3PZQEKV52IO3OUBDS5ACHCV2K34UHCSQRCQXZRVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650715583 (160h22m57.454180175s) [noise=true , address=185.167.204.205:4008 , piece_id=TG5PNUZMD6HB7AYOWQM6LAJIC4DFSGSWPPOLWD42ZLZQIA7TFOFA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650879777 (160h22m57.454344374s) [noise=true , address=185.167.204.206:4049 , piece_id=JJL2EE4FSKLKYNZIQC4DPZICJBM2V7T6FUIJKNOZVPXY3FCK4GLQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651037802 (160h22m57.454502453s) [noise=true , address=185.167.204.205:4014 , piece_id=MJELQYF2MKIHI6UX2AFF7NTABPPTZ7NYEZN5GQNKOFBBAQ4XOKAA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651306523 (160h22m57.454771119s) [noise=true , address=81.171.14.70:4029 , piece_id=PMDZH27BZU52YWCVRUHLQB7K6CFGWK2UQKVFYMWJZMT53R5T3IVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651476372 (160h22m57.45494095s) [noise=true , address=81.171.14.70:4048 , piece_id=UYAQIALBK6OGIZU7UFRJRWLTSQFMQRJU5A6PKWFF7QQ5VB3H4LXQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651648406 (160h22m57.455113002s) [noise=true , address=89.149.201.147:4003 , piece_id=VCVV5WC5Q7YJFQZ3LTJQZ2WHWF5ISWELC2IPX6NJTCLSCRUF4L6Q, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: rpc: dial tcp 89.149.201.147:4003: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651820843 (160h22m57.455285449s) [noise=true , address=89.149.201.147:4019 , piece_id=JOQH7YYR52QRAXMXC35XHHDHIYU57AGBD4DE4AJROTHXDNY5CMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: rpc: dial tcp 89.149.201.147:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651991651 (160h22m57.455456234s) [noise=true , address=185.167.204.205:4031 , piece_id=YHTTQIWCH2YB7HLEUVV5P2AK5OWRB52KZBKKERQBQPGRD4JSMNOQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 139.59.144.22:36174->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.652019889 (160h22m57.455484483s) [seg_pos={0 0}, upload=141188]: Done waiting for segment. successful: 0 optimal: 26 errs: <nil>
Duration: 891.743684ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
3.006551198s
FAIL (2025-09-30 06:16:38 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.006844784s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [........................XXX.................................] duration:
2.700134622s
FAIL (2025-09-30 06:16:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.700738413s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.......................XXX..................................] duration:
862.905196ms
FAIL (2025-09-30 06:16:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 26 but got 0)
======LOGS======
[noise=true , address=81.171.14.70:4045 , piece_id=DD53MUKF24OCOLISJNN4F2ESSJSAM6KTBCIHF4UJVOYLKPOLANEA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648490545 (160h22m57.451955126s) [noise=true , address=89.149.201.147:4013 , piece_id=RSPYSYOBACSJ4OKRGV7NQNNQT5ORQJNX4RZVVPHHHM63DYN4KCIQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: rpc: dial tcp 89.149.201.147:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648635402 (160h22m57.452099988s) [noise=true , address=185.167.204.206:4050 , piece_id=DHS3HOFXUBK4BKB5NVZVLDMNI2ZKTP6RVK4KJ2MVL67V47IL2Z3A, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648822212 (160h22m57.452286803s) [noise=true , address=81.171.14.70:4038 , piece_id=T5H2PB2PIPPCGVEDBD4PN5K7VI6TDMKXP6QW242EA6LMFJCAS4OQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: rpc: dial tcp 81.171.14.70:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648970309 (160h22m57.452434895s) [noise=true , address=89.149.201.147:4005 , piece_id=5UJBQPRPDDKVBMIPOZNSE2ZD5TL2KQFP7BNIHXYDW7XFTUCZ4KNA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649153071 (160h22m57.452617658s) [noise=true , address=89.149.201.147:4016 , piece_id=UUNTWX7FB4I7YG2LDN2Y2WP7BHXHZHYKNQROUVFRAMHEKEJQF6VA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649337300 (160h22m57.452801882s) [noise=true , address=185.167.204.205:4027 , piece_id=WTCV2L3SLOFED6725FQ46U3JEO2LE76LH2N4W767PMAFZ4DNGTWA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649489850 (160h22m57.45295445s) [noise=true , address=185.167.204.205:4025 , piece_id=KFG5MK4RB57N2XF4ZLMTAJ7HCCBSJUIGRFQRA3QOFEAHYRRZEUKQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649644940 (160h22m57.453109528s) [noise=true , address=81.171.14.70:4047 , piece_id=O6W5TPWL24YQCYKT7GWQ7T3GA55DIBTFU5HL244L6ZYXYMQQYMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: rpc: dial tcp 81.171.14.70:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649837367 (160h22m57.453301961s) [noise=true , address=89.149.201.147:4022 , piece_id=BLOGBOXX6FBANQXXBUN3BQWRWAH3PC43VZCIDRIXROQM2ZAV7NOA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: rpc: dial tcp 89.149.201.147:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650055408 (160h22m57.453519984s) [noise=true , address=185.167.204.206:4064 , piece_id=MAC6XEQNR2UYDLEDIPXR3VYLH4SR7VEI3RCJ27E24EIMIF4DSSGA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650229995 (160h22m57.453694573s) [noise=true , address=185.167.204.205:4012 , piece_id=X4IQFROU2Y2GCPBFNFIGBIV54LWLFY7UGPZ2YOB34ZZHAEQ3MBEQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650390416 (160h22m57.453855007s) [noise=true , address=89.149.201.147:4021 , piece_id=MAEF5F7L3C47ZSOTPF2Z5PWHXMTYUTFIZ6Z756MONBCQDDAF5BYQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: rpc: dial tcp 89.149.201.147:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650549336 (160h22m57.454013931s) [noise=true , address=185.167.204.205:4011 , piece_id=TTQHENFBPMCI3PZQEKV52IO3OUBDS5ACHCV2K34UHCSQRCQXZRVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650715583 (160h22m57.454180175s) [noise=true , address=185.167.204.205:4008 , piece_id=TG5PNUZMD6HB7AYOWQM6LAJIC4DFSGSWPPOLWD42ZLZQIA7TFOFA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650879777 (160h22m57.454344374s) [noise=true , address=185.167.204.206:4049 , piece_id=JJL2EE4FSKLKYNZIQC4DPZICJBM2V7T6FUIJKNOZVPXY3FCK4GLQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651037802 (160h22m57.454502453s) [noise=true , address=185.167.204.205:4014 , piece_id=MJELQYF2MKIHI6UX2AFF7NTABPPTZ7NYEZN5GQNKOFBBAQ4XOKAA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651306523 (160h22m57.454771119s) [noise=true , address=81.171.14.70:4029 , piece_id=PMDZH27BZU52YWCVRUHLQB7K6CFGWK2UQKVFYMWJZMT53R5T3IVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651476372 (160h22m57.45494095s) [noise=true , address=81.171.14.70:4048 , piece_id=UYAQIALBK6OGIZU7UFRJRWLTSQFMQRJU5A6PKWFF7QQ5VB3H4LXQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651648406 (160h22m57.455113002s) [noise=true , address=89.149.201.147:4003 , piece_id=VCVV5WC5Q7YJFQZ3LTJQZ2WHWF5ISWELC2IPX6NJTCLSCRUF4L6Q, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: rpc: dial tcp 89.149.201.147:4003: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651820843 (160h22m57.455285449s) [noise=true , address=89.149.201.147:4019 , piece_id=JOQH7YYR52QRAXMXC35XHHDHIYU57AGBD4DE4AJROTHXDNY5CMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: rpc: dial tcp 89.149.201.147:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651991651 (160h22m57.455456234s) [noise=true , address=185.167.204.205:4031 , piece_id=YHTTQIWCH2YB7HLEUVV5P2AK5OWRB52KZBKKERQBQPGRD4JSMNOQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 139.59.144.22:36174->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.652019889 (160h22m57.455484483s) [seg_pos={0 0}, upload=141188]: Done waiting for segment. successful: 0 optimal: 26 errs: <nil>
Duration: 862.944751ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................XX..................................] duration:
1.15203491s
FAIL (2025-09-30 06:16:17 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 1.152068582s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................XX.................................] duration:
1.180892566s
FAIL (2025-09-30 06:16:01 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 1.18092052s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........................XXX................................] duration:
2.937651061s
FAIL (2025-09-30 06:15:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.937676729s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................XX................................] duration:
1.386418062s
FAIL (2025-09-30 06:15:46 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 1.386442849s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
2.979687529s
FAIL (2025-09-30 06:15:36 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.979713015s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [........................XXX.................................] duration:
897.621718ms
FAIL (2025-09-30 06:15:29 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 26 but got 0)
======LOGS======
[noise=true , address=81.171.14.70:4045 , piece_id=DD53MUKF24OCOLISJNN4F2ESSJSAM6KTBCIHF4UJVOYLKPOLANEA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648490545 (160h22m57.451955126s) [noise=true , address=89.149.201.147:4013 , piece_id=RSPYSYOBACSJ4OKRGV7NQNNQT5ORQJNX4RZVVPHHHM63DYN4KCIQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: rpc: dial tcp 89.149.201.147:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648635402 (160h22m57.452099988s) [noise=true , address=185.167.204.206:4050 , piece_id=DHS3HOFXUBK4BKB5NVZVLDMNI2ZKTP6RVK4KJ2MVL67V47IL2Z3A, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648822212 (160h22m57.452286803s) [noise=true , address=81.171.14.70:4038 , piece_id=T5H2PB2PIPPCGVEDBD4PN5K7VI6TDMKXP6QW242EA6LMFJCAS4OQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: rpc: dial tcp 81.171.14.70:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648970309 (160h22m57.452434895s) [noise=true , address=89.149.201.147:4005 , piece_id=5UJBQPRPDDKVBMIPOZNSE2ZD5TL2KQFP7BNIHXYDW7XFTUCZ4KNA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649153071 (160h22m57.452617658s) [noise=true , address=89.149.201.147:4016 , piece_id=UUNTWX7FB4I7YG2LDN2Y2WP7BHXHZHYKNQROUVFRAMHEKEJQF6VA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649337300 (160h22m57.452801882s) [noise=true , address=185.167.204.205:4027 , piece_id=WTCV2L3SLOFED6725FQ46U3JEO2LE76LH2N4W767PMAFZ4DNGTWA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649489850 (160h22m57.45295445s) [noise=true , address=185.167.204.205:4025 , piece_id=KFG5MK4RB57N2XF4ZLMTAJ7HCCBSJUIGRFQRA3QOFEAHYRRZEUKQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649644940 (160h22m57.453109528s) [noise=true , address=81.171.14.70:4047 , piece_id=O6W5TPWL24YQCYKT7GWQ7T3GA55DIBTFU5HL244L6ZYXYMQQYMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: rpc: dial tcp 81.171.14.70:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649837367 (160h22m57.453301961s) [noise=true , address=89.149.201.147:4022 , piece_id=BLOGBOXX6FBANQXXBUN3BQWRWAH3PC43VZCIDRIXROQM2ZAV7NOA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: rpc: dial tcp 89.149.201.147:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650055408 (160h22m57.453519984s) [noise=true , address=185.167.204.206:4064 , piece_id=MAC6XEQNR2UYDLEDIPXR3VYLH4SR7VEI3RCJ27E24EIMIF4DSSGA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650229995 (160h22m57.453694573s) [noise=true , address=185.167.204.205:4012 , piece_id=X4IQFROU2Y2GCPBFNFIGBIV54LWLFY7UGPZ2YOB34ZZHAEQ3MBEQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650390416 (160h22m57.453855007s) [noise=true , address=89.149.201.147:4021 , piece_id=MAEF5F7L3C47ZSOTPF2Z5PWHXMTYUTFIZ6Z756MONBCQDDAF5BYQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: rpc: dial tcp 89.149.201.147:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650549336 (160h22m57.454013931s) [noise=true , address=185.167.204.205:4011 , piece_id=TTQHENFBPMCI3PZQEKV52IO3OUBDS5ACHCV2K34UHCSQRCQXZRVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650715583 (160h22m57.454180175s) [noise=true , address=185.167.204.205:4008 , piece_id=TG5PNUZMD6HB7AYOWQM6LAJIC4DFSGSWPPOLWD42ZLZQIA7TFOFA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650879777 (160h22m57.454344374s) [noise=true , address=185.167.204.206:4049 , piece_id=JJL2EE4FSKLKYNZIQC4DPZICJBM2V7T6FUIJKNOZVPXY3FCK4GLQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651037802 (160h22m57.454502453s) [noise=true , address=185.167.204.205:4014 , piece_id=MJELQYF2MKIHI6UX2AFF7NTABPPTZ7NYEZN5GQNKOFBBAQ4XOKAA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651306523 (160h22m57.454771119s) [noise=true , address=81.171.14.70:4029 , piece_id=PMDZH27BZU52YWCVRUHLQB7K6CFGWK2UQKVFYMWJZMT53R5T3IVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651476372 (160h22m57.45494095s) [noise=true , address=81.171.14.70:4048 , piece_id=UYAQIALBK6OGIZU7UFRJRWLTSQFMQRJU5A6PKWFF7QQ5VB3H4LXQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651648406 (160h22m57.455113002s) [noise=true , address=89.149.201.147:4003 , piece_id=VCVV5WC5Q7YJFQZ3LTJQZ2WHWF5ISWELC2IPX6NJTCLSCRUF4L6Q, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: rpc: dial tcp 89.149.201.147:4003: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651820843 (160h22m57.455285449s) [noise=true , address=89.149.201.147:4019 , piece_id=JOQH7YYR52QRAXMXC35XHHDHIYU57AGBD4DE4AJROTHXDNY5CMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: rpc: dial tcp 89.149.201.147:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651991651 (160h22m57.455456234s) [noise=true , address=185.167.204.205:4031 , piece_id=YHTTQIWCH2YB7HLEUVV5P2AK5OWRB52KZBKKERQBQPGRD4JSMNOQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 139.59.144.22:36174->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.652019889 (160h22m57.455484483s) [seg_pos={0 0}, upload=141188]: Done waiting for segment. successful: 0 optimal: 26 errs: <nil>
Duration: 897.655583ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
3.056715491s
FAIL (2025-09-30 06:15:20 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.056767914s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.........................XXX................................] duration:
940.451938ms
FAIL (2025-09-30 06:15:06 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 26 but got 0)
======LOGS======
[noise=true , address=81.171.14.70:4045 , piece_id=DD53MUKF24OCOLISJNN4F2ESSJSAM6KTBCIHF4UJVOYLKPOLANEA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648490545 (160h22m57.451955126s) [noise=true , address=89.149.201.147:4013 , piece_id=RSPYSYOBACSJ4OKRGV7NQNNQT5ORQJNX4RZVVPHHHM63DYN4KCIQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: rpc: dial tcp 89.149.201.147:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648635402 (160h22m57.452099988s) [noise=true , address=185.167.204.206:4050 , piece_id=DHS3HOFXUBK4BKB5NVZVLDMNI2ZKTP6RVK4KJ2MVL67V47IL2Z3A, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648822212 (160h22m57.452286803s) [noise=true , address=81.171.14.70:4038 , piece_id=T5H2PB2PIPPCGVEDBD4PN5K7VI6TDMKXP6QW242EA6LMFJCAS4OQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: rpc: dial tcp 81.171.14.70:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648970309 (160h22m57.452434895s) [noise=true , address=89.149.201.147:4005 , piece_id=5UJBQPRPDDKVBMIPOZNSE2ZD5TL2KQFP7BNIHXYDW7XFTUCZ4KNA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649153071 (160h22m57.452617658s) [noise=true , address=89.149.201.147:4016 , piece_id=UUNTWX7FB4I7YG2LDN2Y2WP7BHXHZHYKNQROUVFRAMHEKEJQF6VA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649337300 (160h22m57.452801882s) [noise=true , address=185.167.204.205:4027 , piece_id=WTCV2L3SLOFED6725FQ46U3JEO2LE76LH2N4W767PMAFZ4DNGTWA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649489850 (160h22m57.45295445s) [noise=true , address=185.167.204.205:4025 , piece_id=KFG5MK4RB57N2XF4ZLMTAJ7HCCBSJUIGRFQRA3QOFEAHYRRZEUKQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649644940 (160h22m57.453109528s) [noise=true , address=81.171.14.70:4047 , piece_id=O6W5TPWL24YQCYKT7GWQ7T3GA55DIBTFU5HL244L6ZYXYMQQYMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: rpc: dial tcp 81.171.14.70:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649837367 (160h22m57.453301961s) [noise=true , address=89.149.201.147:4022 , piece_id=BLOGBOXX6FBANQXXBUN3BQWRWAH3PC43VZCIDRIXROQM2ZAV7NOA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: rpc: dial tcp 89.149.201.147:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650055408 (160h22m57.453519984s) [noise=true , address=185.167.204.206:4064 , piece_id=MAC6XEQNR2UYDLEDIPXR3VYLH4SR7VEI3RCJ27E24EIMIF4DSSGA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650229995 (160h22m57.453694573s) [noise=true , address=185.167.204.205:4012 , piece_id=X4IQFROU2Y2GCPBFNFIGBIV54LWLFY7UGPZ2YOB34ZZHAEQ3MBEQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650390416 (160h22m57.453855007s) [noise=true , address=89.149.201.147:4021 , piece_id=MAEF5F7L3C47ZSOTPF2Z5PWHXMTYUTFIZ6Z756MONBCQDDAF5BYQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: rpc: dial tcp 89.149.201.147:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650549336 (160h22m57.454013931s) [noise=true , address=185.167.204.205:4011 , piece_id=TTQHENFBPMCI3PZQEKV52IO3OUBDS5ACHCV2K34UHCSQRCQXZRVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650715583 (160h22m57.454180175s) [noise=true , address=185.167.204.205:4008 , piece_id=TG5PNUZMD6HB7AYOWQM6LAJIC4DFSGSWPPOLWD42ZLZQIA7TFOFA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650879777 (160h22m57.454344374s) [noise=true , address=185.167.204.206:4049 , piece_id=JJL2EE4FSKLKYNZIQC4DPZICJBM2V7T6FUIJKNOZVPXY3FCK4GLQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651037802 (160h22m57.454502453s) [noise=true , address=185.167.204.205:4014 , piece_id=MJELQYF2MKIHI6UX2AFF7NTABPPTZ7NYEZN5GQNKOFBBAQ4XOKAA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651306523 (160h22m57.454771119s) [noise=true , address=81.171.14.70:4029 , piece_id=PMDZH27BZU52YWCVRUHLQB7K6CFGWK2UQKVFYMWJZMT53R5T3IVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651476372 (160h22m57.45494095s) [noise=true , address=81.171.14.70:4048 , piece_id=UYAQIALBK6OGIZU7UFRJRWLTSQFMQRJU5A6PKWFF7QQ5VB3H4LXQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651648406 (160h22m57.455113002s) [noise=true , address=89.149.201.147:4003 , piece_id=VCVV5WC5Q7YJFQZ3LTJQZ2WHWF5ISWELC2IPX6NJTCLSCRUF4L6Q, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: rpc: dial tcp 89.149.201.147:4003: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651820843 (160h22m57.455285449s) [noise=true , address=89.149.201.147:4019 , piece_id=JOQH7YYR52QRAXMXC35XHHDHIYU57AGBD4DE4AJROTHXDNY5CMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: rpc: dial tcp 89.149.201.147:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651991651 (160h22m57.455456234s) [noise=true , address=185.167.204.205:4031 , piece_id=YHTTQIWCH2YB7HLEUVV5P2AK5OWRB52KZBKKERQBQPGRD4JSMNOQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 139.59.144.22:36174->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.652019889 (160h22m57.455484483s) [seg_pos={0 0}, upload=141188]: Done waiting for segment. successful: 0 optimal: 26 errs: <nil>
Duration: 940.485791ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................XX...............................] duration:
1.180287127s
FAIL (2025-09-30 06:15:04 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 1.180332797s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........................XXX...............................] duration:
2.878542948s
FAIL (2025-09-30 06:15:00 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.878569122s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
3.372872173s
FAIL (2025-09-30 06:14:26 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.372955225s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................XX..............................] duration:
1.211510872s
FAIL (2025-09-30 06:14:25 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 1.211536528s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
3.047408297s
FAIL (2025-09-30 06:14:10 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.047480239s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........................XXX..............................] duration:
2.753381826s
FAIL (2025-09-30 06:14:01 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.753410508s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [..........................XXX...............................] duration:
891.864189ms
FAIL (2025-09-30 06:13:57 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 26 but got 0)
======LOGS======
[noise=true , address=81.171.14.70:4045 , piece_id=DD53MUKF24OCOLISJNN4F2ESSJSAM6KTBCIHF4UJVOYLKPOLANEA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648490545 (160h22m57.451955126s) [noise=true , address=89.149.201.147:4013 , piece_id=RSPYSYOBACSJ4OKRGV7NQNNQT5ORQJNX4RZVVPHHHM63DYN4KCIQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: rpc: dial tcp 89.149.201.147:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648635402 (160h22m57.452099988s) [noise=true , address=185.167.204.206:4050 , piece_id=DHS3HOFXUBK4BKB5NVZVLDMNI2ZKTP6RVK4KJ2MVL67V47IL2Z3A, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648822212 (160h22m57.452286803s) [noise=true , address=81.171.14.70:4038 , piece_id=T5H2PB2PIPPCGVEDBD4PN5K7VI6TDMKXP6QW242EA6LMFJCAS4OQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: rpc: dial tcp 81.171.14.70:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648970309 (160h22m57.452434895s) [noise=true , address=89.149.201.147:4005 , piece_id=5UJBQPRPDDKVBMIPOZNSE2ZD5TL2KQFP7BNIHXYDW7XFTUCZ4KNA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649153071 (160h22m57.452617658s) [noise=true , address=89.149.201.147:4016 , piece_id=UUNTWX7FB4I7YG2LDN2Y2WP7BHXHZHYKNQROUVFRAMHEKEJQF6VA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649337300 (160h22m57.452801882s) [noise=true , address=185.167.204.205:4027 , piece_id=WTCV2L3SLOFED6725FQ46U3JEO2LE76LH2N4W767PMAFZ4DNGTWA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649489850 (160h22m57.45295445s) [noise=true , address=185.167.204.205:4025 , piece_id=KFG5MK4RB57N2XF4ZLMTAJ7HCCBSJUIGRFQRA3QOFEAHYRRZEUKQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649644940 (160h22m57.453109528s) [noise=true , address=81.171.14.70:4047 , piece_id=O6W5TPWL24YQCYKT7GWQ7T3GA55DIBTFU5HL244L6ZYXYMQQYMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: rpc: dial tcp 81.171.14.70:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649837367 (160h22m57.453301961s) [noise=true , address=89.149.201.147:4022 , piece_id=BLOGBOXX6FBANQXXBUN3BQWRWAH3PC43VZCIDRIXROQM2ZAV7NOA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: rpc: dial tcp 89.149.201.147:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650055408 (160h22m57.453519984s) [noise=true , address=185.167.204.206:4064 , piece_id=MAC6XEQNR2UYDLEDIPXR3VYLH4SR7VEI3RCJ27E24EIMIF4DSSGA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650229995 (160h22m57.453694573s) [noise=true , address=185.167.204.205:4012 , piece_id=X4IQFROU2Y2GCPBFNFIGBIV54LWLFY7UGPZ2YOB34ZZHAEQ3MBEQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650390416 (160h22m57.453855007s) [noise=true , address=89.149.201.147:4021 , piece_id=MAEF5F7L3C47ZSOTPF2Z5PWHXMTYUTFIZ6Z756MONBCQDDAF5BYQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: rpc: dial tcp 89.149.201.147:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650549336 (160h22m57.454013931s) [noise=true , address=185.167.204.205:4011 , piece_id=TTQHENFBPMCI3PZQEKV52IO3OUBDS5ACHCV2K34UHCSQRCQXZRVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650715583 (160h22m57.454180175s) [noise=true , address=185.167.204.205:4008 , piece_id=TG5PNUZMD6HB7AYOWQM6LAJIC4DFSGSWPPOLWD42ZLZQIA7TFOFA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650879777 (160h22m57.454344374s) [noise=true , address=185.167.204.206:4049 , piece_id=JJL2EE4FSKLKYNZIQC4DPZICJBM2V7T6FUIJKNOZVPXY3FCK4GLQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651037802 (160h22m57.454502453s) [noise=true , address=185.167.204.205:4014 , piece_id=MJELQYF2MKIHI6UX2AFF7NTABPPTZ7NYEZN5GQNKOFBBAQ4XOKAA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651306523 (160h22m57.454771119s) [noise=true , address=81.171.14.70:4029 , piece_id=PMDZH27BZU52YWCVRUHLQB7K6CFGWK2UQKVFYMWJZMT53R5T3IVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651476372 (160h22m57.45494095s) [noise=true , address=81.171.14.70:4048 , piece_id=UYAQIALBK6OGIZU7UFRJRWLTSQFMQRJU5A6PKWFF7QQ5VB3H4LXQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651648406 (160h22m57.455113002s) [noise=true , address=89.149.201.147:4003 , piece_id=VCVV5WC5Q7YJFQZ3LTJQZ2WHWF5ISWELC2IPX6NJTCLSCRUF4L6Q, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: rpc: dial tcp 89.149.201.147:4003: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651820843 (160h22m57.455285449s) [noise=true , address=89.149.201.147:4019 , piece_id=JOQH7YYR52QRAXMXC35XHHDHIYU57AGBD4DE4AJROTHXDNY5CMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: rpc: dial tcp 89.149.201.147:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651991651 (160h22m57.455456234s) [noise=true , address=185.167.204.205:4031 , piece_id=YHTTQIWCH2YB7HLEUVV5P2AK5OWRB52KZBKKERQBQPGRD4JSMNOQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 139.59.144.22:36174->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.652019889 (160h22m57.455484483s) [seg_pos={0 0}, upload=141188]: Done waiting for segment. successful: 0 optimal: 26 errs: <nil>
Duration: 891.888655ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................XX.............................] duration:
1.124250784s
FAIL (2025-09-30 06:13:47 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 1.124269164s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [............................XXX.............................] duration:
2.884813127s
FAIL (2025-09-30 06:13:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.884843052s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [...........................XXX..............................] duration:
471.544048ms
FAIL (2025-09-30 06:13:28 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 26 but got 0)
======LOGS======
[noise=true , address=81.171.14.70:4045 , piece_id=DD53MUKF24OCOLISJNN4F2ESSJSAM6KTBCIHF4UJVOYLKPOLANEA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648490545 (160h22m57.451955126s) [noise=true , address=89.149.201.147:4013 , piece_id=RSPYSYOBACSJ4OKRGV7NQNNQT5ORQJNX4RZVVPHHHM63DYN4KCIQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: rpc: dial tcp 89.149.201.147:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648635402 (160h22m57.452099988s) [noise=true , address=185.167.204.206:4050 , piece_id=DHS3HOFXUBK4BKB5NVZVLDMNI2ZKTP6RVK4KJ2MVL67V47IL2Z3A, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648822212 (160h22m57.452286803s) [noise=true , address=81.171.14.70:4038 , piece_id=T5H2PB2PIPPCGVEDBD4PN5K7VI6TDMKXP6QW242EA6LMFJCAS4OQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: rpc: dial tcp 81.171.14.70:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648970309 (160h22m57.452434895s) [noise=true , address=89.149.201.147:4005 , piece_id=5UJBQPRPDDKVBMIPOZNSE2ZD5TL2KQFP7BNIHXYDW7XFTUCZ4KNA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649153071 (160h22m57.452617658s) [noise=true , address=89.149.201.147:4016 , piece_id=UUNTWX7FB4I7YG2LDN2Y2WP7BHXHZHYKNQROUVFRAMHEKEJQF6VA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649337300 (160h22m57.452801882s) [noise=true , address=185.167.204.205:4027 , piece_id=WTCV2L3SLOFED6725FQ46U3JEO2LE76LH2N4W767PMAFZ4DNGTWA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649489850 (160h22m57.45295445s) [noise=true , address=185.167.204.205:4025 , piece_id=KFG5MK4RB57N2XF4ZLMTAJ7HCCBSJUIGRFQRA3QOFEAHYRRZEUKQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649644940 (160h22m57.453109528s) [noise=true , address=81.171.14.70:4047 , piece_id=O6W5TPWL24YQCYKT7GWQ7T3GA55DIBTFU5HL244L6ZYXYMQQYMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: rpc: dial tcp 81.171.14.70:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649837367 (160h22m57.453301961s) [noise=true , address=89.149.201.147:4022 , piece_id=BLOGBOXX6FBANQXXBUN3BQWRWAH3PC43VZCIDRIXROQM2ZAV7NOA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: rpc: dial tcp 89.149.201.147:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650055408 (160h22m57.453519984s) [noise=true , address=185.167.204.206:4064 , piece_id=MAC6XEQNR2UYDLEDIPXR3VYLH4SR7VEI3RCJ27E24EIMIF4DSSGA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650229995 (160h22m57.453694573s) [noise=true , address=185.167.204.205:4012 , piece_id=X4IQFROU2Y2GCPBFNFIGBIV54LWLFY7UGPZ2YOB34ZZHAEQ3MBEQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650390416 (160h22m57.453855007s) [noise=true , address=89.149.201.147:4021 , piece_id=MAEF5F7L3C47ZSOTPF2Z5PWHXMTYUTFIZ6Z756MONBCQDDAF5BYQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: rpc: dial tcp 89.149.201.147:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650549336 (160h22m57.454013931s) [noise=true , address=185.167.204.205:4011 , piece_id=TTQHENFBPMCI3PZQEKV52IO3OUBDS5ACHCV2K34UHCSQRCQXZRVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650715583 (160h22m57.454180175s) [noise=true , address=185.167.204.205:4008 , piece_id=TG5PNUZMD6HB7AYOWQM6LAJIC4DFSGSWPPOLWD42ZLZQIA7TFOFA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650879777 (160h22m57.454344374s) [noise=true , address=185.167.204.206:4049 , piece_id=JJL2EE4FSKLKYNZIQC4DPZICJBM2V7T6FUIJKNOZVPXY3FCK4GLQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651037802 (160h22m57.454502453s) [noise=true , address=185.167.204.205:4014 , piece_id=MJELQYF2MKIHI6UX2AFF7NTABPPTZ7NYEZN5GQNKOFBBAQ4XOKAA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651306523 (160h22m57.454771119s) [noise=true , address=81.171.14.70:4029 , piece_id=PMDZH27BZU52YWCVRUHLQB7K6CFGWK2UQKVFYMWJZMT53R5T3IVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651476372 (160h22m57.45494095s) [noise=true , address=81.171.14.70:4048 , piece_id=UYAQIALBK6OGIZU7UFRJRWLTSQFMQRJU5A6PKWFF7QQ5VB3H4LXQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651648406 (160h22m57.455113002s) [noise=true , address=89.149.201.147:4003 , piece_id=VCVV5WC5Q7YJFQZ3LTJQZ2WHWF5ISWELC2IPX6NJTCLSCRUF4L6Q, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: rpc: dial tcp 89.149.201.147:4003: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651820843 (160h22m57.455285449s) [noise=true , address=89.149.201.147:4019 , piece_id=JOQH7YYR52QRAXMXC35XHHDHIYU57AGBD4DE4AJROTHXDNY5CMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: rpc: dial tcp 89.149.201.147:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651991651 (160h22m57.455456234s) [noise=true , address=185.167.204.205:4031 , piece_id=YHTTQIWCH2YB7HLEUVV5P2AK5OWRB52KZBKKERQBQPGRD4JSMNOQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 139.59.144.22:36174->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.652019889 (160h22m57.455484483s) [seg_pos={0 0}, upload=141188]: Done waiting for segment. successful: 0 optimal: 26 errs: <nil>
Duration: 471.576094ms
core
uplink
eu-select-1
eu1-placement-15
|