Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001249117s
FAIL (2025-09-30 07:40:23 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 185.244.226.3:443: i/o timeout
Duration: 30.001305289s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX] duration:
30.000681204s target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-09-30 07:40:19 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp 185.244.226.3:443: i/o timeout
Duration: 30.000732284s
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
2 out of 60 is failed (threshold=6) [..........................................................XX] duration:
30.00066125s target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-09-30 07:40:18 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": dial tcp 185.244.226.3:443: i/o timeout
Duration: 30.000690581s
edge
linksharing
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.016671112s
FAIL (2025-09-30 07:40:17 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 44)
Duration: 30.016698324s
core
uplink
eu1
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
10.002102464s target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt
FAIL (2025-09-30 07:40:12 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp: lookup link.us-select-1.storjshare.io on 100.100.100.100:53: read udp 100.64.0.132:58475->100.100.100.100:53: i/o timeout
Duration: 10.002197319s
edge
linksharing
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX] duration:
30.00121021s target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-09-30 07:40:06 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp 185.244.226.3:443: i/o timeout
Duration: 30.001245521s
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.201691028s
FAIL (2025-09-30 07:40:02 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 42)
Duration: 30.20172433s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
2 out of 60 is failed (threshold=3) [.........................................................XX.] duration:
106.810337ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
FAIL (2025-09-30 07:40:02 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp 185.244.226.3:443: i/o timeout
Duration: 106.835003ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
11.114345ms target:
https://eu1.storj.io/login
FAIL (2025-09-30 07:40:00 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout
Duration: 11.142304ms
core
satellite
eu1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
553.212339ms
FAIL (2025-09-30 07:40:00 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 185.244.226.3:443: i/o timeout
Duration: 553.245431ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001370791s
FAIL (2025-09-30 07:39:54 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 185.244.226.3:443: i/o timeout
Duration: 30.001399909s
edge
authservice
http
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
1.01976572s
FAIL (2025-09-30 07:39:53 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 1.019866438s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [...........................................................X] duration:
30.001630238s target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-09-30 07:39:48 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": dial tcp 185.244.226.3:443: i/o timeout
Duration: 30.00166712s
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.000521176s target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-09-30 07:39:46 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp 185.244.226.3:443: i/o timeout
Duration: 30.000555391s
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.113304694s
FAIL (2025-09-30 07:39:44 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 42)
Duration: 30.113332035s
core
uplink
us1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [...........................................................X] duration:
30.001233998s target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt
FAIL (2025-09-30 07:39:40 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": dial tcp 185.244.226.3:443: i/o timeout
Duration: 30.00126123s
edge
linksharing
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.000523358s target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
FAIL (2025-09-30 07:39:32 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp 185.244.226.3:443: i/o timeout
Duration: 30.000563892s
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.00042709s target:
https://eu1.storj.io/login
FAIL (2025-09-30 07:39:32 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout
Duration: 30.000460294s
core
satellite
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001012185s target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-09-30 07:39:21 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp 185.244.226.3:443: i/o timeout
Duration: 30.001057854s
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001154377s
FAIL (2025-09-30 07:39:19 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 30.001200919s
core
uplink
eu1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
1.156363886s
FAIL (2025-09-30 06:37:15 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 1.15639789s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.705559931s
FAIL (2025-09-30 06:36:26 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.70560451s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.811941979s
FAIL (2025-09-30 06:36:10 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.811983627s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................] duration:
1.12042829s
FAIL (2025-09-30 06:36:02 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 1.120542249s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
672.482565ms
FAIL (2025-09-30 06:35:45 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 26 but got 0)
======LOGS======
[noise=true , address=81.171.14.70:4045 , piece_id=DD53MUKF24OCOLISJNN4F2ESSJSAM6KTBCIHF4UJVOYLKPOLANEA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648490545 (160h22m57.451955126s) [noise=true , address=89.149.201.147:4013 , piece_id=RSPYSYOBACSJ4OKRGV7NQNNQT5ORQJNX4RZVVPHHHM63DYN4KCIQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: rpc: dial tcp 89.149.201.147:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648635402 (160h22m57.452099988s) [noise=true , address=185.167.204.206:4050 , piece_id=DHS3HOFXUBK4BKB5NVZVLDMNI2ZKTP6RVK4KJ2MVL67V47IL2Z3A, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648822212 (160h22m57.452286803s) [noise=true , address=81.171.14.70:4038 , piece_id=T5H2PB2PIPPCGVEDBD4PN5K7VI6TDMKXP6QW242EA6LMFJCAS4OQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: rpc: dial tcp 81.171.14.70:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648970309 (160h22m57.452434895s) [noise=true , address=89.149.201.147:4005 , piece_id=5UJBQPRPDDKVBMIPOZNSE2ZD5TL2KQFP7BNIHXYDW7XFTUCZ4KNA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649153071 (160h22m57.452617658s) [noise=true , address=89.149.201.147:4016 , piece_id=UUNTWX7FB4I7YG2LDN2Y2WP7BHXHZHYKNQROUVFRAMHEKEJQF6VA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649337300 (160h22m57.452801882s) [noise=true , address=185.167.204.205:4027 , piece_id=WTCV2L3SLOFED6725FQ46U3JEO2LE76LH2N4W767PMAFZ4DNGTWA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649489850 (160h22m57.45295445s) [noise=true , address=185.167.204.205:4025 , piece_id=KFG5MK4RB57N2XF4ZLMTAJ7HCCBSJUIGRFQRA3QOFEAHYRRZEUKQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649644940 (160h22m57.453109528s) [noise=true , address=81.171.14.70:4047 , piece_id=O6W5TPWL24YQCYKT7GWQ7T3GA55DIBTFU5HL244L6ZYXYMQQYMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: rpc: dial tcp 81.171.14.70:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649837367 (160h22m57.453301961s) [noise=true , address=89.149.201.147:4022 , piece_id=BLOGBOXX6FBANQXXBUN3BQWRWAH3PC43VZCIDRIXROQM2ZAV7NOA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: rpc: dial tcp 89.149.201.147:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650055408 (160h22m57.453519984s) [noise=true , address=185.167.204.206:4064 , piece_id=MAC6XEQNR2UYDLEDIPXR3VYLH4SR7VEI3RCJ27E24EIMIF4DSSGA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650229995 (160h22m57.453694573s) [noise=true , address=185.167.204.205:4012 , piece_id=X4IQFROU2Y2GCPBFNFIGBIV54LWLFY7UGPZ2YOB34ZZHAEQ3MBEQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650390416 (160h22m57.453855007s) [noise=true , address=89.149.201.147:4021 , piece_id=MAEF5F7L3C47ZSOTPF2Z5PWHXMTYUTFIZ6Z756MONBCQDDAF5BYQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: rpc: dial tcp 89.149.201.147:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650549336 (160h22m57.454013931s) [noise=true , address=185.167.204.205:4011 , piece_id=TTQHENFBPMCI3PZQEKV52IO3OUBDS5ACHCV2K34UHCSQRCQXZRVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650715583 (160h22m57.454180175s) [noise=true , address=185.167.204.205:4008 , piece_id=TG5PNUZMD6HB7AYOWQM6LAJIC4DFSGSWPPOLWD42ZLZQIA7TFOFA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650879777 (160h22m57.454344374s) [noise=true , address=185.167.204.206:4049 , piece_id=JJL2EE4FSKLKYNZIQC4DPZICJBM2V7T6FUIJKNOZVPXY3FCK4GLQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651037802 (160h22m57.454502453s) [noise=true , address=185.167.204.205:4014 , piece_id=MJELQYF2MKIHI6UX2AFF7NTABPPTZ7NYEZN5GQNKOFBBAQ4XOKAA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651306523 (160h22m57.454771119s) [noise=true , address=81.171.14.70:4029 , piece_id=PMDZH27BZU52YWCVRUHLQB7K6CFGWK2UQKVFYMWJZMT53R5T3IVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651476372 (160h22m57.45494095s) [noise=true , address=81.171.14.70:4048 , piece_id=UYAQIALBK6OGIZU7UFRJRWLTSQFMQRJU5A6PKWFF7QQ5VB3H4LXQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651648406 (160h22m57.455113002s) [noise=true , address=89.149.201.147:4003 , piece_id=VCVV5WC5Q7YJFQZ3LTJQZ2WHWF5ISWELC2IPX6NJTCLSCRUF4L6Q, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: rpc: dial tcp 89.149.201.147:4003: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651820843 (160h22m57.455285449s) [noise=true , address=89.149.201.147:4019 , piece_id=JOQH7YYR52QRAXMXC35XHHDHIYU57AGBD4DE4AJROTHXDNY5CMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: rpc: dial tcp 89.149.201.147:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651991651 (160h22m57.455456234s) [noise=true , address=185.167.204.205:4031 , piece_id=YHTTQIWCH2YB7HLEUVV5P2AK5OWRB52KZBKKERQBQPGRD4JSMNOQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 139.59.144.22:36174->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.652019889 (160h22m57.455484483s) [seg_pos={0 0}, upload=141188]: Done waiting for segment. successful: 0 optimal: 26 errs: <nil>
Duration: 672.520124ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................] duration:
2.558391666s
FAIL (2025-09-30 06:35:26 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.55841825s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.828468195s
FAIL (2025-09-30 06:35:23 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.828838081s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................] duration:
894.10203ms
FAIL (2025-09-30 06:35:12 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 26 but got 0)
======LOGS======
[noise=true , address=81.171.14.70:4045 , piece_id=DD53MUKF24OCOLISJNN4F2ESSJSAM6KTBCIHF4UJVOYLKPOLANEA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648490545 (160h22m57.451955126s) [noise=true , address=89.149.201.147:4013 , piece_id=RSPYSYOBACSJ4OKRGV7NQNNQT5ORQJNX4RZVVPHHHM63DYN4KCIQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: rpc: dial tcp 89.149.201.147:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648635402 (160h22m57.452099988s) [noise=true , address=185.167.204.206:4050 , piece_id=DHS3HOFXUBK4BKB5NVZVLDMNI2ZKTP6RVK4KJ2MVL67V47IL2Z3A, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648822212 (160h22m57.452286803s) [noise=true , address=81.171.14.70:4038 , piece_id=T5H2PB2PIPPCGVEDBD4PN5K7VI6TDMKXP6QW242EA6LMFJCAS4OQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: rpc: dial tcp 81.171.14.70:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648970309 (160h22m57.452434895s) [noise=true , address=89.149.201.147:4005 , piece_id=5UJBQPRPDDKVBMIPOZNSE2ZD5TL2KQFP7BNIHXYDW7XFTUCZ4KNA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649153071 (160h22m57.452617658s) [noise=true , address=89.149.201.147:4016 , piece_id=UUNTWX7FB4I7YG2LDN2Y2WP7BHXHZHYKNQROUVFRAMHEKEJQF6VA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649337300 (160h22m57.452801882s) [noise=true , address=185.167.204.205:4027 , piece_id=WTCV2L3SLOFED6725FQ46U3JEO2LE76LH2N4W767PMAFZ4DNGTWA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649489850 (160h22m57.45295445s) [noise=true , address=185.167.204.205:4025 , piece_id=KFG5MK4RB57N2XF4ZLMTAJ7HCCBSJUIGRFQRA3QOFEAHYRRZEUKQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649644940 (160h22m57.453109528s) [noise=true , address=81.171.14.70:4047 , piece_id=O6W5TPWL24YQCYKT7GWQ7T3GA55DIBTFU5HL244L6ZYXYMQQYMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: rpc: dial tcp 81.171.14.70:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649837367 (160h22m57.453301961s) [noise=true , address=89.149.201.147:4022 , piece_id=BLOGBOXX6FBANQXXBUN3BQWRWAH3PC43VZCIDRIXROQM2ZAV7NOA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: rpc: dial tcp 89.149.201.147:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650055408 (160h22m57.453519984s) [noise=true , address=185.167.204.206:4064 , piece_id=MAC6XEQNR2UYDLEDIPXR3VYLH4SR7VEI3RCJ27E24EIMIF4DSSGA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650229995 (160h22m57.453694573s) [noise=true , address=185.167.204.205:4012 , piece_id=X4IQFROU2Y2GCPBFNFIGBIV54LWLFY7UGPZ2YOB34ZZHAEQ3MBEQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650390416 (160h22m57.453855007s) [noise=true , address=89.149.201.147:4021 , piece_id=MAEF5F7L3C47ZSOTPF2Z5PWHXMTYUTFIZ6Z756MONBCQDDAF5BYQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: rpc: dial tcp 89.149.201.147:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650549336 (160h22m57.454013931s) [noise=true , address=185.167.204.205:4011 , piece_id=TTQHENFBPMCI3PZQEKV52IO3OUBDS5ACHCV2K34UHCSQRCQXZRVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650715583 (160h22m57.454180175s) [noise=true , address=185.167.204.205:4008 , piece_id=TG5PNUZMD6HB7AYOWQM6LAJIC4DFSGSWPPOLWD42ZLZQIA7TFOFA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650879777 (160h22m57.454344374s) [noise=true , address=185.167.204.206:4049 , piece_id=JJL2EE4FSKLKYNZIQC4DPZICJBM2V7T6FUIJKNOZVPXY3FCK4GLQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651037802 (160h22m57.454502453s) [noise=true , address=185.167.204.205:4014 , piece_id=MJELQYF2MKIHI6UX2AFF7NTABPPTZ7NYEZN5GQNKOFBBAQ4XOKAA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651306523 (160h22m57.454771119s) [noise=true , address=81.171.14.70:4029 , piece_id=PMDZH27BZU52YWCVRUHLQB7K6CFGWK2UQKVFYMWJZMT53R5T3IVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651476372 (160h22m57.45494095s) [noise=true , address=81.171.14.70:4048 , piece_id=UYAQIALBK6OGIZU7UFRJRWLTSQFMQRJU5A6PKWFF7QQ5VB3H4LXQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651648406 (160h22m57.455113002s) [noise=true , address=89.149.201.147:4003 , piece_id=VCVV5WC5Q7YJFQZ3LTJQZ2WHWF5ISWELC2IPX6NJTCLSCRUF4L6Q, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: rpc: dial tcp 89.149.201.147:4003: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651820843 (160h22m57.455285449s) [noise=true , address=89.149.201.147:4019 , piece_id=JOQH7YYR52QRAXMXC35XHHDHIYU57AGBD4DE4AJROTHXDNY5CMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: rpc: dial tcp 89.149.201.147:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651991651 (160h22m57.455456234s) [noise=true , address=185.167.204.205:4031 , piece_id=YHTTQIWCH2YB7HLEUVV5P2AK5OWRB52KZBKKERQBQPGRD4JSMNOQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 139.59.144.22:36174->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.652019889 (160h22m57.455484483s) [seg_pos={0 0}, upload=141188]: Done waiting for segment. successful: 0 optimal: 26 errs: <nil>
Duration: 894.141512ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.XX.........................................................] duration:
1.235256471s
FAIL (2025-09-30 06:34:55 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 1.235372768s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [XXX.........................................................] duration:
2.950904707s
FAIL (2025-09-30 06:34:50 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.950931827s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [XXX.........................................................] duration:
843.370263ms
FAIL (2025-09-30 06:34:36 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 26 but got 0)
======LOGS======
[noise=true , address=81.171.14.70:4045 , piece_id=DD53MUKF24OCOLISJNN4F2ESSJSAM6KTBCIHF4UJVOYLKPOLANEA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648490545 (160h22m57.451955126s) [noise=true , address=89.149.201.147:4013 , piece_id=RSPYSYOBACSJ4OKRGV7NQNNQT5ORQJNX4RZVVPHHHM63DYN4KCIQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: rpc: dial tcp 89.149.201.147:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648635402 (160h22m57.452099988s) [noise=true , address=185.167.204.206:4050 , piece_id=DHS3HOFXUBK4BKB5NVZVLDMNI2ZKTP6RVK4KJ2MVL67V47IL2Z3A, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648822212 (160h22m57.452286803s) [noise=true , address=81.171.14.70:4038 , piece_id=T5H2PB2PIPPCGVEDBD4PN5K7VI6TDMKXP6QW242EA6LMFJCAS4OQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: rpc: dial tcp 81.171.14.70:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648970309 (160h22m57.452434895s) [noise=true , address=89.149.201.147:4005 , piece_id=5UJBQPRPDDKVBMIPOZNSE2ZD5TL2KQFP7BNIHXYDW7XFTUCZ4KNA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649153071 (160h22m57.452617658s) [noise=true , address=89.149.201.147:4016 , piece_id=UUNTWX7FB4I7YG2LDN2Y2WP7BHXHZHYKNQROUVFRAMHEKEJQF6VA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649337300 (160h22m57.452801882s) [noise=true , address=185.167.204.205:4027 , piece_id=WTCV2L3SLOFED6725FQ46U3JEO2LE76LH2N4W767PMAFZ4DNGTWA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649489850 (160h22m57.45295445s) [noise=true , address=185.167.204.205:4025 , piece_id=KFG5MK4RB57N2XF4ZLMTAJ7HCCBSJUIGRFQRA3QOFEAHYRRZEUKQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649644940 (160h22m57.453109528s) [noise=true , address=81.171.14.70:4047 , piece_id=O6W5TPWL24YQCYKT7GWQ7T3GA55DIBTFU5HL244L6ZYXYMQQYMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: rpc: dial tcp 81.171.14.70:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649837367 (160h22m57.453301961s) [noise=true , address=89.149.201.147:4022 , piece_id=BLOGBOXX6FBANQXXBUN3BQWRWAH3PC43VZCIDRIXROQM2ZAV7NOA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: rpc: dial tcp 89.149.201.147:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650055408 (160h22m57.453519984s) [noise=true , address=185.167.204.206:4064 , piece_id=MAC6XEQNR2UYDLEDIPXR3VYLH4SR7VEI3RCJ27E24EIMIF4DSSGA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650229995 (160h22m57.453694573s) [noise=true , address=185.167.204.205:4012 , piece_id=X4IQFROU2Y2GCPBFNFIGBIV54LWLFY7UGPZ2YOB34ZZHAEQ3MBEQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650390416 (160h22m57.453855007s) [noise=true , address=89.149.201.147:4021 , piece_id=MAEF5F7L3C47ZSOTPF2Z5PWHXMTYUTFIZ6Z756MONBCQDDAF5BYQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: rpc: dial tcp 89.149.201.147:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650549336 (160h22m57.454013931s) [noise=true , address=185.167.204.205:4011 , piece_id=TTQHENFBPMCI3PZQEKV52IO3OUBDS5ACHCV2K34UHCSQRCQXZRVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650715583 (160h22m57.454180175s) [noise=true , address=185.167.204.205:4008 , piece_id=TG5PNUZMD6HB7AYOWQM6LAJIC4DFSGSWPPOLWD42ZLZQIA7TFOFA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650879777 (160h22m57.454344374s) [noise=true , address=185.167.204.206:4049 , piece_id=JJL2EE4FSKLKYNZIQC4DPZICJBM2V7T6FUIJKNOZVPXY3FCK4GLQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651037802 (160h22m57.454502453s) [noise=true , address=185.167.204.205:4014 , piece_id=MJELQYF2MKIHI6UX2AFF7NTABPPTZ7NYEZN5GQNKOFBBAQ4XOKAA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651306523 (160h22m57.454771119s) [noise=true , address=81.171.14.70:4029 , piece_id=PMDZH27BZU52YWCVRUHLQB7K6CFGWK2UQKVFYMWJZMT53R5T3IVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651476372 (160h22m57.45494095s) [noise=true , address=81.171.14.70:4048 , piece_id=UYAQIALBK6OGIZU7UFRJRWLTSQFMQRJU5A6PKWFF7QQ5VB3H4LXQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651648406 (160h22m57.455113002s) [noise=true , address=89.149.201.147:4003 , piece_id=VCVV5WC5Q7YJFQZ3LTJQZ2WHWF5ISWELC2IPX6NJTCLSCRUF4L6Q, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: rpc: dial tcp 89.149.201.147:4003: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651820843 (160h22m57.455285449s) [noise=true , address=89.149.201.147:4019 , piece_id=JOQH7YYR52QRAXMXC35XHHDHIYU57AGBD4DE4AJROTHXDNY5CMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: rpc: dial tcp 89.149.201.147:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651991651 (160h22m57.455456234s) [noise=true , address=185.167.204.205:4031 , piece_id=YHTTQIWCH2YB7HLEUVV5P2AK5OWRB52KZBKKERQBQPGRD4JSMNOQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 139.59.144.22:36174->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.652019889 (160h22m57.455484483s) [seg_pos={0 0}, upload=141188]: Done waiting for segment. successful: 0 optimal: 26 errs: <nil>
Duration: 843.407433ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.808841397s
FAIL (2025-09-30 06:34:23 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.808923142s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..XX........................................................] duration:
1.32425541s
FAIL (2025-09-30 06:34:21 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 1.324293704s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.XXX........................................................] duration:
439.736485ms
FAIL (2025-09-30 06:34:04 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 26 but got 0)
======LOGS======
[noise=true , address=81.171.14.70:4045 , piece_id=DD53MUKF24OCOLISJNN4F2ESSJSAM6KTBCIHF4UJVOYLKPOLANEA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648490545 (160h22m57.451955126s) [noise=true , address=89.149.201.147:4013 , piece_id=RSPYSYOBACSJ4OKRGV7NQNNQT5ORQJNX4RZVVPHHHM63DYN4KCIQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: rpc: dial tcp 89.149.201.147:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648635402 (160h22m57.452099988s) [noise=true , address=185.167.204.206:4050 , piece_id=DHS3HOFXUBK4BKB5NVZVLDMNI2ZKTP6RVK4KJ2MVL67V47IL2Z3A, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648822212 (160h22m57.452286803s) [noise=true , address=81.171.14.70:4038 , piece_id=T5H2PB2PIPPCGVEDBD4PN5K7VI6TDMKXP6QW242EA6LMFJCAS4OQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: rpc: dial tcp 81.171.14.70:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648970309 (160h22m57.452434895s) [noise=true , address=89.149.201.147:4005 , piece_id=5UJBQPRPDDKVBMIPOZNSE2ZD5TL2KQFP7BNIHXYDW7XFTUCZ4KNA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649153071 (160h22m57.452617658s) [noise=true , address=89.149.201.147:4016 , piece_id=UUNTWX7FB4I7YG2LDN2Y2WP7BHXHZHYKNQROUVFRAMHEKEJQF6VA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649337300 (160h22m57.452801882s) [noise=true , address=185.167.204.205:4027 , piece_id=WTCV2L3SLOFED6725FQ46U3JEO2LE76LH2N4W767PMAFZ4DNGTWA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649489850 (160h22m57.45295445s) [noise=true , address=185.167.204.205:4025 , piece_id=KFG5MK4RB57N2XF4ZLMTAJ7HCCBSJUIGRFQRA3QOFEAHYRRZEUKQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649644940 (160h22m57.453109528s) [noise=true , address=81.171.14.70:4047 , piece_id=O6W5TPWL24YQCYKT7GWQ7T3GA55DIBTFU5HL244L6ZYXYMQQYMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: rpc: dial tcp 81.171.14.70:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649837367 (160h22m57.453301961s) [noise=true , address=89.149.201.147:4022 , piece_id=BLOGBOXX6FBANQXXBUN3BQWRWAH3PC43VZCIDRIXROQM2ZAV7NOA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: rpc: dial tcp 89.149.201.147:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650055408 (160h22m57.453519984s) [noise=true , address=185.167.204.206:4064 , piece_id=MAC6XEQNR2UYDLEDIPXR3VYLH4SR7VEI3RCJ27E24EIMIF4DSSGA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650229995 (160h22m57.453694573s) [noise=true , address=185.167.204.205:4012 , piece_id=X4IQFROU2Y2GCPBFNFIGBIV54LWLFY7UGPZ2YOB34ZZHAEQ3MBEQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650390416 (160h22m57.453855007s) [noise=true , address=89.149.201.147:4021 , piece_id=MAEF5F7L3C47ZSOTPF2Z5PWHXMTYUTFIZ6Z756MONBCQDDAF5BYQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: rpc: dial tcp 89.149.201.147:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650549336 (160h22m57.454013931s) [noise=true , address=185.167.204.205:4011 , piece_id=TTQHENFBPMCI3PZQEKV52IO3OUBDS5ACHCV2K34UHCSQRCQXZRVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650715583 (160h22m57.454180175s) [noise=true , address=185.167.204.205:4008 , piece_id=TG5PNUZMD6HB7AYOWQM6LAJIC4DFSGSWPPOLWD42ZLZQIA7TFOFA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650879777 (160h22m57.454344374s) [noise=true , address=185.167.204.206:4049 , piece_id=JJL2EE4FSKLKYNZIQC4DPZICJBM2V7T6FUIJKNOZVPXY3FCK4GLQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651037802 (160h22m57.454502453s) [noise=true , address=185.167.204.205:4014 , piece_id=MJELQYF2MKIHI6UX2AFF7NTABPPTZ7NYEZN5GQNKOFBBAQ4XOKAA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651306523 (160h22m57.454771119s) [noise=true , address=81.171.14.70:4029 , piece_id=PMDZH27BZU52YWCVRUHLQB7K6CFGWK2UQKVFYMWJZMT53R5T3IVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651476372 (160h22m57.45494095s) [noise=true , address=81.171.14.70:4048 , piece_id=UYAQIALBK6OGIZU7UFRJRWLTSQFMQRJU5A6PKWFF7QQ5VB3H4LXQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651648406 (160h22m57.455113002s) [noise=true , address=89.149.201.147:4003 , piece_id=VCVV5WC5Q7YJFQZ3LTJQZ2WHWF5ISWELC2IPX6NJTCLSCRUF4L6Q, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: rpc: dial tcp 89.149.201.147:4003: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651820843 (160h22m57.455285449s) [noise=true , address=89.149.201.147:4019 , piece_id=JOQH7YYR52QRAXMXC35XHHDHIYU57AGBD4DE4AJROTHXDNY5CMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: rpc: dial tcp 89.149.201.147:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651991651 (160h22m57.455456234s) [noise=true , address=185.167.204.205:4031 , piece_id=YHTTQIWCH2YB7HLEUVV5P2AK5OWRB52KZBKKERQBQPGRD4JSMNOQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 139.59.144.22:36174->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.652019889 (160h22m57.455484483s) [seg_pos={0 0}, upload=141188]: Done waiting for segment. successful: 0 optimal: 26 errs: <nil>
Duration: 439.768619ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.XXX........................................................] duration:
2.881156236s
FAIL (2025-09-30 06:34:04 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.881182314s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [..XXX.......................................................] duration:
445.55255ms
FAIL (2025-09-30 06:33:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 26 but got 0)
======LOGS======
[noise=true , address=81.171.14.70:4045 , piece_id=DD53MUKF24OCOLISJNN4F2ESSJSAM6KTBCIHF4UJVOYLKPOLANEA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648490545 (160h22m57.451955126s) [noise=true , address=89.149.201.147:4013 , piece_id=RSPYSYOBACSJ4OKRGV7NQNNQT5ORQJNX4RZVVPHHHM63DYN4KCIQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: rpc: dial tcp 89.149.201.147:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648635402 (160h22m57.452099988s) [noise=true , address=185.167.204.206:4050 , piece_id=DHS3HOFXUBK4BKB5NVZVLDMNI2ZKTP6RVK4KJ2MVL67V47IL2Z3A, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648822212 (160h22m57.452286803s) [noise=true , address=81.171.14.70:4038 , piece_id=T5H2PB2PIPPCGVEDBD4PN5K7VI6TDMKXP6QW242EA6LMFJCAS4OQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: rpc: dial tcp 81.171.14.70:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648970309 (160h22m57.452434895s) [noise=true , address=89.149.201.147:4005 , piece_id=5UJBQPRPDDKVBMIPOZNSE2ZD5TL2KQFP7BNIHXYDW7XFTUCZ4KNA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649153071 (160h22m57.452617658s) [noise=true , address=89.149.201.147:4016 , piece_id=UUNTWX7FB4I7YG2LDN2Y2WP7BHXHZHYKNQROUVFRAMHEKEJQF6VA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649337300 (160h22m57.452801882s) [noise=true , address=185.167.204.205:4027 , piece_id=WTCV2L3SLOFED6725FQ46U3JEO2LE76LH2N4W767PMAFZ4DNGTWA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649489850 (160h22m57.45295445s) [noise=true , address=185.167.204.205:4025 , piece_id=KFG5MK4RB57N2XF4ZLMTAJ7HCCBSJUIGRFQRA3QOFEAHYRRZEUKQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649644940 (160h22m57.453109528s) [noise=true , address=81.171.14.70:4047 , piece_id=O6W5TPWL24YQCYKT7GWQ7T3GA55DIBTFU5HL244L6ZYXYMQQYMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: rpc: dial tcp 81.171.14.70:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649837367 (160h22m57.453301961s) [noise=true , address=89.149.201.147:4022 , piece_id=BLOGBOXX6FBANQXXBUN3BQWRWAH3PC43VZCIDRIXROQM2ZAV7NOA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: rpc: dial tcp 89.149.201.147:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650055408 (160h22m57.453519984s) [noise=true , address=185.167.204.206:4064 , piece_id=MAC6XEQNR2UYDLEDIPXR3VYLH4SR7VEI3RCJ27E24EIMIF4DSSGA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650229995 (160h22m57.453694573s) [noise=true , address=185.167.204.205:4012 , piece_id=X4IQFROU2Y2GCPBFNFIGBIV54LWLFY7UGPZ2YOB34ZZHAEQ3MBEQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650390416 (160h22m57.453855007s) [noise=true , address=89.149.201.147:4021 , piece_id=MAEF5F7L3C47ZSOTPF2Z5PWHXMTYUTFIZ6Z756MONBCQDDAF5BYQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: rpc: dial tcp 89.149.201.147:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650549336 (160h22m57.454013931s) [noise=true , address=185.167.204.205:4011 , piece_id=TTQHENFBPMCI3PZQEKV52IO3OUBDS5ACHCV2K34UHCSQRCQXZRVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650715583 (160h22m57.454180175s) [noise=true , address=185.167.204.205:4008 , piece_id=TG5PNUZMD6HB7AYOWQM6LAJIC4DFSGSWPPOLWD42ZLZQIA7TFOFA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650879777 (160h22m57.454344374s) [noise=true , address=185.167.204.206:4049 , piece_id=JJL2EE4FSKLKYNZIQC4DPZICJBM2V7T6FUIJKNOZVPXY3FCK4GLQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651037802 (160h22m57.454502453s) [noise=true , address=185.167.204.205:4014 , piece_id=MJELQYF2MKIHI6UX2AFF7NTABPPTZ7NYEZN5GQNKOFBBAQ4XOKAA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651306523 (160h22m57.454771119s) [noise=true , address=81.171.14.70:4029 , piece_id=PMDZH27BZU52YWCVRUHLQB7K6CFGWK2UQKVFYMWJZMT53R5T3IVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651476372 (160h22m57.45494095s) [noise=true , address=81.171.14.70:4048 , piece_id=UYAQIALBK6OGIZU7UFRJRWLTSQFMQRJU5A6PKWFF7QQ5VB3H4LXQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651648406 (160h22m57.455113002s) [noise=true , address=89.149.201.147:4003 , piece_id=VCVV5WC5Q7YJFQZ3LTJQZ2WHWF5ISWELC2IPX6NJTCLSCRUF4L6Q, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: rpc: dial tcp 89.149.201.147:4003: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651820843 (160h22m57.455285449s) [noise=true , address=89.149.201.147:4019 , piece_id=JOQH7YYR52QRAXMXC35XHHDHIYU57AGBD4DE4AJROTHXDNY5CMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: rpc: dial tcp 89.149.201.147:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651991651 (160h22m57.455456234s) [noise=true , address=185.167.204.205:4031 , piece_id=YHTTQIWCH2YB7HLEUVV5P2AK5OWRB52KZBKKERQBQPGRD4JSMNOQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 139.59.144.22:36174->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.652019889 (160h22m57.455484483s) [seg_pos={0 0}, upload=141188]: Done waiting for segment. successful: 0 optimal: 26 errs: <nil>
Duration: 445.578206ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [..XXX.......................................................] duration:
2.65034978s
FAIL (2025-09-30 06:33:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.650388148s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [...XX.......................................................] duration:
1.124478562s
FAIL (2025-09-30 06:33:23 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 1.124577302s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.845614788s
FAIL (2025-09-30 06:33:10 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.845644684s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [...XXX......................................................] duration:
922.511941ms
FAIL (2025-09-30 06:33:06 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 26 but got 0)
======LOGS======
[noise=true , address=81.171.14.70:4045 , piece_id=DD53MUKF24OCOLISJNN4F2ESSJSAM6KTBCIHF4UJVOYLKPOLANEA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648490545 (160h22m57.451955126s) [noise=true , address=89.149.201.147:4013 , piece_id=RSPYSYOBACSJ4OKRGV7NQNNQT5ORQJNX4RZVVPHHHM63DYN4KCIQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: rpc: dial tcp 89.149.201.147:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648635402 (160h22m57.452099988s) [noise=true , address=185.167.204.206:4050 , piece_id=DHS3HOFXUBK4BKB5NVZVLDMNI2ZKTP6RVK4KJ2MVL67V47IL2Z3A, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648822212 (160h22m57.452286803s) [noise=true , address=81.171.14.70:4038 , piece_id=T5H2PB2PIPPCGVEDBD4PN5K7VI6TDMKXP6QW242EA6LMFJCAS4OQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: rpc: dial tcp 81.171.14.70:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648970309 (160h22m57.452434895s) [noise=true , address=89.149.201.147:4005 , piece_id=5UJBQPRPDDKVBMIPOZNSE2ZD5TL2KQFP7BNIHXYDW7XFTUCZ4KNA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649153071 (160h22m57.452617658s) [noise=true , address=89.149.201.147:4016 , piece_id=UUNTWX7FB4I7YG2LDN2Y2WP7BHXHZHYKNQROUVFRAMHEKEJQF6VA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649337300 (160h22m57.452801882s) [noise=true , address=185.167.204.205:4027 , piece_id=WTCV2L3SLOFED6725FQ46U3JEO2LE76LH2N4W767PMAFZ4DNGTWA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649489850 (160h22m57.45295445s) [noise=true , address=185.167.204.205:4025 , piece_id=KFG5MK4RB57N2XF4ZLMTAJ7HCCBSJUIGRFQRA3QOFEAHYRRZEUKQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649644940 (160h22m57.453109528s) [noise=true , address=81.171.14.70:4047 , piece_id=O6W5TPWL24YQCYKT7GWQ7T3GA55DIBTFU5HL244L6ZYXYMQQYMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: rpc: dial tcp 81.171.14.70:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649837367 (160h22m57.453301961s) [noise=true , address=89.149.201.147:4022 , piece_id=BLOGBOXX6FBANQXXBUN3BQWRWAH3PC43VZCIDRIXROQM2ZAV7NOA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: rpc: dial tcp 89.149.201.147:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650055408 (160h22m57.453519984s) [noise=true , address=185.167.204.206:4064 , piece_id=MAC6XEQNR2UYDLEDIPXR3VYLH4SR7VEI3RCJ27E24EIMIF4DSSGA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650229995 (160h22m57.453694573s) [noise=true , address=185.167.204.205:4012 , piece_id=X4IQFROU2Y2GCPBFNFIGBIV54LWLFY7UGPZ2YOB34ZZHAEQ3MBEQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650390416 (160h22m57.453855007s) [noise=true , address=89.149.201.147:4021 , piece_id=MAEF5F7L3C47ZSOTPF2Z5PWHXMTYUTFIZ6Z756MONBCQDDAF5BYQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: rpc: dial tcp 89.149.201.147:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650549336 (160h22m57.454013931s) [noise=true , address=185.167.204.205:4011 , piece_id=TTQHENFBPMCI3PZQEKV52IO3OUBDS5ACHCV2K34UHCSQRCQXZRVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650715583 (160h22m57.454180175s) [noise=true , address=185.167.204.205:4008 , piece_id=TG5PNUZMD6HB7AYOWQM6LAJIC4DFSGSWPPOLWD42ZLZQIA7TFOFA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650879777 (160h22m57.454344374s) [noise=true , address=185.167.204.206:4049 , piece_id=JJL2EE4FSKLKYNZIQC4DPZICJBM2V7T6FUIJKNOZVPXY3FCK4GLQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651037802 (160h22m57.454502453s) [noise=true , address=185.167.204.205:4014 , piece_id=MJELQYF2MKIHI6UX2AFF7NTABPPTZ7NYEZN5GQNKOFBBAQ4XOKAA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651306523 (160h22m57.454771119s) [noise=true , address=81.171.14.70:4029 , piece_id=PMDZH27BZU52YWCVRUHLQB7K6CFGWK2UQKVFYMWJZMT53R5T3IVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651476372 (160h22m57.45494095s) [noise=true , address=81.171.14.70:4048 , piece_id=UYAQIALBK6OGIZU7UFRJRWLTSQFMQRJU5A6PKWFF7QQ5VB3H4LXQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651648406 (160h22m57.455113002s) [noise=true , address=89.149.201.147:4003 , piece_id=VCVV5WC5Q7YJFQZ3LTJQZ2WHWF5ISWELC2IPX6NJTCLSCRUF4L6Q, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: rpc: dial tcp 89.149.201.147:4003: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651820843 (160h22m57.455285449s) [noise=true , address=89.149.201.147:4019 , piece_id=JOQH7YYR52QRAXMXC35XHHDHIYU57AGBD4DE4AJROTHXDNY5CMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: rpc: dial tcp 89.149.201.147:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651991651 (160h22m57.455456234s) [noise=true , address=185.167.204.205:4031 , piece_id=YHTTQIWCH2YB7HLEUVV5P2AK5OWRB52KZBKKERQBQPGRD4JSMNOQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 139.59.144.22:36174->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.652019889 (160h22m57.455484483s) [seg_pos={0 0}, upload=141188]: Done waiting for segment. successful: 0 optimal: 26 errs: <nil>
Duration: 922.552302ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [...XXX......................................................] duration:
2.828153792s
FAIL (2025-09-30 06:33:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.82827834s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.835437535s
FAIL (2025-09-30 06:32:16 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.835456347s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [....XX......................................................] duration:
1.143867782s
FAIL (2025-09-30 06:32:12 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 1.143893105s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [....XXX.....................................................] duration:
975.9737ms
FAIL (2025-09-30 06:32:10 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 26 but got 0)
======LOGS======
[noise=true , address=81.171.14.70:4045 , piece_id=DD53MUKF24OCOLISJNN4F2ESSJSAM6KTBCIHF4UJVOYLKPOLANEA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648490545 (160h22m57.451955126s) [noise=true , address=89.149.201.147:4013 , piece_id=RSPYSYOBACSJ4OKRGV7NQNNQT5ORQJNX4RZVVPHHHM63DYN4KCIQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: rpc: dial tcp 89.149.201.147:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648635402 (160h22m57.452099988s) [noise=true , address=185.167.204.206:4050 , piece_id=DHS3HOFXUBK4BKB5NVZVLDMNI2ZKTP6RVK4KJ2MVL67V47IL2Z3A, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648822212 (160h22m57.452286803s) [noise=true , address=81.171.14.70:4038 , piece_id=T5H2PB2PIPPCGVEDBD4PN5K7VI6TDMKXP6QW242EA6LMFJCAS4OQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: rpc: dial tcp 81.171.14.70:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648970309 (160h22m57.452434895s) [noise=true , address=89.149.201.147:4005 , piece_id=5UJBQPRPDDKVBMIPOZNSE2ZD5TL2KQFP7BNIHXYDW7XFTUCZ4KNA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649153071 (160h22m57.452617658s) [noise=true , address=89.149.201.147:4016 , piece_id=UUNTWX7FB4I7YG2LDN2Y2WP7BHXHZHYKNQROUVFRAMHEKEJQF6VA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649337300 (160h22m57.452801882s) [noise=true , address=185.167.204.205:4027 , piece_id=WTCV2L3SLOFED6725FQ46U3JEO2LE76LH2N4W767PMAFZ4DNGTWA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649489850 (160h22m57.45295445s) [noise=true , address=185.167.204.205:4025 , piece_id=KFG5MK4RB57N2XF4ZLMTAJ7HCCBSJUIGRFQRA3QOFEAHYRRZEUKQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649644940 (160h22m57.453109528s) [noise=true , address=81.171.14.70:4047 , piece_id=O6W5TPWL24YQCYKT7GWQ7T3GA55DIBTFU5HL244L6ZYXYMQQYMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: rpc: dial tcp 81.171.14.70:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649837367 (160h22m57.453301961s) [noise=true , address=89.149.201.147:4022 , piece_id=BLOGBOXX6FBANQXXBUN3BQWRWAH3PC43VZCIDRIXROQM2ZAV7NOA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: rpc: dial tcp 89.149.201.147:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650055408 (160h22m57.453519984s) [noise=true , address=185.167.204.206:4064 , piece_id=MAC6XEQNR2UYDLEDIPXR3VYLH4SR7VEI3RCJ27E24EIMIF4DSSGA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650229995 (160h22m57.453694573s) [noise=true , address=185.167.204.205:4012 , piece_id=X4IQFROU2Y2GCPBFNFIGBIV54LWLFY7UGPZ2YOB34ZZHAEQ3MBEQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650390416 (160h22m57.453855007s) [noise=true , address=89.149.201.147:4021 , piece_id=MAEF5F7L3C47ZSOTPF2Z5PWHXMTYUTFIZ6Z756MONBCQDDAF5BYQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: rpc: dial tcp 89.149.201.147:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650549336 (160h22m57.454013931s) [noise=true , address=185.167.204.205:4011 , piece_id=TTQHENFBPMCI3PZQEKV52IO3OUBDS5ACHCV2K34UHCSQRCQXZRVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650715583 (160h22m57.454180175s) [noise=true , address=185.167.204.205:4008 , piece_id=TG5PNUZMD6HB7AYOWQM6LAJIC4DFSGSWPPOLWD42ZLZQIA7TFOFA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650879777 (160h22m57.454344374s) [noise=true , address=185.167.204.206:4049 , piece_id=JJL2EE4FSKLKYNZIQC4DPZICJBM2V7T6FUIJKNOZVPXY3FCK4GLQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651037802 (160h22m57.454502453s) [noise=true , address=185.167.204.205:4014 , piece_id=MJELQYF2MKIHI6UX2AFF7NTABPPTZ7NYEZN5GQNKOFBBAQ4XOKAA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651306523 (160h22m57.454771119s) [noise=true , address=81.171.14.70:4029 , piece_id=PMDZH27BZU52YWCVRUHLQB7K6CFGWK2UQKVFYMWJZMT53R5T3IVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651476372 (160h22m57.45494095s) [noise=true , address=81.171.14.70:4048 , piece_id=UYAQIALBK6OGIZU7UFRJRWLTSQFMQRJU5A6PKWFF7QQ5VB3H4LXQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651648406 (160h22m57.455113002s) [noise=true , address=89.149.201.147:4003 , piece_id=VCVV5WC5Q7YJFQZ3LTJQZ2WHWF5ISWELC2IPX6NJTCLSCRUF4L6Q, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: rpc: dial tcp 89.149.201.147:4003: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651820843 (160h22m57.455285449s) [noise=true , address=89.149.201.147:4019 , piece_id=JOQH7YYR52QRAXMXC35XHHDHIYU57AGBD4DE4AJROTHXDNY5CMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: rpc: dial tcp 89.149.201.147:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651991651 (160h22m57.455456234s) [noise=true , address=185.167.204.205:4031 , piece_id=YHTTQIWCH2YB7HLEUVV5P2AK5OWRB52KZBKKERQBQPGRD4JSMNOQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 139.59.144.22:36174->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.652019889 (160h22m57.455484483s) [seg_pos={0 0}, upload=141188]: Done waiting for segment. successful: 0 optimal: 26 errs: <nil>
Duration: 976.008732ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [....XXX.....................................................] duration:
2.752161642s
FAIL (2025-09-30 06:31:53 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.752193209s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
3.050811492s
FAIL (2025-09-30 06:31:47 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.050864355s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....XX.....................................................] duration:
1.135329066s
FAIL (2025-09-30 06:31:47 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 1.135358573s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.....XXX....................................................] duration:
899.652698ms
FAIL (2025-09-30 06:31:35 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 26 but got 0)
======LOGS======
[noise=true , address=81.171.14.70:4045 , piece_id=DD53MUKF24OCOLISJNN4F2ESSJSAM6KTBCIHF4UJVOYLKPOLANEA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648490545 (160h22m57.451955126s) [noise=true , address=89.149.201.147:4013 , piece_id=RSPYSYOBACSJ4OKRGV7NQNNQT5ORQJNX4RZVVPHHHM63DYN4KCIQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: rpc: dial tcp 89.149.201.147:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648635402 (160h22m57.452099988s) [noise=true , address=185.167.204.206:4050 , piece_id=DHS3HOFXUBK4BKB5NVZVLDMNI2ZKTP6RVK4KJ2MVL67V47IL2Z3A, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648822212 (160h22m57.452286803s) [noise=true , address=81.171.14.70:4038 , piece_id=T5H2PB2PIPPCGVEDBD4PN5K7VI6TDMKXP6QW242EA6LMFJCAS4OQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: rpc: dial tcp 81.171.14.70:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.648970309 (160h22m57.452434895s) [noise=true , address=89.149.201.147:4005 , piece_id=5UJBQPRPDDKVBMIPOZNSE2ZD5TL2KQFP7BNIHXYDW7XFTUCZ4KNA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649153071 (160h22m57.452617658s) [noise=true , address=89.149.201.147:4016 , piece_id=UUNTWX7FB4I7YG2LDN2Y2WP7BHXHZHYKNQROUVFRAMHEKEJQF6VA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649337300 (160h22m57.452801882s) [noise=true , address=185.167.204.205:4027 , piece_id=WTCV2L3SLOFED6725FQ46U3JEO2LE76LH2N4W767PMAFZ4DNGTWA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649489850 (160h22m57.45295445s) [noise=true , address=185.167.204.205:4025 , piece_id=KFG5MK4RB57N2XF4ZLMTAJ7HCCBSJUIGRFQRA3QOFEAHYRRZEUKQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649644940 (160h22m57.453109528s) [noise=true , address=81.171.14.70:4047 , piece_id=O6W5TPWL24YQCYKT7GWQ7T3GA55DIBTFU5HL244L6ZYXYMQQYMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: rpc: dial tcp 81.171.14.70:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.649837367 (160h22m57.453301961s) [noise=true , address=89.149.201.147:4022 , piece_id=BLOGBOXX6FBANQXXBUN3BQWRWAH3PC43VZCIDRIXROQM2ZAV7NOA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: rpc: dial tcp 89.149.201.147:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650055408 (160h22m57.453519984s) [noise=true , address=185.167.204.206:4064 , piece_id=MAC6XEQNR2UYDLEDIPXR3VYLH4SR7VEI3RCJ27E24EIMIF4DSSGA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650229995 (160h22m57.453694573s) [noise=true , address=185.167.204.205:4012 , piece_id=X4IQFROU2Y2GCPBFNFIGBIV54LWLFY7UGPZ2YOB34ZZHAEQ3MBEQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650390416 (160h22m57.453855007s) [noise=true , address=89.149.201.147:4021 , piece_id=MAEF5F7L3C47ZSOTPF2Z5PWHXMTYUTFIZ6Z756MONBCQDDAF5BYQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: rpc: dial tcp 89.149.201.147:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650549336 (160h22m57.454013931s) [noise=true , address=185.167.204.205:4011 , piece_id=TTQHENFBPMCI3PZQEKV52IO3OUBDS5ACHCV2K34UHCSQRCQXZRVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650715583 (160h22m57.454180175s) [noise=true , address=185.167.204.205:4008 , piece_id=TG5PNUZMD6HB7AYOWQM6LAJIC4DFSGSWPPOLWD42ZLZQIA7TFOFA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.650879777 (160h22m57.454344374s) [noise=true , address=185.167.204.206:4049 , piece_id=JJL2EE4FSKLKYNZIQC4DPZICJBM2V7T6FUIJKNOZVPXY3FCK4GLQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651037802 (160h22m57.454502453s) [noise=true , address=185.167.204.205:4014 , piece_id=MJELQYF2MKIHI6UX2AFF7NTABPPTZ7NYEZN5GQNKOFBBAQ4XOKAA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651306523 (160h22m57.454771119s) [noise=true , address=81.171.14.70:4029 , piece_id=PMDZH27BZU52YWCVRUHLQB7K6CFGWK2UQKVFYMWJZMT53R5T3IVA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651476372 (160h22m57.45494095s) [noise=true , address=81.171.14.70:4048 , piece_id=UYAQIALBK6OGIZU7UFRJRWLTSQFMQRJU5A6PKWFF7QQ5VB3H4LXQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651648406 (160h22m57.455113002s) [noise=true , address=89.149.201.147:4003 , piece_id=VCVV5WC5Q7YJFQZ3LTJQZ2WHWF5ISWELC2IPX6NJTCLSCRUF4L6Q, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: rpc: dial tcp 89.149.201.147:4003: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651820843 (160h22m57.455285449s) [noise=true , address=89.149.201.147:4019 , piece_id=JOQH7YYR52QRAXMXC35XHHDHIYU57AGBD4DE4AJROTHXDNY5CMXA, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: rpc: dial tcp 89.149.201.147:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.651991651 (160h22m57.455456234s) [noise=true , address=185.167.204.205:4031 , piece_id=YHTTQIWCH2YB7HLEUVV5P2AK5OWRB52KZBKKERQBQPGRD4JSMNOQ, seg_pos={0 0}, upload=141188]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 139.59.144.22:36174->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 30 05:53:09.652019889 (160h22m57.455484483s) [seg_pos={0 0}, upload=141188]: Done waiting for segment. successful: 0 optimal: 26 errs: <nil>
Duration: 899.688855ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [......XX....................................................] duration:
1.138974676s
FAIL (2025-09-30 06:31:20 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 1.139066904s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....XXX....................................................] duration:
2.635573539s
FAIL (2025-09-30 06:30:47 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.635602331s
edge
gateway
us-select-1
|