Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
3.032434668s
FAIL (2025-07-05 22:19:47 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.032462793s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
2.556632876s
FAIL (2025-07-05 22:19:01 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.556668812s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.79160164s
FAIL (2025-07-05 22:18:24 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.791638955s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
2.966475928s
FAIL (2025-07-05 22:17:53 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.966529876s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
3.72059464s
FAIL (2025-07-05 22:16:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.720621901s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
2.682091923s
FAIL (2025-07-05 22:16:16 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.682119188s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.714283131s
FAIL (2025-07-05 22:15:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.714329426s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
2.837930731s
FAIL (2025-07-05 22:14:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.837956872s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
2.931370811s
FAIL (2025-07-05 22:13:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.931396456s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
2.542904499s
FAIL (2025-07-05 22:13:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.542949015s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
2.72462887s
FAIL (2025-07-05 22:12:46 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.72468395s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
2.804964226s
FAIL (2025-07-05 22:12:04 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.804985873s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
3.0115608s
FAIL (2025-07-05 22:11:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.011593206s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
2.596046002s
FAIL (2025-07-05 22:10:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.59607256s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
2.74969187s
FAIL (2025-07-05 22:09:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.749725809s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
2.603710872s
FAIL (2025-07-05 22:08:46 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.603731936s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
3.426499079s
FAIL (2025-07-05 22:08:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.426522807s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
2.825905525s
FAIL (2025-07-05 22:06:55 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.825926726s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
2.621279097s
FAIL (2025-07-05 22:06:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.621307814s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.791512288s
FAIL (2025-07-05 22:06:00 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.791544685s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.780382207s
FAIL (2025-07-05 22:05:04 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.780620724s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.672001307s
FAIL (2025-07-05 22:04:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.672025269s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.837464566s
FAIL (2025-07-05 22:03:46 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.837516503s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.63585246s
FAIL (2025-07-05 22:03:25 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.635886259s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.917370117s
FAIL (2025-07-05 22:02:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.917481288s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.5637233s
FAIL (2025-07-05 22:02:03 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.563756079s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.823627261s
FAIL (2025-07-05 22:00:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.823672536s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.811674078s
FAIL (2025-07-05 22:00:03 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.811706827s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
449.149246ms
FAIL (2025-07-05 21:59:41 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 449.188398ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.750487066s
FAIL (2025-07-05 21:59:33 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.750517119s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
444.509866ms
FAIL (2025-07-05 21:59:00 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 444.565036ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
397.238983ms
FAIL (2025-07-05 21:58:38 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 397.278147ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
3.084771738s
FAIL (2025-07-05 21:58:34 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.084797217s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
448.663384ms
FAIL (2025-07-05 21:58:21 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 448.696894ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
465.789901ms
FAIL (2025-07-05 21:57:46 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 465.828292ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.81733417s
FAIL (2025-07-05 21:57:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.817365279s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
445.315981ms
FAIL (2025-07-05 21:56:46 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 445.433124ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
2.837109903s
FAIL (2025-07-05 21:56:36 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.837169594s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
3.47995143s
FAIL (2025-07-05 21:55:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.479980605s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
431.158582ms
FAIL (2025-07-05 21:55:48 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 431.200962ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [X..........................................X................] duration:
2.931570284s
FAIL (2025-07-05 21:55:14 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.931601609s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
618.433736ms
FAIL (2025-07-05 21:55:13 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 618.466009ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X..........................................X...............] duration:
3.643510781s
FAIL (2025-07-05 21:54:26 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.643546703s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
458.196782ms
FAIL (2025-07-05 21:54:01 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 458.245138ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X..........................................X..............] duration:
2.537982747s
FAIL (2025-07-05 21:53:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.538032525s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X..........................................X.............] duration:
2.758366121s
FAIL (2025-07-05 21:53:08 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.758390944s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
448.385853ms
FAIL (2025-07-05 21:52:50 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 448.458616ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
448.347701ms
FAIL (2025-07-05 21:52:26 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 448.378048ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X..........................................X............] duration:
2.823233264s
FAIL (2025-07-05 21:51:56 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.823263582s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
418.535754ms
FAIL (2025-07-05 21:51:31 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 418.568079ms
core
uplink
eu-select-1
eu1-placement-15
|