Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.80913599s FAIL (2025-07-09 07:00:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.809164579s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.731236145s FAIL (2025-07-09 06:59:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.731260127s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.834875952s FAIL (2025-07-09 06:59:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.836061494s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.570444892s FAIL (2025-07-09 06:59:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.570494886s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.531356309s FAIL (2025-07-09 06:58:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.531414598s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.723370878s FAIL (2025-07-09 06:57:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.723440629s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.767758851s FAIL (2025-07-09 06:56:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.767846247s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.620766786s FAIL (2025-07-09 06:56:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.62106795s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.002012559s FAIL (2025-07-09 06:55:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.002043187s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.867581381s FAIL (2025-07-09 03:39:03 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.867605504s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 3.341259171s FAIL (2025-07-09 03:38:32 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.341280216s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.901961556s FAIL (2025-07-09 03:37:49 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.901983138s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.509307447s FAIL (2025-07-09 03:37:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.509332761s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 3.093678403s FAIL (2025-07-09 03:37:21 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.093711825s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.687471121s FAIL (2025-07-09 03:37:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.687512903s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [X...X.......................................................] duration: 4.967694408s FAIL (2025-07-09 03:36:54 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.96773738s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [X.X.........................................................] duration: 2.704382781s FAIL (2025-07-09 03:36:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.704412594s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [XX...X......................................................] duration: 3.749344728s FAIL (2025-07-09 03:36:30 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.749388682s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.X.X........................................................] duration: 2.640325303s FAIL (2025-07-09 03:35:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.640347659s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [XXX...X.....................................................] duration: 2.88961374s FAIL (2025-07-09 03:35:18 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.889639228s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [XXXX...X....................................................] duration: 2.870342752s FAIL (2025-07-09 03:34:39 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.870379453s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [X.X.X.......................................................] duration: 2.734899008s FAIL (2025-07-09 03:34:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.734933884s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X.X.X......................................................] duration: 4.347852957s FAIL (2025-07-09 03:34:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.347881083s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [.XXXX...X...................................................] duration: 8.099004262s FAIL (2025-07-09 03:34:12 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.099034616s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 6 out of 60 is failed (threshold=3) [X.XXXX...X..................................................] duration: 2.837269138s FAIL (2025-07-09 03:33:50 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.837296344s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [X.X.X.X.....................................................] duration: 2.678947701s FAIL (2025-07-09 03:33:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.6789888s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 6 out of 60 is failed (threshold=3) [.X.XXXX...X.................................................] duration: 2.708255454s FAIL (2025-07-09 03:32:54 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.708281262s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.X.X.X.X....................................................] duration: 2.887500454s FAIL (2025-07-09 03:32:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.887542014s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 7 out of 60 is failed (threshold=3) [X.X.XXXX...X................................................] duration: 3.376255668s FAIL (2025-07-09 03:32:27 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.376285286s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 8 out of 60 is failed (threshold=3) [XX.X.XXXX...X...............................................] duration: 2.673133908s FAIL (2025-07-09 03:32:05 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.673165565s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..X.X.X.X...................................................] duration: 2.895860822s FAIL (2025-07-09 03:31:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.895902502s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 8 out of 60 is failed (threshold=3) [.XX.X.XXXX...X..............................................] duration: 3.013083845s FAIL (2025-07-09 03:31:22 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.013162543s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.441606861s FAIL (2025-07-09 03:31:04 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== ting upload Jul 9 02:48:13.623048621 (377h37m13.506462248s) [upload=301971]: Uploading segments... Jul 9 02:48:13.623340323 (377h37m13.506753941s) [upload=301971]: Got next segment. Inline: false Jul 9 02:48:13.623390150 (377h37m13.506803776s) [upload=301971]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 02:48:13.623395504 (377h37m13.50680913s) [upload=301971]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 02:48:13.817252748 (377h37m13.700666374s) [seg_pos={0 0}, upload=301971]: Begin upload segment... Jul 9 02:48:13.817328879 (377h37m13.700742516s) [seg_pos={0 0}, upload=301971]: Done begin upload segment. Jul 9 02:48:13.817359351 (377h37m13.700772986s) [noise=true , address=79.127.205.235:4662 , piece_id=IBJFBZYO3LSKLWJLZROD2CIB7YQXTTOVYRVUKXXODKFH7AT2CEGA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.817380997 (377h37m13.700794628s) [noise=true , address=77.90.31.15:4731 , piece_id=SBKWBYURU7VZDMU3OP36HXOOA2SCXHEHUUUVJXFTQFDM6FGD3QYA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.817823520 (377h37m13.701237149s) [noise=true , address=104.36.82.38:4696 , piece_id=QSUPCFVH2E2AR2AY5AO6X4KBNPTUTYDNM4U53PEGJYWDAPH4BPBQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.817891283 (377h37m13.701304922s) [noise=true , address=104.36.82.40:4955 , piece_id=3AO226MG7GQ4VJGTFCQKJV7LADBDR52DHIBDWDKACYQQOQDJLWMQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818242454 (377h37m13.701656085s) [noise=true , address=77.90.31.11:4556 , piece_id=PEV6YNDVYJ6F5ZXBLUGB5K5MXPZ4B6YISCKM44Z7DWQ3L5GLTR2Q, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818322245 (377h37m13.701735871s) [noise=true , address=104.36.82.2:4763 , piece_id=ITBKWOMUINXGYF3QSKL3EA646UIBTGBZ5K25MZAWC63WYY4HVNEQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818545897 (377h37m13.701959539s) [noise=true , address=104.36.82.35:4598 , piece_id=UW7DOPZFL6TDXN4DQGL6OMEWGVF76SWE5QYB7TQFS4DL7NPAUGGA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818709190 (377h37m13.702122816s) [noise=true , address=104.36.82.12:4161 , piece_id=GAC4GFKQXQIPTEI2VPGAABDI2AYV7GZSXN4L7LY75KW2R6BXKRCQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818886009 (377h37m13.702299638s) [noise=true , address=77.90.31.16:4758 , piece_id=E74XD4JFGC4MQXHZ4HWJ35RTVXSZL7XKNG7D2YSGHW3FD6NRC4DQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.819063767 (377h37m13.702477394s) [noise=true , address=104.36.82.44:4885 , piece_id=QWKTSS4453IJRCPI6BCY4OYUMEYQDCHI7HP45HWHPHJOQN5L4INA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.822137924 (377h37m13.705551558s) [noise=true , address=104.36.82.19:4431 , piece_id=XR2KRXZS7VEII53QLWH3NP6RHZ3CL653JPNUWST4EWPOS2ZP2W3Q, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.822570534 (377h37m13.705984166s) [noise=true , address=77.90.31.14:4679 , piece_id=B5WKU3LFJC4RX5BBGISCGHGDVY2FCRUYK3LHSJPFEYIF7LSAT5NA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.822930688 (377h37m13.706344317s) [noise=true , address=77.90.31.19:4852 , piece_id=VA3E5FIKHLWK6O3I5PPDJS52MKB77JC733CVQ46WFLAGIJDVGDZA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.823225875 (377h37m13.706639508s) [noise=true , address=77.90.31.10:4528 , piece_id=Z45WKOXUE65MKNUTAFEBOUUDNCVWPRGI7D6SPOZX7F6DVZXLQI5A, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.823562888 (377h37m13.706976522s) [noise=true , address=77.90.31.13:4653 , piece_id=7K7IYONUOVWCSQMCOZMJ4OENYB3A24WXDQJQ3YFD6X7KZRTHEQMQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.823880672 (377h37m13.707294311s) [noise=true , address=77.90.31.18:4832 , piece_id=DKEOHPYKXWZLJHPFZCERN7KVRY5AQYGZEV5YVW24PPHFKRGY7RAQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.824210482 (377h37m13.707624099s) [noise=true , address=156.146.43.225:4449 , piece_id=H4TXOQLWVMT6CLQMMFKXP2QLPDIPVUVE2TRMGIXJX3JZWHQJUN3Q, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.824584706 (377h37m13.707998336s) [noise=true , address=104.36.82.50:4037 , piece_id=JSQH5SHZVBZJPVB7W2CPQCX7LOU7GKXM3CBKE7N52BXVXBEF3JTQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:14.400917506 (377h37m14.284331136s) [upload=301971]: Next returned nil segment Jul 9 02:48:14.400948865 (377h37m14.284362476s) [upload=301971]: Waiting for error group managing segments... Jul 9 02:48:14.539683847 (377h37m14.423097475s) [noise=true , address=77.90.31.14:4679 , piece_id=B5WKU3LFJC4RX5BBGISCGHGDVY2FCRUYK3LHSJPFEYIF7LSAT5NA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.545869119 (377h37m14.429282752s) [noise=true , address=77.90.31.16:4758 , piece_id=E74XD4JFGC4MQXHZ4HWJ35RTVXSZL7XKNG7D2YSGHW3FD6NRC4DQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.549093850 (377h37m14.432507475s) [noise=true , address=77.90.31.11:4556 , piece_id=PEV6YNDVYJ6F5ZXBLUGB5K5MXPZ4B6YISCKM44Z7DWQ3L5GLTR2Q, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.549682016 (377h37m14.433095629s) [noise=true , address=77.90.31.15:4731 , piece_id=SBKWBYURU7VZDMU3OP36HXOOA2SCXHEHUUUVJXFTQFDM6FGD3QYA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.559178891 (377h37m14.442592506s) [noise=true , address=77.90.31.19:4852 , piece_id=VA3E5FIKHLWK6O3I5PPDJS52MKB77JC733CVQ46WFLAGIJDVGDZA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.559277031 (377h37m14.442690646s) [noise=true , address=77.90.31.18:4832 , piece_id=DKEOHPYKXWZLJHPFZCERN7KVRY5AQYGZEV5YVW24PPHFKRGY7RAQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.561727156 (377h37m14.445140769s) [noise=true , address=77.90.31.10:4528 , piece_id=Z45WKOXUE65MKNUTAFEBOUUDNCVWPRGI7D6SPOZX7F6DVZXLQI5A, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.579411062 (377h37m14.462824682s) [noise=true , address=77.90.31.13:4653 , piece_id=7K7IYONUOVWCSQMCOZMJ4OENYB3A24WXDQJQ3YFD6X7KZRTHEQMQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.822904625 (377h37m14.706318242s) [noise=true , address=156.146.43.225:4449 , piece_id=H4TXOQLWVMT6CLQMMFKXP2QLPDIPVUVE2TRMGIXJX3JZWHQJUN3Q, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:15.096350399 (377h37m14.979764016s) [noise=true , address=79.127.205.235:4662 , piece_id=IBJFBZYO3LSKLWJLZROD2CIB7YQXTTOVYRVUKXXODKFH7AT2CEGA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:29.510157364 (377h37m29.393570992s) [noise=true , address=104.36.82.2:4763 , piece_id=ITBKWOMUINXGYF3QSKL3EA646UIBTGBZ5K25MZAWC63WYY4HVNEQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:39.632164275 (377h37m39.515577891s) [noise=true , address=104.36.82.12:4161 , piece_id=GAC4GFKQXQIPTEI2VPGAABDI2AYV7GZSXN4L7LY75KW2R6BXKRCQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:44.469621505 (377h37m44.35303512s) [noise=true , address=104.36.82.19:4431 , piece_id=XR2KRXZS7VEII53QLWH3NP6RHZ3CL653JPNUWST4EWPOS2ZP2W3Q, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:49:13.355633183 (377h38m13.23904681s) [noise=true , address=104.36.82.44:4885 , piece_id=QWKTSS4453IJRCPI6BCY4OYUMEYQDCHI7HP45HWHPHJOQN5L4INA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG, address:104.36.82.44:4885): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 02:49:13.355804399 (377h38m13.239218012s) [noise=true , address=104.36.82.35:4598 , piece_id=UW7DOPZFL6TDXN4DQGL6OMEWGVF76SWE5QYB7TQFS4DL7NPAUGGA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:1hJMMH7ft1vWUYnQeugCHmuYGHd2wnMRm44KyMg997BZajJb3M, address:104.36.82.35:4598): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 02:49:13.355849615 (377h38m13.239263241s) [noise=true , address=104.36.82.40:4955 , piece_id=3AO226MG7GQ4VJGTFCQKJV7LADBDR52DHIBDWDKACYQQOQDJLWMQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:12ssLq5bo7og4z8ZPd28f2H6WUExsWohBBZUnciGaH5KKpcQ25d, address:104.36.82.40:4955): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 02:49:13.355894817 (377h38m13.239308443s) [noise=true , address=104.36.82.50:4037 , piece_id=JSQH5SHZVBZJPVB7W2CPQCX7LOU7GKXM3CBKE7N52BXVXBEF3JTQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:14gJ4XfdRiFLVEixdjSP5QB8F9toGcb6xoxP7kXxX1vXJm5TDg, address:104.36.82.50:4037): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 02:49:13.355988218 (377h38m13.239401844s) [noise=true , address=104.36.82.38:4696 , piece_id=QSUPCFVH2E2AR2AY5AO6X4KBNPTUTYDNM4U53PEGJYWDAPH4BPBQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:1JrFvHgEHVLtwK3QYvFTzASCysBCR38qA4Ni8Jvrb1rXUaFy3H, address:104.36.82.38:4696): protocol: write tcp 139.59.144.22:47232->104.36.82.38:4696: use of closed network connection; write tcp 139.59.144.22:47232->104.36.82.38:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47232->104.36.82.38:4696: use of closed network connection Jul 9 02:49:13.356007346 (377h38m13.239420978s) [seg_pos={0 0}, upload=301971]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 02:49:13.464380779 (377h38m13.347794407s) [upload=301971]: Done uploading segments... Jul 9 02:49:13.464449732 (377h38m13.347863348s) [upload=301971]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.441667826s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [X.XX.X.XXXX...X.............................................] duration: 2.921782912s FAIL (2025-07-09 03:30:54 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.922958542s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [X..X.X.X.X..................................................] duration: 2.566090003s FAIL (2025-07-09 03:30:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.566109749s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.24196345s FAIL (2025-07-09 03:30:27 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== ting upload Jul 9 02:48:13.623048621 (377h37m13.506462248s) [upload=301971]: Uploading segments... Jul 9 02:48:13.623340323 (377h37m13.506753941s) [upload=301971]: Got next segment. Inline: false Jul 9 02:48:13.623390150 (377h37m13.506803776s) [upload=301971]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 02:48:13.623395504 (377h37m13.50680913s) [upload=301971]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 02:48:13.817252748 (377h37m13.700666374s) [seg_pos={0 0}, upload=301971]: Begin upload segment... Jul 9 02:48:13.817328879 (377h37m13.700742516s) [seg_pos={0 0}, upload=301971]: Done begin upload segment. Jul 9 02:48:13.817359351 (377h37m13.700772986s) [noise=true , address=79.127.205.235:4662 , piece_id=IBJFBZYO3LSKLWJLZROD2CIB7YQXTTOVYRVUKXXODKFH7AT2CEGA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.817380997 (377h37m13.700794628s) [noise=true , address=77.90.31.15:4731 , piece_id=SBKWBYURU7VZDMU3OP36HXOOA2SCXHEHUUUVJXFTQFDM6FGD3QYA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.817823520 (377h37m13.701237149s) [noise=true , address=104.36.82.38:4696 , piece_id=QSUPCFVH2E2AR2AY5AO6X4KBNPTUTYDNM4U53PEGJYWDAPH4BPBQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.817891283 (377h37m13.701304922s) [noise=true , address=104.36.82.40:4955 , piece_id=3AO226MG7GQ4VJGTFCQKJV7LADBDR52DHIBDWDKACYQQOQDJLWMQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818242454 (377h37m13.701656085s) [noise=true , address=77.90.31.11:4556 , piece_id=PEV6YNDVYJ6F5ZXBLUGB5K5MXPZ4B6YISCKM44Z7DWQ3L5GLTR2Q, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818322245 (377h37m13.701735871s) [noise=true , address=104.36.82.2:4763 , piece_id=ITBKWOMUINXGYF3QSKL3EA646UIBTGBZ5K25MZAWC63WYY4HVNEQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818545897 (377h37m13.701959539s) [noise=true , address=104.36.82.35:4598 , piece_id=UW7DOPZFL6TDXN4DQGL6OMEWGVF76SWE5QYB7TQFS4DL7NPAUGGA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818709190 (377h37m13.702122816s) [noise=true , address=104.36.82.12:4161 , piece_id=GAC4GFKQXQIPTEI2VPGAABDI2AYV7GZSXN4L7LY75KW2R6BXKRCQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818886009 (377h37m13.702299638s) [noise=true , address=77.90.31.16:4758 , piece_id=E74XD4JFGC4MQXHZ4HWJ35RTVXSZL7XKNG7D2YSGHW3FD6NRC4DQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.819063767 (377h37m13.702477394s) [noise=true , address=104.36.82.44:4885 , piece_id=QWKTSS4453IJRCPI6BCY4OYUMEYQDCHI7HP45HWHPHJOQN5L4INA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.822137924 (377h37m13.705551558s) [noise=true , address=104.36.82.19:4431 , piece_id=XR2KRXZS7VEII53QLWH3NP6RHZ3CL653JPNUWST4EWPOS2ZP2W3Q, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.822570534 (377h37m13.705984166s) [noise=true , address=77.90.31.14:4679 , piece_id=B5WKU3LFJC4RX5BBGISCGHGDVY2FCRUYK3LHSJPFEYIF7LSAT5NA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.822930688 (377h37m13.706344317s) [noise=true , address=77.90.31.19:4852 , piece_id=VA3E5FIKHLWK6O3I5PPDJS52MKB77JC733CVQ46WFLAGIJDVGDZA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.823225875 (377h37m13.706639508s) [noise=true , address=77.90.31.10:4528 , piece_id=Z45WKOXUE65MKNUTAFEBOUUDNCVWPRGI7D6SPOZX7F6DVZXLQI5A, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.823562888 (377h37m13.706976522s) [noise=true , address=77.90.31.13:4653 , piece_id=7K7IYONUOVWCSQMCOZMJ4OENYB3A24WXDQJQ3YFD6X7KZRTHEQMQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.823880672 (377h37m13.707294311s) [noise=true , address=77.90.31.18:4832 , piece_id=DKEOHPYKXWZLJHPFZCERN7KVRY5AQYGZEV5YVW24PPHFKRGY7RAQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.824210482 (377h37m13.707624099s) [noise=true , address=156.146.43.225:4449 , piece_id=H4TXOQLWVMT6CLQMMFKXP2QLPDIPVUVE2TRMGIXJX3JZWHQJUN3Q, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.824584706 (377h37m13.707998336s) [noise=true , address=104.36.82.50:4037 , piece_id=JSQH5SHZVBZJPVB7W2CPQCX7LOU7GKXM3CBKE7N52BXVXBEF3JTQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:14.400917506 (377h37m14.284331136s) [upload=301971]: Next returned nil segment Jul 9 02:48:14.400948865 (377h37m14.284362476s) [upload=301971]: Waiting for error group managing segments... Jul 9 02:48:14.539683847 (377h37m14.423097475s) [noise=true , address=77.90.31.14:4679 , piece_id=B5WKU3LFJC4RX5BBGISCGHGDVY2FCRUYK3LHSJPFEYIF7LSAT5NA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.545869119 (377h37m14.429282752s) [noise=true , address=77.90.31.16:4758 , piece_id=E74XD4JFGC4MQXHZ4HWJ35RTVXSZL7XKNG7D2YSGHW3FD6NRC4DQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.549093850 (377h37m14.432507475s) [noise=true , address=77.90.31.11:4556 , piece_id=PEV6YNDVYJ6F5ZXBLUGB5K5MXPZ4B6YISCKM44Z7DWQ3L5GLTR2Q, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.549682016 (377h37m14.433095629s) [noise=true , address=77.90.31.15:4731 , piece_id=SBKWBYURU7VZDMU3OP36HXOOA2SCXHEHUUUVJXFTQFDM6FGD3QYA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.559178891 (377h37m14.442592506s) [noise=true , address=77.90.31.19:4852 , piece_id=VA3E5FIKHLWK6O3I5PPDJS52MKB77JC733CVQ46WFLAGIJDVGDZA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.559277031 (377h37m14.442690646s) [noise=true , address=77.90.31.18:4832 , piece_id=DKEOHPYKXWZLJHPFZCERN7KVRY5AQYGZEV5YVW24PPHFKRGY7RAQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.561727156 (377h37m14.445140769s) [noise=true , address=77.90.31.10:4528 , piece_id=Z45WKOXUE65MKNUTAFEBOUUDNCVWPRGI7D6SPOZX7F6DVZXLQI5A, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.579411062 (377h37m14.462824682s) [noise=true , address=77.90.31.13:4653 , piece_id=7K7IYONUOVWCSQMCOZMJ4OENYB3A24WXDQJQ3YFD6X7KZRTHEQMQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.822904625 (377h37m14.706318242s) [noise=true , address=156.146.43.225:4449 , piece_id=H4TXOQLWVMT6CLQMMFKXP2QLPDIPVUVE2TRMGIXJX3JZWHQJUN3Q, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:15.096350399 (377h37m14.979764016s) [noise=true , address=79.127.205.235:4662 , piece_id=IBJFBZYO3LSKLWJLZROD2CIB7YQXTTOVYRVUKXXODKFH7AT2CEGA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:29.510157364 (377h37m29.393570992s) [noise=true , address=104.36.82.2:4763 , piece_id=ITBKWOMUINXGYF3QSKL3EA646UIBTGBZ5K25MZAWC63WYY4HVNEQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:39.632164275 (377h37m39.515577891s) [noise=true , address=104.36.82.12:4161 , piece_id=GAC4GFKQXQIPTEI2VPGAABDI2AYV7GZSXN4L7LY75KW2R6BXKRCQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:44.469621505 (377h37m44.35303512s) [noise=true , address=104.36.82.19:4431 , piece_id=XR2KRXZS7VEII53QLWH3NP6RHZ3CL653JPNUWST4EWPOS2ZP2W3Q, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:49:13.355633183 (377h38m13.23904681s) [noise=true , address=104.36.82.44:4885 , piece_id=QWKTSS4453IJRCPI6BCY4OYUMEYQDCHI7HP45HWHPHJOQN5L4INA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG, address:104.36.82.44:4885): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 02:49:13.355804399 (377h38m13.239218012s) [noise=true , address=104.36.82.35:4598 , piece_id=UW7DOPZFL6TDXN4DQGL6OMEWGVF76SWE5QYB7TQFS4DL7NPAUGGA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:1hJMMH7ft1vWUYnQeugCHmuYGHd2wnMRm44KyMg997BZajJb3M, address:104.36.82.35:4598): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 02:49:13.355849615 (377h38m13.239263241s) [noise=true , address=104.36.82.40:4955 , piece_id=3AO226MG7GQ4VJGTFCQKJV7LADBDR52DHIBDWDKACYQQOQDJLWMQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:12ssLq5bo7og4z8ZPd28f2H6WUExsWohBBZUnciGaH5KKpcQ25d, address:104.36.82.40:4955): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 02:49:13.355894817 (377h38m13.239308443s) [noise=true , address=104.36.82.50:4037 , piece_id=JSQH5SHZVBZJPVB7W2CPQCX7LOU7GKXM3CBKE7N52BXVXBEF3JTQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:14gJ4XfdRiFLVEixdjSP5QB8F9toGcb6xoxP7kXxX1vXJm5TDg, address:104.36.82.50:4037): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 02:49:13.355988218 (377h38m13.239401844s) [noise=true , address=104.36.82.38:4696 , piece_id=QSUPCFVH2E2AR2AY5AO6X4KBNPTUTYDNM4U53PEGJYWDAPH4BPBQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:1JrFvHgEHVLtwK3QYvFTzASCysBCR38qA4Ni8Jvrb1rXUaFy3H, address:104.36.82.38:4696): protocol: write tcp 139.59.144.22:47232->104.36.82.38:4696: use of closed network connection; write tcp 139.59.144.22:47232->104.36.82.38:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47232->104.36.82.38:4696: use of closed network connection Jul 9 02:49:13.356007346 (377h38m13.239420978s) [seg_pos={0 0}, upload=301971]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 02:49:13.464380779 (377h38m13.347794407s) [upload=301971]: Done uploading segments... Jul 9 02:49:13.464449732 (377h38m13.347863348s) [upload=301971]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.242000102s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.322373193s FAIL (2025-07-09 03:29:53 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== ting upload Jul 9 02:48:13.623048621 (377h37m13.506462248s) [upload=301971]: Uploading segments... Jul 9 02:48:13.623340323 (377h37m13.506753941s) [upload=301971]: Got next segment. Inline: false Jul 9 02:48:13.623390150 (377h37m13.506803776s) [upload=301971]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 02:48:13.623395504 (377h37m13.50680913s) [upload=301971]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 02:48:13.817252748 (377h37m13.700666374s) [seg_pos={0 0}, upload=301971]: Begin upload segment... Jul 9 02:48:13.817328879 (377h37m13.700742516s) [seg_pos={0 0}, upload=301971]: Done begin upload segment. Jul 9 02:48:13.817359351 (377h37m13.700772986s) [noise=true , address=79.127.205.235:4662 , piece_id=IBJFBZYO3LSKLWJLZROD2CIB7YQXTTOVYRVUKXXODKFH7AT2CEGA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.817380997 (377h37m13.700794628s) [noise=true , address=77.90.31.15:4731 , piece_id=SBKWBYURU7VZDMU3OP36HXOOA2SCXHEHUUUVJXFTQFDM6FGD3QYA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.817823520 (377h37m13.701237149s) [noise=true , address=104.36.82.38:4696 , piece_id=QSUPCFVH2E2AR2AY5AO6X4KBNPTUTYDNM4U53PEGJYWDAPH4BPBQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.817891283 (377h37m13.701304922s) [noise=true , address=104.36.82.40:4955 , piece_id=3AO226MG7GQ4VJGTFCQKJV7LADBDR52DHIBDWDKACYQQOQDJLWMQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818242454 (377h37m13.701656085s) [noise=true , address=77.90.31.11:4556 , piece_id=PEV6YNDVYJ6F5ZXBLUGB5K5MXPZ4B6YISCKM44Z7DWQ3L5GLTR2Q, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818322245 (377h37m13.701735871s) [noise=true , address=104.36.82.2:4763 , piece_id=ITBKWOMUINXGYF3QSKL3EA646UIBTGBZ5K25MZAWC63WYY4HVNEQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818545897 (377h37m13.701959539s) [noise=true , address=104.36.82.35:4598 , piece_id=UW7DOPZFL6TDXN4DQGL6OMEWGVF76SWE5QYB7TQFS4DL7NPAUGGA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818709190 (377h37m13.702122816s) [noise=true , address=104.36.82.12:4161 , piece_id=GAC4GFKQXQIPTEI2VPGAABDI2AYV7GZSXN4L7LY75KW2R6BXKRCQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818886009 (377h37m13.702299638s) [noise=true , address=77.90.31.16:4758 , piece_id=E74XD4JFGC4MQXHZ4HWJ35RTVXSZL7XKNG7D2YSGHW3FD6NRC4DQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.819063767 (377h37m13.702477394s) [noise=true , address=104.36.82.44:4885 , piece_id=QWKTSS4453IJRCPI6BCY4OYUMEYQDCHI7HP45HWHPHJOQN5L4INA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.822137924 (377h37m13.705551558s) [noise=true , address=104.36.82.19:4431 , piece_id=XR2KRXZS7VEII53QLWH3NP6RHZ3CL653JPNUWST4EWPOS2ZP2W3Q, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.822570534 (377h37m13.705984166s) [noise=true , address=77.90.31.14:4679 , piece_id=B5WKU3LFJC4RX5BBGISCGHGDVY2FCRUYK3LHSJPFEYIF7LSAT5NA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.822930688 (377h37m13.706344317s) [noise=true , address=77.90.31.19:4852 , piece_id=VA3E5FIKHLWK6O3I5PPDJS52MKB77JC733CVQ46WFLAGIJDVGDZA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.823225875 (377h37m13.706639508s) [noise=true , address=77.90.31.10:4528 , piece_id=Z45WKOXUE65MKNUTAFEBOUUDNCVWPRGI7D6SPOZX7F6DVZXLQI5A, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.823562888 (377h37m13.706976522s) [noise=true , address=77.90.31.13:4653 , piece_id=7K7IYONUOVWCSQMCOZMJ4OENYB3A24WXDQJQ3YFD6X7KZRTHEQMQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.823880672 (377h37m13.707294311s) [noise=true , address=77.90.31.18:4832 , piece_id=DKEOHPYKXWZLJHPFZCERN7KVRY5AQYGZEV5YVW24PPHFKRGY7RAQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.824210482 (377h37m13.707624099s) [noise=true , address=156.146.43.225:4449 , piece_id=H4TXOQLWVMT6CLQMMFKXP2QLPDIPVUVE2TRMGIXJX3JZWHQJUN3Q, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.824584706 (377h37m13.707998336s) [noise=true , address=104.36.82.50:4037 , piece_id=JSQH5SHZVBZJPVB7W2CPQCX7LOU7GKXM3CBKE7N52BXVXBEF3JTQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:14.400917506 (377h37m14.284331136s) [upload=301971]: Next returned nil segment Jul 9 02:48:14.400948865 (377h37m14.284362476s) [upload=301971]: Waiting for error group managing segments... Jul 9 02:48:14.539683847 (377h37m14.423097475s) [noise=true , address=77.90.31.14:4679 , piece_id=B5WKU3LFJC4RX5BBGISCGHGDVY2FCRUYK3LHSJPFEYIF7LSAT5NA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.545869119 (377h37m14.429282752s) [noise=true , address=77.90.31.16:4758 , piece_id=E74XD4JFGC4MQXHZ4HWJ35RTVXSZL7XKNG7D2YSGHW3FD6NRC4DQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.549093850 (377h37m14.432507475s) [noise=true , address=77.90.31.11:4556 , piece_id=PEV6YNDVYJ6F5ZXBLUGB5K5MXPZ4B6YISCKM44Z7DWQ3L5GLTR2Q, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.549682016 (377h37m14.433095629s) [noise=true , address=77.90.31.15:4731 , piece_id=SBKWBYURU7VZDMU3OP36HXOOA2SCXHEHUUUVJXFTQFDM6FGD3QYA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.559178891 (377h37m14.442592506s) [noise=true , address=77.90.31.19:4852 , piece_id=VA3E5FIKHLWK6O3I5PPDJS52MKB77JC733CVQ46WFLAGIJDVGDZA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.559277031 (377h37m14.442690646s) [noise=true , address=77.90.31.18:4832 , piece_id=DKEOHPYKXWZLJHPFZCERN7KVRY5AQYGZEV5YVW24PPHFKRGY7RAQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.561727156 (377h37m14.445140769s) [noise=true , address=77.90.31.10:4528 , piece_id=Z45WKOXUE65MKNUTAFEBOUUDNCVWPRGI7D6SPOZX7F6DVZXLQI5A, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.579411062 (377h37m14.462824682s) [noise=true , address=77.90.31.13:4653 , piece_id=7K7IYONUOVWCSQMCOZMJ4OENYB3A24WXDQJQ3YFD6X7KZRTHEQMQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.822904625 (377h37m14.706318242s) [noise=true , address=156.146.43.225:4449 , piece_id=H4TXOQLWVMT6CLQMMFKXP2QLPDIPVUVE2TRMGIXJX3JZWHQJUN3Q, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:15.096350399 (377h37m14.979764016s) [noise=true , address=79.127.205.235:4662 , piece_id=IBJFBZYO3LSKLWJLZROD2CIB7YQXTTOVYRVUKXXODKFH7AT2CEGA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:29.510157364 (377h37m29.393570992s) [noise=true , address=104.36.82.2:4763 , piece_id=ITBKWOMUINXGYF3QSKL3EA646UIBTGBZ5K25MZAWC63WYY4HVNEQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:39.632164275 (377h37m39.515577891s) [noise=true , address=104.36.82.12:4161 , piece_id=GAC4GFKQXQIPTEI2VPGAABDI2AYV7GZSXN4L7LY75KW2R6BXKRCQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:44.469621505 (377h37m44.35303512s) [noise=true , address=104.36.82.19:4431 , piece_id=XR2KRXZS7VEII53QLWH3NP6RHZ3CL653JPNUWST4EWPOS2ZP2W3Q, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:49:13.355633183 (377h38m13.23904681s) [noise=true , address=104.36.82.44:4885 , piece_id=QWKTSS4453IJRCPI6BCY4OYUMEYQDCHI7HP45HWHPHJOQN5L4INA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG, address:104.36.82.44:4885): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 02:49:13.355804399 (377h38m13.239218012s) [noise=true , address=104.36.82.35:4598 , piece_id=UW7DOPZFL6TDXN4DQGL6OMEWGVF76SWE5QYB7TQFS4DL7NPAUGGA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:1hJMMH7ft1vWUYnQeugCHmuYGHd2wnMRm44KyMg997BZajJb3M, address:104.36.82.35:4598): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 02:49:13.355849615 (377h38m13.239263241s) [noise=true , address=104.36.82.40:4955 , piece_id=3AO226MG7GQ4VJGTFCQKJV7LADBDR52DHIBDWDKACYQQOQDJLWMQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:12ssLq5bo7og4z8ZPd28f2H6WUExsWohBBZUnciGaH5KKpcQ25d, address:104.36.82.40:4955): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 02:49:13.355894817 (377h38m13.239308443s) [noise=true , address=104.36.82.50:4037 , piece_id=JSQH5SHZVBZJPVB7W2CPQCX7LOU7GKXM3CBKE7N52BXVXBEF3JTQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:14gJ4XfdRiFLVEixdjSP5QB8F9toGcb6xoxP7kXxX1vXJm5TDg, address:104.36.82.50:4037): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 02:49:13.355988218 (377h38m13.239401844s) [noise=true , address=104.36.82.38:4696 , piece_id=QSUPCFVH2E2AR2AY5AO6X4KBNPTUTYDNM4U53PEGJYWDAPH4BPBQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:1JrFvHgEHVLtwK3QYvFTzASCysBCR38qA4Ni8Jvrb1rXUaFy3H, address:104.36.82.38:4696): protocol: write tcp 139.59.144.22:47232->104.36.82.38:4696: use of closed network connection; write tcp 139.59.144.22:47232->104.36.82.38:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47232->104.36.82.38:4696: use of closed network connection Jul 9 02:49:13.356007346 (377h38m13.239420978s) [seg_pos={0 0}, upload=301971]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 02:49:13.464380779 (377h38m13.347794407s) [upload=301971]: Done uploading segments... Jul 9 02:49:13.464449732 (377h38m13.347863348s) [upload=301971]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.322409859s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [.X.XX.X.XXXX...X............................................] duration: 5.365432146s FAIL (2025-07-09 03:29:47 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.365662101s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.X..X.X.X.X.................................................] duration: 3.16399629s FAIL (2025-07-09 03:29:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.164027955s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [..X.XX.X.XXXX...X...........................................] duration: 2.963008614s FAIL (2025-07-09 03:29:16 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.963728072s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.434186487s FAIL (2025-07-09 03:29:14 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== ting upload Jul 9 02:48:13.623048621 (377h37m13.506462248s) [upload=301971]: Uploading segments... Jul 9 02:48:13.623340323 (377h37m13.506753941s) [upload=301971]: Got next segment. Inline: false Jul 9 02:48:13.623390150 (377h37m13.506803776s) [upload=301971]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 02:48:13.623395504 (377h37m13.50680913s) [upload=301971]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 02:48:13.817252748 (377h37m13.700666374s) [seg_pos={0 0}, upload=301971]: Begin upload segment... Jul 9 02:48:13.817328879 (377h37m13.700742516s) [seg_pos={0 0}, upload=301971]: Done begin upload segment. Jul 9 02:48:13.817359351 (377h37m13.700772986s) [noise=true , address=79.127.205.235:4662 , piece_id=IBJFBZYO3LSKLWJLZROD2CIB7YQXTTOVYRVUKXXODKFH7AT2CEGA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.817380997 (377h37m13.700794628s) [noise=true , address=77.90.31.15:4731 , piece_id=SBKWBYURU7VZDMU3OP36HXOOA2SCXHEHUUUVJXFTQFDM6FGD3QYA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.817823520 (377h37m13.701237149s) [noise=true , address=104.36.82.38:4696 , piece_id=QSUPCFVH2E2AR2AY5AO6X4KBNPTUTYDNM4U53PEGJYWDAPH4BPBQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.817891283 (377h37m13.701304922s) [noise=true , address=104.36.82.40:4955 , piece_id=3AO226MG7GQ4VJGTFCQKJV7LADBDR52DHIBDWDKACYQQOQDJLWMQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818242454 (377h37m13.701656085s) [noise=true , address=77.90.31.11:4556 , piece_id=PEV6YNDVYJ6F5ZXBLUGB5K5MXPZ4B6YISCKM44Z7DWQ3L5GLTR2Q, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818322245 (377h37m13.701735871s) [noise=true , address=104.36.82.2:4763 , piece_id=ITBKWOMUINXGYF3QSKL3EA646UIBTGBZ5K25MZAWC63WYY4HVNEQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818545897 (377h37m13.701959539s) [noise=true , address=104.36.82.35:4598 , piece_id=UW7DOPZFL6TDXN4DQGL6OMEWGVF76SWE5QYB7TQFS4DL7NPAUGGA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818709190 (377h37m13.702122816s) [noise=true , address=104.36.82.12:4161 , piece_id=GAC4GFKQXQIPTEI2VPGAABDI2AYV7GZSXN4L7LY75KW2R6BXKRCQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818886009 (377h37m13.702299638s) [noise=true , address=77.90.31.16:4758 , piece_id=E74XD4JFGC4MQXHZ4HWJ35RTVXSZL7XKNG7D2YSGHW3FD6NRC4DQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.819063767 (377h37m13.702477394s) [noise=true , address=104.36.82.44:4885 , piece_id=QWKTSS4453IJRCPI6BCY4OYUMEYQDCHI7HP45HWHPHJOQN5L4INA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.822137924 (377h37m13.705551558s) [noise=true , address=104.36.82.19:4431 , piece_id=XR2KRXZS7VEII53QLWH3NP6RHZ3CL653JPNUWST4EWPOS2ZP2W3Q, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.822570534 (377h37m13.705984166s) [noise=true , address=77.90.31.14:4679 , piece_id=B5WKU3LFJC4RX5BBGISCGHGDVY2FCRUYK3LHSJPFEYIF7LSAT5NA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.822930688 (377h37m13.706344317s) [noise=true , address=77.90.31.19:4852 , piece_id=VA3E5FIKHLWK6O3I5PPDJS52MKB77JC733CVQ46WFLAGIJDVGDZA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.823225875 (377h37m13.706639508s) [noise=true , address=77.90.31.10:4528 , piece_id=Z45WKOXUE65MKNUTAFEBOUUDNCVWPRGI7D6SPOZX7F6DVZXLQI5A, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.823562888 (377h37m13.706976522s) [noise=true , address=77.90.31.13:4653 , piece_id=7K7IYONUOVWCSQMCOZMJ4OENYB3A24WXDQJQ3YFD6X7KZRTHEQMQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.823880672 (377h37m13.707294311s) [noise=true , address=77.90.31.18:4832 , piece_id=DKEOHPYKXWZLJHPFZCERN7KVRY5AQYGZEV5YVW24PPHFKRGY7RAQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.824210482 (377h37m13.707624099s) [noise=true , address=156.146.43.225:4449 , piece_id=H4TXOQLWVMT6CLQMMFKXP2QLPDIPVUVE2TRMGIXJX3JZWHQJUN3Q, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.824584706 (377h37m13.707998336s) [noise=true , address=104.36.82.50:4037 , piece_id=JSQH5SHZVBZJPVB7W2CPQCX7LOU7GKXM3CBKE7N52BXVXBEF3JTQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:14.400917506 (377h37m14.284331136s) [upload=301971]: Next returned nil segment Jul 9 02:48:14.400948865 (377h37m14.284362476s) [upload=301971]: Waiting for error group managing segments... Jul 9 02:48:14.539683847 (377h37m14.423097475s) [noise=true , address=77.90.31.14:4679 , piece_id=B5WKU3LFJC4RX5BBGISCGHGDVY2FCRUYK3LHSJPFEYIF7LSAT5NA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.545869119 (377h37m14.429282752s) [noise=true , address=77.90.31.16:4758 , piece_id=E74XD4JFGC4MQXHZ4HWJ35RTVXSZL7XKNG7D2YSGHW3FD6NRC4DQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.549093850 (377h37m14.432507475s) [noise=true , address=77.90.31.11:4556 , piece_id=PEV6YNDVYJ6F5ZXBLUGB5K5MXPZ4B6YISCKM44Z7DWQ3L5GLTR2Q, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.549682016 (377h37m14.433095629s) [noise=true , address=77.90.31.15:4731 , piece_id=SBKWBYURU7VZDMU3OP36HXOOA2SCXHEHUUUVJXFTQFDM6FGD3QYA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.559178891 (377h37m14.442592506s) [noise=true , address=77.90.31.19:4852 , piece_id=VA3E5FIKHLWK6O3I5PPDJS52MKB77JC733CVQ46WFLAGIJDVGDZA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.559277031 (377h37m14.442690646s) [noise=true , address=77.90.31.18:4832 , piece_id=DKEOHPYKXWZLJHPFZCERN7KVRY5AQYGZEV5YVW24PPHFKRGY7RAQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.561727156 (377h37m14.445140769s) [noise=true , address=77.90.31.10:4528 , piece_id=Z45WKOXUE65MKNUTAFEBOUUDNCVWPRGI7D6SPOZX7F6DVZXLQI5A, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.579411062 (377h37m14.462824682s) [noise=true , address=77.90.31.13:4653 , piece_id=7K7IYONUOVWCSQMCOZMJ4OENYB3A24WXDQJQ3YFD6X7KZRTHEQMQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.822904625 (377h37m14.706318242s) [noise=true , address=156.146.43.225:4449 , piece_id=H4TXOQLWVMT6CLQMMFKXP2QLPDIPVUVE2TRMGIXJX3JZWHQJUN3Q, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:15.096350399 (377h37m14.979764016s) [noise=true , address=79.127.205.235:4662 , piece_id=IBJFBZYO3LSKLWJLZROD2CIB7YQXTTOVYRVUKXXODKFH7AT2CEGA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:29.510157364 (377h37m29.393570992s) [noise=true , address=104.36.82.2:4763 , piece_id=ITBKWOMUINXGYF3QSKL3EA646UIBTGBZ5K25MZAWC63WYY4HVNEQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:39.632164275 (377h37m39.515577891s) [noise=true , address=104.36.82.12:4161 , piece_id=GAC4GFKQXQIPTEI2VPGAABDI2AYV7GZSXN4L7LY75KW2R6BXKRCQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:44.469621505 (377h37m44.35303512s) [noise=true , address=104.36.82.19:4431 , piece_id=XR2KRXZS7VEII53QLWH3NP6RHZ3CL653JPNUWST4EWPOS2ZP2W3Q, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:49:13.355633183 (377h38m13.23904681s) [noise=true , address=104.36.82.44:4885 , piece_id=QWKTSS4453IJRCPI6BCY4OYUMEYQDCHI7HP45HWHPHJOQN5L4INA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG, address:104.36.82.44:4885): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 02:49:13.355804399 (377h38m13.239218012s) [noise=true , address=104.36.82.35:4598 , piece_id=UW7DOPZFL6TDXN4DQGL6OMEWGVF76SWE5QYB7TQFS4DL7NPAUGGA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:1hJMMH7ft1vWUYnQeugCHmuYGHd2wnMRm44KyMg997BZajJb3M, address:104.36.82.35:4598): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 02:49:13.355849615 (377h38m13.239263241s) [noise=true , address=104.36.82.40:4955 , piece_id=3AO226MG7GQ4VJGTFCQKJV7LADBDR52DHIBDWDKACYQQOQDJLWMQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:12ssLq5bo7og4z8ZPd28f2H6WUExsWohBBZUnciGaH5KKpcQ25d, address:104.36.82.40:4955): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 02:49:13.355894817 (377h38m13.239308443s) [noise=true , address=104.36.82.50:4037 , piece_id=JSQH5SHZVBZJPVB7W2CPQCX7LOU7GKXM3CBKE7N52BXVXBEF3JTQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:14gJ4XfdRiFLVEixdjSP5QB8F9toGcb6xoxP7kXxX1vXJm5TDg, address:104.36.82.50:4037): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 02:49:13.355988218 (377h38m13.239401844s) [noise=true , address=104.36.82.38:4696 , piece_id=QSUPCFVH2E2AR2AY5AO6X4KBNPTUTYDNM4U53PEGJYWDAPH4BPBQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:1JrFvHgEHVLtwK3QYvFTzASCysBCR38qA4Ni8Jvrb1rXUaFy3H, address:104.36.82.38:4696): protocol: write tcp 139.59.144.22:47232->104.36.82.38:4696: use of closed network connection; write tcp 139.59.144.22:47232->104.36.82.38:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47232->104.36.82.38:4696: use of closed network connection Jul 9 02:49:13.356007346 (377h38m13.239420978s) [seg_pos={0 0}, upload=301971]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 02:49:13.464380779 (377h38m13.347794407s) [upload=301971]: Done uploading segments... Jul 9 02:49:13.464449732 (377h38m13.347863348s) [upload=301971]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.434227025s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.412226622s FAIL (2025-07-09 03:28:58 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== ting upload Jul 9 02:48:13.623048621 (377h37m13.506462248s) [upload=301971]: Uploading segments... Jul 9 02:48:13.623340323 (377h37m13.506753941s) [upload=301971]: Got next segment. Inline: false Jul 9 02:48:13.623390150 (377h37m13.506803776s) [upload=301971]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 02:48:13.623395504 (377h37m13.50680913s) [upload=301971]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 02:48:13.817252748 (377h37m13.700666374s) [seg_pos={0 0}, upload=301971]: Begin upload segment... Jul 9 02:48:13.817328879 (377h37m13.700742516s) [seg_pos={0 0}, upload=301971]: Done begin upload segment. Jul 9 02:48:13.817359351 (377h37m13.700772986s) [noise=true , address=79.127.205.235:4662 , piece_id=IBJFBZYO3LSKLWJLZROD2CIB7YQXTTOVYRVUKXXODKFH7AT2CEGA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.817380997 (377h37m13.700794628s) [noise=true , address=77.90.31.15:4731 , piece_id=SBKWBYURU7VZDMU3OP36HXOOA2SCXHEHUUUVJXFTQFDM6FGD3QYA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.817823520 (377h37m13.701237149s) [noise=true , address=104.36.82.38:4696 , piece_id=QSUPCFVH2E2AR2AY5AO6X4KBNPTUTYDNM4U53PEGJYWDAPH4BPBQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.817891283 (377h37m13.701304922s) [noise=true , address=104.36.82.40:4955 , piece_id=3AO226MG7GQ4VJGTFCQKJV7LADBDR52DHIBDWDKACYQQOQDJLWMQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818242454 (377h37m13.701656085s) [noise=true , address=77.90.31.11:4556 , piece_id=PEV6YNDVYJ6F5ZXBLUGB5K5MXPZ4B6YISCKM44Z7DWQ3L5GLTR2Q, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818322245 (377h37m13.701735871s) [noise=true , address=104.36.82.2:4763 , piece_id=ITBKWOMUINXGYF3QSKL3EA646UIBTGBZ5K25MZAWC63WYY4HVNEQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818545897 (377h37m13.701959539s) [noise=true , address=104.36.82.35:4598 , piece_id=UW7DOPZFL6TDXN4DQGL6OMEWGVF76SWE5QYB7TQFS4DL7NPAUGGA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818709190 (377h37m13.702122816s) [noise=true , address=104.36.82.12:4161 , piece_id=GAC4GFKQXQIPTEI2VPGAABDI2AYV7GZSXN4L7LY75KW2R6BXKRCQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818886009 (377h37m13.702299638s) [noise=true , address=77.90.31.16:4758 , piece_id=E74XD4JFGC4MQXHZ4HWJ35RTVXSZL7XKNG7D2YSGHW3FD6NRC4DQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.819063767 (377h37m13.702477394s) [noise=true , address=104.36.82.44:4885 , piece_id=QWKTSS4453IJRCPI6BCY4OYUMEYQDCHI7HP45HWHPHJOQN5L4INA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.822137924 (377h37m13.705551558s) [noise=true , address=104.36.82.19:4431 , piece_id=XR2KRXZS7VEII53QLWH3NP6RHZ3CL653JPNUWST4EWPOS2ZP2W3Q, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.822570534 (377h37m13.705984166s) [noise=true , address=77.90.31.14:4679 , piece_id=B5WKU3LFJC4RX5BBGISCGHGDVY2FCRUYK3LHSJPFEYIF7LSAT5NA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.822930688 (377h37m13.706344317s) [noise=true , address=77.90.31.19:4852 , piece_id=VA3E5FIKHLWK6O3I5PPDJS52MKB77JC733CVQ46WFLAGIJDVGDZA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.823225875 (377h37m13.706639508s) [noise=true , address=77.90.31.10:4528 , piece_id=Z45WKOXUE65MKNUTAFEBOUUDNCVWPRGI7D6SPOZX7F6DVZXLQI5A, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.823562888 (377h37m13.706976522s) [noise=true , address=77.90.31.13:4653 , piece_id=7K7IYONUOVWCSQMCOZMJ4OENYB3A24WXDQJQ3YFD6X7KZRTHEQMQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.823880672 (377h37m13.707294311s) [noise=true , address=77.90.31.18:4832 , piece_id=DKEOHPYKXWZLJHPFZCERN7KVRY5AQYGZEV5YVW24PPHFKRGY7RAQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.824210482 (377h37m13.707624099s) [noise=true , address=156.146.43.225:4449 , piece_id=H4TXOQLWVMT6CLQMMFKXP2QLPDIPVUVE2TRMGIXJX3JZWHQJUN3Q, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.824584706 (377h37m13.707998336s) [noise=true , address=104.36.82.50:4037 , piece_id=JSQH5SHZVBZJPVB7W2CPQCX7LOU7GKXM3CBKE7N52BXVXBEF3JTQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:14.400917506 (377h37m14.284331136s) [upload=301971]: Next returned nil segment Jul 9 02:48:14.400948865 (377h37m14.284362476s) [upload=301971]: Waiting for error group managing segments... Jul 9 02:48:14.539683847 (377h37m14.423097475s) [noise=true , address=77.90.31.14:4679 , piece_id=B5WKU3LFJC4RX5BBGISCGHGDVY2FCRUYK3LHSJPFEYIF7LSAT5NA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.545869119 (377h37m14.429282752s) [noise=true , address=77.90.31.16:4758 , piece_id=E74XD4JFGC4MQXHZ4HWJ35RTVXSZL7XKNG7D2YSGHW3FD6NRC4DQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.549093850 (377h37m14.432507475s) [noise=true , address=77.90.31.11:4556 , piece_id=PEV6YNDVYJ6F5ZXBLUGB5K5MXPZ4B6YISCKM44Z7DWQ3L5GLTR2Q, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.549682016 (377h37m14.433095629s) [noise=true , address=77.90.31.15:4731 , piece_id=SBKWBYURU7VZDMU3OP36HXOOA2SCXHEHUUUVJXFTQFDM6FGD3QYA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.559178891 (377h37m14.442592506s) [noise=true , address=77.90.31.19:4852 , piece_id=VA3E5FIKHLWK6O3I5PPDJS52MKB77JC733CVQ46WFLAGIJDVGDZA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.559277031 (377h37m14.442690646s) [noise=true , address=77.90.31.18:4832 , piece_id=DKEOHPYKXWZLJHPFZCERN7KVRY5AQYGZEV5YVW24PPHFKRGY7RAQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.561727156 (377h37m14.445140769s) [noise=true , address=77.90.31.10:4528 , piece_id=Z45WKOXUE65MKNUTAFEBOUUDNCVWPRGI7D6SPOZX7F6DVZXLQI5A, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.579411062 (377h37m14.462824682s) [noise=true , address=77.90.31.13:4653 , piece_id=7K7IYONUOVWCSQMCOZMJ4OENYB3A24WXDQJQ3YFD6X7KZRTHEQMQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.822904625 (377h37m14.706318242s) [noise=true , address=156.146.43.225:4449 , piece_id=H4TXOQLWVMT6CLQMMFKXP2QLPDIPVUVE2TRMGIXJX3JZWHQJUN3Q, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:15.096350399 (377h37m14.979764016s) [noise=true , address=79.127.205.235:4662 , piece_id=IBJFBZYO3LSKLWJLZROD2CIB7YQXTTOVYRVUKXXODKFH7AT2CEGA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:29.510157364 (377h37m29.393570992s) [noise=true , address=104.36.82.2:4763 , piece_id=ITBKWOMUINXGYF3QSKL3EA646UIBTGBZ5K25MZAWC63WYY4HVNEQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:39.632164275 (377h37m39.515577891s) [noise=true , address=104.36.82.12:4161 , piece_id=GAC4GFKQXQIPTEI2VPGAABDI2AYV7GZSXN4L7LY75KW2R6BXKRCQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:44.469621505 (377h37m44.35303512s) [noise=true , address=104.36.82.19:4431 , piece_id=XR2KRXZS7VEII53QLWH3NP6RHZ3CL653JPNUWST4EWPOS2ZP2W3Q, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:49:13.355633183 (377h38m13.23904681s) [noise=true , address=104.36.82.44:4885 , piece_id=QWKTSS4453IJRCPI6BCY4OYUMEYQDCHI7HP45HWHPHJOQN5L4INA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG, address:104.36.82.44:4885): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 02:49:13.355804399 (377h38m13.239218012s) [noise=true , address=104.36.82.35:4598 , piece_id=UW7DOPZFL6TDXN4DQGL6OMEWGVF76SWE5QYB7TQFS4DL7NPAUGGA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:1hJMMH7ft1vWUYnQeugCHmuYGHd2wnMRm44KyMg997BZajJb3M, address:104.36.82.35:4598): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 02:49:13.355849615 (377h38m13.239263241s) [noise=true , address=104.36.82.40:4955 , piece_id=3AO226MG7GQ4VJGTFCQKJV7LADBDR52DHIBDWDKACYQQOQDJLWMQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:12ssLq5bo7og4z8ZPd28f2H6WUExsWohBBZUnciGaH5KKpcQ25d, address:104.36.82.40:4955): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 02:49:13.355894817 (377h38m13.239308443s) [noise=true , address=104.36.82.50:4037 , piece_id=JSQH5SHZVBZJPVB7W2CPQCX7LOU7GKXM3CBKE7N52BXVXBEF3JTQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:14gJ4XfdRiFLVEixdjSP5QB8F9toGcb6xoxP7kXxX1vXJm5TDg, address:104.36.82.50:4037): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 02:49:13.355988218 (377h38m13.239401844s) [noise=true , address=104.36.82.38:4696 , piece_id=QSUPCFVH2E2AR2AY5AO6X4KBNPTUTYDNM4U53PEGJYWDAPH4BPBQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:1JrFvHgEHVLtwK3QYvFTzASCysBCR38qA4Ni8Jvrb1rXUaFy3H, address:104.36.82.38:4696): protocol: write tcp 139.59.144.22:47232->104.36.82.38:4696: use of closed network connection; write tcp 139.59.144.22:47232->104.36.82.38:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47232->104.36.82.38:4696: use of closed network connection Jul 9 02:49:13.356007346 (377h38m13.239420978s) [seg_pos={0 0}, upload=301971]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 02:49:13.464380779 (377h38m13.347794407s) [upload=301971]: Done uploading segments... Jul 9 02:49:13.464449732 (377h38m13.347863348s) [upload=301971]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.412260047s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 10 out of 60 is failed (threshold=3) [X..X.XX.X.XXXX...X..........................................] duration: 3.501923052s FAIL (2025-07-09 03:28:43 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.501990883s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [..X..X.X.X.X................................................] duration: 2.808979281s FAIL (2025-07-09 03:28:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.809010174s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [...X..X.X.X.X...............................................] duration: 2.988669479s FAIL (2025-07-09 03:28:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.988728516s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 6.782170958s FAIL (2025-07-09 03:28:14 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== ting upload Jul 9 02:48:13.623048621 (377h37m13.506462248s) [upload=301971]: Uploading segments... Jul 9 02:48:13.623340323 (377h37m13.506753941s) [upload=301971]: Got next segment. Inline: false Jul 9 02:48:13.623390150 (377h37m13.506803776s) [upload=301971]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 02:48:13.623395504 (377h37m13.50680913s) [upload=301971]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 02:48:13.817252748 (377h37m13.700666374s) [seg_pos={0 0}, upload=301971]: Begin upload segment... Jul 9 02:48:13.817328879 (377h37m13.700742516s) [seg_pos={0 0}, upload=301971]: Done begin upload segment. Jul 9 02:48:13.817359351 (377h37m13.700772986s) [noise=true , address=79.127.205.235:4662 , piece_id=IBJFBZYO3LSKLWJLZROD2CIB7YQXTTOVYRVUKXXODKFH7AT2CEGA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.817380997 (377h37m13.700794628s) [noise=true , address=77.90.31.15:4731 , piece_id=SBKWBYURU7VZDMU3OP36HXOOA2SCXHEHUUUVJXFTQFDM6FGD3QYA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.817823520 (377h37m13.701237149s) [noise=true , address=104.36.82.38:4696 , piece_id=QSUPCFVH2E2AR2AY5AO6X4KBNPTUTYDNM4U53PEGJYWDAPH4BPBQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.817891283 (377h37m13.701304922s) [noise=true , address=104.36.82.40:4955 , piece_id=3AO226MG7GQ4VJGTFCQKJV7LADBDR52DHIBDWDKACYQQOQDJLWMQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818242454 (377h37m13.701656085s) [noise=true , address=77.90.31.11:4556 , piece_id=PEV6YNDVYJ6F5ZXBLUGB5K5MXPZ4B6YISCKM44Z7DWQ3L5GLTR2Q, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818322245 (377h37m13.701735871s) [noise=true , address=104.36.82.2:4763 , piece_id=ITBKWOMUINXGYF3QSKL3EA646UIBTGBZ5K25MZAWC63WYY4HVNEQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818545897 (377h37m13.701959539s) [noise=true , address=104.36.82.35:4598 , piece_id=UW7DOPZFL6TDXN4DQGL6OMEWGVF76SWE5QYB7TQFS4DL7NPAUGGA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818709190 (377h37m13.702122816s) [noise=true , address=104.36.82.12:4161 , piece_id=GAC4GFKQXQIPTEI2VPGAABDI2AYV7GZSXN4L7LY75KW2R6BXKRCQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818886009 (377h37m13.702299638s) [noise=true , address=77.90.31.16:4758 , piece_id=E74XD4JFGC4MQXHZ4HWJ35RTVXSZL7XKNG7D2YSGHW3FD6NRC4DQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.819063767 (377h37m13.702477394s) [noise=true , address=104.36.82.44:4885 , piece_id=QWKTSS4453IJRCPI6BCY4OYUMEYQDCHI7HP45HWHPHJOQN5L4INA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.822137924 (377h37m13.705551558s) [noise=true , address=104.36.82.19:4431 , piece_id=XR2KRXZS7VEII53QLWH3NP6RHZ3CL653JPNUWST4EWPOS2ZP2W3Q, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.822570534 (377h37m13.705984166s) [noise=true , address=77.90.31.14:4679 , piece_id=B5WKU3LFJC4RX5BBGISCGHGDVY2FCRUYK3LHSJPFEYIF7LSAT5NA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.822930688 (377h37m13.706344317s) [noise=true , address=77.90.31.19:4852 , piece_id=VA3E5FIKHLWK6O3I5PPDJS52MKB77JC733CVQ46WFLAGIJDVGDZA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.823225875 (377h37m13.706639508s) [noise=true , address=77.90.31.10:4528 , piece_id=Z45WKOXUE65MKNUTAFEBOUUDNCVWPRGI7D6SPOZX7F6DVZXLQI5A, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.823562888 (377h37m13.706976522s) [noise=true , address=77.90.31.13:4653 , piece_id=7K7IYONUOVWCSQMCOZMJ4OENYB3A24WXDQJQ3YFD6X7KZRTHEQMQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.823880672 (377h37m13.707294311s) [noise=true , address=77.90.31.18:4832 , piece_id=DKEOHPYKXWZLJHPFZCERN7KVRY5AQYGZEV5YVW24PPHFKRGY7RAQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.824210482 (377h37m13.707624099s) [noise=true , address=156.146.43.225:4449 , piece_id=H4TXOQLWVMT6CLQMMFKXP2QLPDIPVUVE2TRMGIXJX3JZWHQJUN3Q, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.824584706 (377h37m13.707998336s) [noise=true , address=104.36.82.50:4037 , piece_id=JSQH5SHZVBZJPVB7W2CPQCX7LOU7GKXM3CBKE7N52BXVXBEF3JTQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:14.400917506 (377h37m14.284331136s) [upload=301971]: Next returned nil segment Jul 9 02:48:14.400948865 (377h37m14.284362476s) [upload=301971]: Waiting for error group managing segments... Jul 9 02:48:14.539683847 (377h37m14.423097475s) [noise=true , address=77.90.31.14:4679 , piece_id=B5WKU3LFJC4RX5BBGISCGHGDVY2FCRUYK3LHSJPFEYIF7LSAT5NA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.545869119 (377h37m14.429282752s) [noise=true , address=77.90.31.16:4758 , piece_id=E74XD4JFGC4MQXHZ4HWJ35RTVXSZL7XKNG7D2YSGHW3FD6NRC4DQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.549093850 (377h37m14.432507475s) [noise=true , address=77.90.31.11:4556 , piece_id=PEV6YNDVYJ6F5ZXBLUGB5K5MXPZ4B6YISCKM44Z7DWQ3L5GLTR2Q, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.549682016 (377h37m14.433095629s) [noise=true , address=77.90.31.15:4731 , piece_id=SBKWBYURU7VZDMU3OP36HXOOA2SCXHEHUUUVJXFTQFDM6FGD3QYA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.559178891 (377h37m14.442592506s) [noise=true , address=77.90.31.19:4852 , piece_id=VA3E5FIKHLWK6O3I5PPDJS52MKB77JC733CVQ46WFLAGIJDVGDZA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.559277031 (377h37m14.442690646s) [noise=true , address=77.90.31.18:4832 , piece_id=DKEOHPYKXWZLJHPFZCERN7KVRY5AQYGZEV5YVW24PPHFKRGY7RAQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.561727156 (377h37m14.445140769s) [noise=true , address=77.90.31.10:4528 , piece_id=Z45WKOXUE65MKNUTAFEBOUUDNCVWPRGI7D6SPOZX7F6DVZXLQI5A, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.579411062 (377h37m14.462824682s) [noise=true , address=77.90.31.13:4653 , piece_id=7K7IYONUOVWCSQMCOZMJ4OENYB3A24WXDQJQ3YFD6X7KZRTHEQMQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.822904625 (377h37m14.706318242s) [noise=true , address=156.146.43.225:4449 , piece_id=H4TXOQLWVMT6CLQMMFKXP2QLPDIPVUVE2TRMGIXJX3JZWHQJUN3Q, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:15.096350399 (377h37m14.979764016s) [noise=true , address=79.127.205.235:4662 , piece_id=IBJFBZYO3LSKLWJLZROD2CIB7YQXTTOVYRVUKXXODKFH7AT2CEGA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:29.510157364 (377h37m29.393570992s) [noise=true , address=104.36.82.2:4763 , piece_id=ITBKWOMUINXGYF3QSKL3EA646UIBTGBZ5K25MZAWC63WYY4HVNEQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:39.632164275 (377h37m39.515577891s) [noise=true , address=104.36.82.12:4161 , piece_id=GAC4GFKQXQIPTEI2VPGAABDI2AYV7GZSXN4L7LY75KW2R6BXKRCQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:44.469621505 (377h37m44.35303512s) [noise=true , address=104.36.82.19:4431 , piece_id=XR2KRXZS7VEII53QLWH3NP6RHZ3CL653JPNUWST4EWPOS2ZP2W3Q, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:49:13.355633183 (377h38m13.23904681s) [noise=true , address=104.36.82.44:4885 , piece_id=QWKTSS4453IJRCPI6BCY4OYUMEYQDCHI7HP45HWHPHJOQN5L4INA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG, address:104.36.82.44:4885): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 02:49:13.355804399 (377h38m13.239218012s) [noise=true , address=104.36.82.35:4598 , piece_id=UW7DOPZFL6TDXN4DQGL6OMEWGVF76SWE5QYB7TQFS4DL7NPAUGGA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:1hJMMH7ft1vWUYnQeugCHmuYGHd2wnMRm44KyMg997BZajJb3M, address:104.36.82.35:4598): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 02:49:13.355849615 (377h38m13.239263241s) [noise=true , address=104.36.82.40:4955 , piece_id=3AO226MG7GQ4VJGTFCQKJV7LADBDR52DHIBDWDKACYQQOQDJLWMQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:12ssLq5bo7og4z8ZPd28f2H6WUExsWohBBZUnciGaH5KKpcQ25d, address:104.36.82.40:4955): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 02:49:13.355894817 (377h38m13.239308443s) [noise=true , address=104.36.82.50:4037 , piece_id=JSQH5SHZVBZJPVB7W2CPQCX7LOU7GKXM3CBKE7N52BXVXBEF3JTQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:14gJ4XfdRiFLVEixdjSP5QB8F9toGcb6xoxP7kXxX1vXJm5TDg, address:104.36.82.50:4037): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 02:49:13.355988218 (377h38m13.239401844s) [noise=true , address=104.36.82.38:4696 , piece_id=QSUPCFVH2E2AR2AY5AO6X4KBNPTUTYDNM4U53PEGJYWDAPH4BPBQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:1JrFvHgEHVLtwK3QYvFTzASCysBCR38qA4Ni8Jvrb1rXUaFy3H, address:104.36.82.38:4696): protocol: write tcp 139.59.144.22:47232->104.36.82.38:4696: use of closed network connection; write tcp 139.59.144.22:47232->104.36.82.38:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47232->104.36.82.38:4696: use of closed network connection Jul 9 02:49:13.356007346 (377h38m13.239420978s) [seg_pos={0 0}, upload=301971]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 02:49:13.464380779 (377h38m13.347794407s) [upload=301971]: Done uploading segments... Jul 9 02:49:13.464449732 (377h38m13.347863348s) [upload=301971]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 6.782203284s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [....X..X.X.X.X..............................................] duration: 2.794935889s FAIL (2025-07-09 03:27:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.794958667s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [XX..X.XX.X.XXXX...X.........................................] duration: 3.507663575s FAIL (2025-07-09 03:27:34 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.507692551s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.446400114s FAIL (2025-07-09 03:27:07 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== ting upload Jul 9 02:48:13.623048621 (377h37m13.506462248s) [upload=301971]: Uploading segments... Jul 9 02:48:13.623340323 (377h37m13.506753941s) [upload=301971]: Got next segment. Inline: false Jul 9 02:48:13.623390150 (377h37m13.506803776s) [upload=301971]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 9 02:48:13.623395504 (377h37m13.50680913s) [upload=301971]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 9 02:48:13.817252748 (377h37m13.700666374s) [seg_pos={0 0}, upload=301971]: Begin upload segment... Jul 9 02:48:13.817328879 (377h37m13.700742516s) [seg_pos={0 0}, upload=301971]: Done begin upload segment. Jul 9 02:48:13.817359351 (377h37m13.700772986s) [noise=true , address=79.127.205.235:4662 , piece_id=IBJFBZYO3LSKLWJLZROD2CIB7YQXTTOVYRVUKXXODKFH7AT2CEGA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.817380997 (377h37m13.700794628s) [noise=true , address=77.90.31.15:4731 , piece_id=SBKWBYURU7VZDMU3OP36HXOOA2SCXHEHUUUVJXFTQFDM6FGD3QYA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.817823520 (377h37m13.701237149s) [noise=true , address=104.36.82.38:4696 , piece_id=QSUPCFVH2E2AR2AY5AO6X4KBNPTUTYDNM4U53PEGJYWDAPH4BPBQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.817891283 (377h37m13.701304922s) [noise=true , address=104.36.82.40:4955 , piece_id=3AO226MG7GQ4VJGTFCQKJV7LADBDR52DHIBDWDKACYQQOQDJLWMQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818242454 (377h37m13.701656085s) [noise=true , address=77.90.31.11:4556 , piece_id=PEV6YNDVYJ6F5ZXBLUGB5K5MXPZ4B6YISCKM44Z7DWQ3L5GLTR2Q, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818322245 (377h37m13.701735871s) [noise=true , address=104.36.82.2:4763 , piece_id=ITBKWOMUINXGYF3QSKL3EA646UIBTGBZ5K25MZAWC63WYY4HVNEQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818545897 (377h37m13.701959539s) [noise=true , address=104.36.82.35:4598 , piece_id=UW7DOPZFL6TDXN4DQGL6OMEWGVF76SWE5QYB7TQFS4DL7NPAUGGA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818709190 (377h37m13.702122816s) [noise=true , address=104.36.82.12:4161 , piece_id=GAC4GFKQXQIPTEI2VPGAABDI2AYV7GZSXN4L7LY75KW2R6BXKRCQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.818886009 (377h37m13.702299638s) [noise=true , address=77.90.31.16:4758 , piece_id=E74XD4JFGC4MQXHZ4HWJ35RTVXSZL7XKNG7D2YSGHW3FD6NRC4DQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.819063767 (377h37m13.702477394s) [noise=true , address=104.36.82.44:4885 , piece_id=QWKTSS4453IJRCPI6BCY4OYUMEYQDCHI7HP45HWHPHJOQN5L4INA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.822137924 (377h37m13.705551558s) [noise=true , address=104.36.82.19:4431 , piece_id=XR2KRXZS7VEII53QLWH3NP6RHZ3CL653JPNUWST4EWPOS2ZP2W3Q, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.822570534 (377h37m13.705984166s) [noise=true , address=77.90.31.14:4679 , piece_id=B5WKU3LFJC4RX5BBGISCGHGDVY2FCRUYK3LHSJPFEYIF7LSAT5NA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.822930688 (377h37m13.706344317s) [noise=true , address=77.90.31.19:4852 , piece_id=VA3E5FIKHLWK6O3I5PPDJS52MKB77JC733CVQ46WFLAGIJDVGDZA, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.823225875 (377h37m13.706639508s) [noise=true , address=77.90.31.10:4528 , piece_id=Z45WKOXUE65MKNUTAFEBOUUDNCVWPRGI7D6SPOZX7F6DVZXLQI5A, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.823562888 (377h37m13.706976522s) [noise=true , address=77.90.31.13:4653 , piece_id=7K7IYONUOVWCSQMCOZMJ4OENYB3A24WXDQJQ3YFD6X7KZRTHEQMQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.823880672 (377h37m13.707294311s) [noise=true , address=77.90.31.18:4832 , piece_id=DKEOHPYKXWZLJHPFZCERN7KVRY5AQYGZEV5YVW24PPHFKRGY7RAQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.824210482 (377h37m13.707624099s) [noise=true , address=156.146.43.225:4449 , piece_id=H4TXOQLWVMT6CLQMMFKXP2QLPDIPVUVE2TRMGIXJX3JZWHQJUN3Q, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:13.824584706 (377h37m13.707998336s) [noise=true , address=104.36.82.50:4037 , piece_id=JSQH5SHZVBZJPVB7W2CPQCX7LOU7GKXM3CBKE7N52BXVXBEF3JTQ, seg_pos={0 0}, upload=301971]: Uploading piece... Jul 9 02:48:14.400917506 (377h37m14.284331136s) [upload=301971]: Next returned nil segment Jul 9 02:48:14.400948865 (377h37m14.284362476s) [upload=301971]: Waiting for error group managing segments... Jul 9 02:48:14.539683847 (377h37m14.423097475s) [noise=true , address=77.90.31.14:4679 , piece_id=B5WKU3LFJC4RX5BBGISCGHGDVY2FCRUYK3LHSJPFEYIF7LSAT5NA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.545869119 (377h37m14.429282752s) [noise=true , address=77.90.31.16:4758 , piece_id=E74XD4JFGC4MQXHZ4HWJ35RTVXSZL7XKNG7D2YSGHW3FD6NRC4DQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.549093850 (377h37m14.432507475s) [noise=true , address=77.90.31.11:4556 , piece_id=PEV6YNDVYJ6F5ZXBLUGB5K5MXPZ4B6YISCKM44Z7DWQ3L5GLTR2Q, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.549682016 (377h37m14.433095629s) [noise=true , address=77.90.31.15:4731 , piece_id=SBKWBYURU7VZDMU3OP36HXOOA2SCXHEHUUUVJXFTQFDM6FGD3QYA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.559178891 (377h37m14.442592506s) [noise=true , address=77.90.31.19:4852 , piece_id=VA3E5FIKHLWK6O3I5PPDJS52MKB77JC733CVQ46WFLAGIJDVGDZA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.559277031 (377h37m14.442690646s) [noise=true , address=77.90.31.18:4832 , piece_id=DKEOHPYKXWZLJHPFZCERN7KVRY5AQYGZEV5YVW24PPHFKRGY7RAQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.561727156 (377h37m14.445140769s) [noise=true , address=77.90.31.10:4528 , piece_id=Z45WKOXUE65MKNUTAFEBOUUDNCVWPRGI7D6SPOZX7F6DVZXLQI5A, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.579411062 (377h37m14.462824682s) [noise=true , address=77.90.31.13:4653 , piece_id=7K7IYONUOVWCSQMCOZMJ4OENYB3A24WXDQJQ3YFD6X7KZRTHEQMQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:14.822904625 (377h37m14.706318242s) [noise=true , address=156.146.43.225:4449 , piece_id=H4TXOQLWVMT6CLQMMFKXP2QLPDIPVUVE2TRMGIXJX3JZWHQJUN3Q, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:15.096350399 (377h37m14.979764016s) [noise=true , address=79.127.205.235:4662 , piece_id=IBJFBZYO3LSKLWJLZROD2CIB7YQXTTOVYRVUKXXODKFH7AT2CEGA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:29.510157364 (377h37m29.393570992s) [noise=true , address=104.36.82.2:4763 , piece_id=ITBKWOMUINXGYF3QSKL3EA646UIBTGBZ5K25MZAWC63WYY4HVNEQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:39.632164275 (377h37m39.515577891s) [noise=true , address=104.36.82.12:4161 , piece_id=GAC4GFKQXQIPTEI2VPGAABDI2AYV7GZSXN4L7LY75KW2R6BXKRCQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:48:44.469621505 (377h37m44.35303512s) [noise=true , address=104.36.82.19:4431 , piece_id=XR2KRXZS7VEII53QLWH3NP6RHZ3CL653JPNUWST4EWPOS2ZP2W3Q, seg_pos={0 0}, upload=301971]: Done uploading piece. err: <nil> Jul 9 02:49:13.355633183 (377h38m13.23904681s) [noise=true , address=104.36.82.44:4885 , piece_id=QWKTSS4453IJRCPI6BCY4OYUMEYQDCHI7HP45HWHPHJOQN5L4INA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG, address:104.36.82.44:4885): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 02:49:13.355804399 (377h38m13.239218012s) [noise=true , address=104.36.82.35:4598 , piece_id=UW7DOPZFL6TDXN4DQGL6OMEWGVF76SWE5QYB7TQFS4DL7NPAUGGA, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:1hJMMH7ft1vWUYnQeugCHmuYGHd2wnMRm44KyMg997BZajJb3M, address:104.36.82.35:4598): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 02:49:13.355849615 (377h38m13.239263241s) [noise=true , address=104.36.82.40:4955 , piece_id=3AO226MG7GQ4VJGTFCQKJV7LADBDR52DHIBDWDKACYQQOQDJLWMQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:12ssLq5bo7og4z8ZPd28f2H6WUExsWohBBZUnciGaH5KKpcQ25d, address:104.36.82.40:4955): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 02:49:13.355894817 (377h38m13.239308443s) [noise=true , address=104.36.82.50:4037 , piece_id=JSQH5SHZVBZJPVB7W2CPQCX7LOU7GKXM3CBKE7N52BXVXBEF3JTQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:14gJ4XfdRiFLVEixdjSP5QB8F9toGcb6xoxP7kXxX1vXJm5TDg, address:104.36.82.50:4037): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 02:49:13.355988218 (377h38m13.239401844s) [noise=true , address=104.36.82.38:4696 , piece_id=QSUPCFVH2E2AR2AY5AO6X4KBNPTUTYDNM4U53PEGJYWDAPH4BPBQ, seg_pos={0 0}, upload=301971]: Done uploading piece. err: ecclient: upload failed (node:1JrFvHgEHVLtwK3QYvFTzASCysBCR38qA4Ni8Jvrb1rXUaFy3H, address:104.36.82.38:4696): protocol: write tcp 139.59.144.22:47232->104.36.82.38:4696: use of closed network connection; write tcp 139.59.144.22:47232->104.36.82.38:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47232->104.36.82.38:4696: use of closed network connection Jul 9 02:49:13.356007346 (377h38m13.239420978s) [seg_pos={0 0}, upload=301971]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 02:49:13.464380779 (377h38m13.347794407s) [upload=301971]: Done uploading segments... Jul 9 02:49:13.464449732 (377h38m13.347863348s) [upload=301971]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.44642777s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 6 out of 60 is failed (threshold=3) [X....X..X.X.X.X.............................................] duration: 2.833812527s FAIL (2025-07-09 03:26:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.83383828s edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)