Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.845692571s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 08:01:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.845723756s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 3.222359639s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 08:00:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.222392108s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.596764842s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:59:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.596800247s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.660964775s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:58:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.660996481s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.822264206s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:58:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.822290977s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.698796133s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:57:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.698827243s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.701284235s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:56:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.701337681s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.723011003s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:55:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.723057111s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 3.085533949s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:55:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.085608745s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.608752609s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:54:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.608959573s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.646886664s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:53:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.646904988s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.521383037s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:53:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.521414655s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.652357142s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:52:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.652392514s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.790674561s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:51:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.790710081s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.628728864s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:50:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.628760199s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.666907486s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:49:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.666948621s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.814294286s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:48:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.81432326s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.724463965s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:48:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.724488934s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.527544918s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:47:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.527606344s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.55955702s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:45:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.560288607s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.619990333s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:45:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.620023909s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.514815093s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:43:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.514849716s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.550878776s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:43:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.551158652s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.697847578s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:43:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.697898178s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.655668696s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:42:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.655696383s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.929553513s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:42:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.929623157s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.67511734s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:41:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.67516829s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.68903766s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:40:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.689075004s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.675110773s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:39:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.675199939s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.642952868s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:39:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.642978387s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.614969894s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:38:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.615004915s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.531870899s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:37:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.531903941s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.897358969s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:36:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.897456734s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.727264982s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:36:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.727373247s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.753825401s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:36:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.753844546s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 3.038107123s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:35:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.038138643s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.709299693s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:34:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.709388339s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.55492345s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:33:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.554970019s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.555174473s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:32:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.555209681s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.807284661s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:31:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.807304249s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.695348992s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:30:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.695383063s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.625363868s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:29:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.625396775s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.000752283s trace: https://jaeger.dev.storj.io/trace/7b3fce0eb640e2a6 FAIL (2025-11-10 07:29:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000861856s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.419437952s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:50:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.419518666s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.414642337s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:50:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.414678942s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.317218557s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:49:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.317248569s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.407622167s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:48:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.407656677s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.416983611s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:48:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.417014676s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.353140781s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:47:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.353187849s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.28131055s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:47:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.281336103s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)