Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 3.026380253s trace: https://jaeger.dev.storj.io/trace/42206651daeeda15 FAIL (2025-11-14 03:17:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.026403106s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.98257917s trace: https://jaeger.dev.storj.io/trace/42206651daeeda15 FAIL (2025-11-14 03:16:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.982613743s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.900402928s trace: https://jaeger.dev.storj.io/trace/42206651daeeda15 FAIL (2025-11-14 03:16:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.900425979s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 3.150773664s trace: https://jaeger.dev.storj.io/trace/42206651daeeda15 FAIL (2025-11-14 03:15:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.150872496s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.847502408s trace: https://jaeger.dev.storj.io/trace/42206651daeeda15 FAIL (2025-11-14 03:13:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.847530176s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.95761565s trace: https://jaeger.dev.storj.io/trace/42206651daeeda15 FAIL (2025-11-14 03:13:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.957638245s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.882743253s trace: https://jaeger.dev.storj.io/trace/42206651daeeda15 FAIL (2025-11-14 03:12:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.882782319s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 3.052066734s trace: https://jaeger.dev.storj.io/trace/42206651daeeda15 FAIL (2025-11-14 03:12:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.052096497s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.988883532s trace: https://jaeger.dev.storj.io/trace/42206651daeeda15 FAIL (2025-11-14 03:12:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.988917569s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.858789774s trace: https://jaeger.dev.storj.io/trace/42206651daeeda15 FAIL (2025-11-14 03:10:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.858813511s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.717299805s trace: https://jaeger.dev.storj.io/trace/42206651daeeda15 FAIL (2025-11-14 03:10:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.717333418s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.90826632s trace: https://jaeger.dev.storj.io/trace/42206651daeeda15 FAIL (2025-11-14 03:10:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.908369008s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.997684245s trace: https://jaeger.dev.storj.io/trace/42206651daeeda15 FAIL (2025-11-14 03:09:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.997704761s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.915325525s trace: https://jaeger.dev.storj.io/trace/42206651daeeda15 FAIL (2025-11-14 03:08:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.915354571s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.972828225s trace: https://jaeger.dev.storj.io/trace/42206651daeeda15 FAIL (2025-11-14 03:07:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.972857727s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.782403642s trace: https://jaeger.dev.storj.io/trace/42206651daeeda15 FAIL (2025-11-14 03:06:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.782435454s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.905913021s trace: https://jaeger.dev.storj.io/trace/42206651daeeda15 FAIL (2025-11-14 03:04:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.905941389s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.983655834s trace: https://jaeger.dev.storj.io/trace/42206651daeeda15 FAIL (2025-11-14 03:04:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.983687294s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 3.032533202s trace: https://jaeger.dev.storj.io/trace/42206651daeeda15 FAIL (2025-11-14 03:03:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.032563061s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.976314878s trace: https://jaeger.dev.storj.io/trace/42206651daeeda15 FAIL (2025-11-14 03:02:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.976341783s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.925647077s trace: https://jaeger.dev.storj.io/trace/42206651daeeda15 FAIL (2025-11-14 03:02:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.926346515s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.950549112s trace: https://jaeger.dev.storj.io/trace/42206651daeeda15 FAIL (2025-11-14 03:02:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.950579777s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.879183403s trace: https://jaeger.dev.storj.io/trace/42206651daeeda15 FAIL (2025-11-14 03:01:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.879214089s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 3.033084338s trace: https://jaeger.dev.storj.io/trace/42206651daeeda15 FAIL (2025-11-14 03:00:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.033105894s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 3.019542848s trace: https://jaeger.dev.storj.io/trace/42206651daeeda15 FAIL (2025-11-14 03:00:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.019599392s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.886532387s trace: https://jaeger.dev.storj.io/trace/42206651daeeda15 FAIL (2025-11-14 02:59:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.88655127s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.000932692s trace: https://jaeger.dev.storj.io/trace/42206651daeeda15 FAIL (2025-11-14 02:59:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001079462s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 478.04661ms trace: https://jaeger.dev.storj.io/trace/2e8c315807960d64 FAIL (2025-11-14 00:22:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments... Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments... Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 478.079209ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 500.038973ms trace: https://jaeger.dev.storj.io/trace/2e8c315807960d64 FAIL (2025-11-14 00:21:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments... Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments... Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 500.086091ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 461.360331ms trace: https://jaeger.dev.storj.io/trace/2e8c315807960d64 FAIL (2025-11-14 00:20:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments... Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments... Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 461.399942ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 508.421771ms trace: https://jaeger.dev.storj.io/trace/2e8c315807960d64 FAIL (2025-11-14 00:19:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments... Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments... Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 508.451056ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 993.912716ms trace: https://jaeger.dev.storj.io/trace/2e8c315807960d64 FAIL (2025-11-14 00:19:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments... Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments... Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 993.940695ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 517.547601ms trace: https://jaeger.dev.storj.io/trace/2e8c315807960d64 FAIL (2025-11-14 00:18:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments... Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments... Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 517.583318ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 1.00304588s trace: https://jaeger.dev.storj.io/trace/2e8c315807960d64 FAIL (2025-11-14 00:17:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments... Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments... Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 1.003063669s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 487.465537ms trace: https://jaeger.dev.storj.io/trace/2e8c315807960d64 FAIL (2025-11-14 00:16:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments... Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments... Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 487.496382ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 809.658587ms trace: https://jaeger.dev.storj.io/trace/2e8c315807960d64 FAIL (2025-11-14 00:16:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments... Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments... Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 809.745321ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 444.42752ms trace: https://jaeger.dev.storj.io/trace/2e8c315807960d64 FAIL (2025-11-14 00:15:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments... Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments... Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 444.474016ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 553.266216ms trace: https://jaeger.dev.storj.io/trace/2e8c315807960d64 FAIL (2025-11-14 00:15:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments... Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments... Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 553.296187ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 931.888766ms trace: https://jaeger.dev.storj.io/trace/2e8c315807960d64 FAIL (2025-11-14 00:13:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments... Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments... Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 931.923035ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 468.86401ms trace: https://jaeger.dev.storj.io/trace/2e8c315807960d64 FAIL (2025-11-14 00:13:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments... Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments... Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 468.916622ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 660.243959ms trace: https://jaeger.dev.storj.io/trace/2e8c315807960d64 FAIL (2025-11-14 00:12:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments... Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments... Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 660.277211ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 493.676327ms trace: https://jaeger.dev.storj.io/trace/2e8c315807960d64 FAIL (2025-11-14 00:11:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments... Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments... Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 493.704532ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 417.814211ms trace: https://jaeger.dev.storj.io/trace/2e8c315807960d64 FAIL (2025-11-14 00:10:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments... Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments... Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 417.844651ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 986.744861ms trace: https://jaeger.dev.storj.io/trace/2e8c315807960d64 FAIL (2025-11-14 00:10:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments... Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments... Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 986.777034ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 677.637287ms trace: https://jaeger.dev.storj.io/trace/2e8c315807960d64 FAIL (2025-11-14 00:09:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments... Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments... Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 677.771674ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 995.004742ms trace: https://jaeger.dev.storj.io/trace/2e8c315807960d64 FAIL (2025-11-14 00:08:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments... Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments... Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 995.035002ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 956.433692ms trace: https://jaeger.dev.storj.io/trace/2e8c315807960d64 FAIL (2025-11-14 00:08:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments... Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments... Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 956.509402ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 954.21664ms trace: https://jaeger.dev.storj.io/trace/2e8c315807960d64 FAIL (2025-11-14 00:07:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments... Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments... Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 954.269388ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 961.400418ms trace: https://jaeger.dev.storj.io/trace/2e8c315807960d64 FAIL (2025-11-14 00:06:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments... Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments... Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 961.443251ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 1.015209493s trace: https://jaeger.dev.storj.io/trace/2e8c315807960d64 FAIL (2025-11-14 00:05:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece... Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments... Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil> Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments... Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 1.015240815s core uplink eu-select-1 eu1-placement-15

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)