Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 190366 reports (Page 342 of 3808)
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................]
duration:
2.633628341s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:42:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.63364433s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................]
duration:
2.852091126s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:41:18 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.852115086s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................]
duration:
2.596076623s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:40:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.596105918s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................]
duration:
2.733821566s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:39:50 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.733843003s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................]
duration:
2.738587721s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:38:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.738611996s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................]
duration:
2.684161335s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:38:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.684201519s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................]
duration:
2.728683602s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:38:08 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.728704593s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................]
duration:
2.822326452s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:36:56 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.82235254s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................]
duration:
2.730919437s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:35:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.730946021s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................]
duration:
2.726545596s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:34:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.726577078s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................]
duration:
2.718390842s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:33:47 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.718412632s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................]
duration:
2.690384605s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:32:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.690487806s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................]
duration:
2.861667671s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:31:55 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.861714522s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................]
duration:
2.572325821s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:31:20 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.572441633s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................]
duration:
2.704338359s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:30:50 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.704362528s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................]
duration:
2.881783424s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:29:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.881805954s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................]
duration:
2.760887816s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:29:15 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.76091552s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................]
duration:
2.74075679s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:28:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.740780188s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration:
2.830937138s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:27:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.830969167s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................]
duration:
2.834073609s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:26:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.834102548s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............]
duration:
2.690410545s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:25:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.690437205s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration:
2.544386454s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:25:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.54441041s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration:
2.8084464s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:24:17 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.808471369s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............]
duration:
2.642359491s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:23:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.642382923s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........]
duration:
2.74972007s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:23:17 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.749744124s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration:
2.856080047s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:22:15 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.856095397s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration:
2.72758194s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:21:05 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.727608221s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........]
duration:
2.8660863s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:20:37 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.866115624s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration:
2.636385972s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:19:56 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.63641148s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
2.749323599s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:19:36 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.749384224s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
2.845256944s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:19:12 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.84528039s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
2.890569315s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:18:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.890593209s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
2.731620145s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:17:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.731650968s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration:
2.748383088s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:16:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.748416853s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration:
2.731508713s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:16:14 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.731536779s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
30.001023988s
trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:15:53 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001048125s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................]
duration:
419.901549ms
trace:
https://jaeger.dev.storj.io/trace/70994c85f165c3a0
FAIL (2025-11-16 18:56:03 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce...
Nov 16 18:11:56.176141393 (128h27m41.53480005s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176505694 (128h27m41.535164346s) [noise=true , address=81.171.14.70:4029    , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176694869 (128h27m41.535353535s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176906560 (128h27m41.535565213s) [noise=true , address=81.171.14.70:4034    , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178010924 (128h27m41.536669583s) [noise=true , address=81.171.14.70:4041    , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178162029 (128h27m41.53682069s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178624747 (128h27m41.537283407s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.179822806 (128h27m41.538481511s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.181092396 (128h27m41.539751055s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.182267056 (128h27m41.540925728s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.298224599 (128h27m41.656883262s) [upload=113070]: Next returned nil segment
Nov 16 18:11:56.298240977 (128h27m41.656899643s) [upload=113070]: Waiting for error group managing segments...
Nov 16 18:11:56.322992573 (128h27m41.681651228s) [noise=true , address=81.171.14.70:4031    , piece_id=WMGGCRBCTQTVREBKXGD37YVKTKSK2P5SFJV5LH2MGFI3RJXONTKQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.326677846 (128h27m41.6853365s) [noise=true , address=81.171.14.70:4033    , piece_id=UR3UBNCMPQSDNMI44MKZ34MRQ4MYPCLHGWGWNDEPVNJ3GGFDULDQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.327086439 (128h27m41.685745102s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330596159 (128h27m41.689254822s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330894325 (128h27m41.689552985s) [noise=true , address=185.167.204.205:4016 , piece_id=XTDJJJHRNTXLU4D3HJ4OCP2UQR6RF6KHCU6OWSQAPI2Q6SONPKYA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331200302 (128h27m41.689858955s) [noise=true , address=185.167.204.205:4019 , piece_id=LJCJSOQLF4FSLVI7G753ZYDJW6VJJIQCOESIN4KVUHQ36NPZZOHQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331708487 (128h27m41.69036714s) [noise=true , address=185.167.204.206:4061 , piece_id=VWC7K7VZIUF3B47V3XQKWG4WRWFIZSCI4QOW24JI5RC77KZ2VKNQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331819138 (128h27m41.690477798s) [noise=true , address=185.167.204.205:4002 , piece_id=NL2FGXMOTSJRIS7O4ZBTIE2636T4UBL4TBWO3YMA7LCKNTSDGYSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334312534 (128h27m41.692971206s) [noise=true , address=185.167.204.205:4031 , piece_id=J2H4MRWYBVR3FYDVOB7BHQV3XJ2PBXPBKTGIS5SK6N76DDQI3VJA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334376547 (128h27m41.693035205s) [noise=true , address=81.171.14.70:4034    , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334837583 (128h27m41.693496245s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.335363984 (128h27m41.694022646s) [noise=true , address=185.167.204.205:4005 , piece_id=VFVSPAC4QXC5RDOZWH5HS5GLIXCOSRJN67KX65IXBZD2WGULIAJQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.338489129 (128h27m41.697147785s) [noise=true , address=185.167.204.206:4039 , piece_id=S24WYTQCI7XAYTNW5CO6APLU3RRGU4AEJIANW3I5KT5CUHTP5WFQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.340260145 (128h27m41.698918799s) [noise=true , address=81.171.14.70:4040    , piece_id=4YLPSBJNFFRY4KJQRXR4FYNLV4DFOEO6SHIZGTJMSAUHRB4DTBWA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.342507930 (128h27m41.701166584s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.343055650 (128h27m41.701714293s) [noise=true , address=185.167.204.205:4024 , piece_id=EAG5CMHBVOSIFI2WFCQIXQFNGYU4ATNHUUIBQKYKM6B6XETO63YQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.346735021 (128h27m41.705393678s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.348599199 (128h27m41.707257859s) [noise=true , address=185.167.204.206:4051 , piece_id=3OFN2SAZSTHRRM4SNHQCU2IEVOCXMA3BZOLS2YNULUJ5IHFQQSPA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.349247455 (128h27m41.707906114s) [noise=true , address=89.149.201.147:4023  , piece_id=O533J4NWGNLHIAD4SA7VWCHP4WF7GGB33AG4EPFIUMZIVSMCZLSQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.355006125 (128h27m41.713664782s) [noise=true , address=185.167.204.205:4033 , piece_id=SWXEHUBOBIUDILZLZ2NC5G7MGHFPOWU2ZPODJAJV6NFUAYBUYZXQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.360471308 (128h27m41.719129963s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.374029787 (128h27m41.73268843s) [noise=true , address=89.149.201.147:4009  , piece_id=SEU3XXEIWPXZAES7EPYAZQTCKXCOEE7S6CLFL3SZZA3MTBNSMG2A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.789361201 (128h27m42.14801986s) [noise=true , address=81.171.14.70:4030    , piece_id=EPDZQGCWBKEEGW2EMHFP4FVUH4ZCOWFRRVJHH63TX7DF6BUELUIQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.804954891 (128h27m42.163613548s) [noise=true , address=81.171.14.70:4029    , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.805830432 (128h27m42.164489092s) [noise=true , address=81.171.14.70:4041    , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813392799 (128h27m42.172051464s) [noise=true , address=89.149.201.147:4015  , piece_id=W7BFUW3BP7ZK6RTZMKRDLTDIUSA5Y6HA3YXWDPB3MRD3RXDVYZKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813434571 (128h27m42.172093236s) [seg_pos={0 0}, upload=113070]: Segment reached optimal threshold of 26 pieces.
Nov 16 18:11:56.813848675 (128h27m42.172507339s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813864049 (128h27m42.172522714s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813894323 (128h27m42.172552985s) [noise=true , address=89.149.201.147:4022  , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813935878 (128h27m42.172594551s) [noise=true , address=89.149.201.147:4022  , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813968221 (128h27m42.172626877s) [seg_pos={0 0}, upload=113070]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 16 18:11:56.814067848 (128h27m42.172726507s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 16 18:11:56.814075640 (128h27m42.172734299s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 16 18:13:47.213254651 (128h29m32.571913308s) [upload=113070]: Done uploading segments...
Nov 16 18:13:47.213331906 (128h29m32.57199057s) [upload=113070]: Upload finished. err: metaclient: context deadline exceeded
Duration: 419.937207ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................]
duration:
441.911273ms
trace:
https://jaeger.dev.storj.io/trace/70994c85f165c3a0
FAIL (2025-11-16 18:55:12 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce...
Nov 16 18:11:56.176141393 (128h27m41.53480005s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176505694 (128h27m41.535164346s) [noise=true , address=81.171.14.70:4029    , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176694869 (128h27m41.535353535s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176906560 (128h27m41.535565213s) [noise=true , address=81.171.14.70:4034    , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178010924 (128h27m41.536669583s) [noise=true , address=81.171.14.70:4041    , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178162029 (128h27m41.53682069s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178624747 (128h27m41.537283407s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.179822806 (128h27m41.538481511s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.181092396 (128h27m41.539751055s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.182267056 (128h27m41.540925728s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.298224599 (128h27m41.656883262s) [upload=113070]: Next returned nil segment
Nov 16 18:11:56.298240977 (128h27m41.656899643s) [upload=113070]: Waiting for error group managing segments...
Nov 16 18:11:56.322992573 (128h27m41.681651228s) [noise=true , address=81.171.14.70:4031    , piece_id=WMGGCRBCTQTVREBKXGD37YVKTKSK2P5SFJV5LH2MGFI3RJXONTKQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.326677846 (128h27m41.6853365s) [noise=true , address=81.171.14.70:4033    , piece_id=UR3UBNCMPQSDNMI44MKZ34MRQ4MYPCLHGWGWNDEPVNJ3GGFDULDQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.327086439 (128h27m41.685745102s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330596159 (128h27m41.689254822s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330894325 (128h27m41.689552985s) [noise=true , address=185.167.204.205:4016 , piece_id=XTDJJJHRNTXLU4D3HJ4OCP2UQR6RF6KHCU6OWSQAPI2Q6SONPKYA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331200302 (128h27m41.689858955s) [noise=true , address=185.167.204.205:4019 , piece_id=LJCJSOQLF4FSLVI7G753ZYDJW6VJJIQCOESIN4KVUHQ36NPZZOHQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331708487 (128h27m41.69036714s) [noise=true , address=185.167.204.206:4061 , piece_id=VWC7K7VZIUF3B47V3XQKWG4WRWFIZSCI4QOW24JI5RC77KZ2VKNQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331819138 (128h27m41.690477798s) [noise=true , address=185.167.204.205:4002 , piece_id=NL2FGXMOTSJRIS7O4ZBTIE2636T4UBL4TBWO3YMA7LCKNTSDGYSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334312534 (128h27m41.692971206s) [noise=true , address=185.167.204.205:4031 , piece_id=J2H4MRWYBVR3FYDVOB7BHQV3XJ2PBXPBKTGIS5SK6N76DDQI3VJA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334376547 (128h27m41.693035205s) [noise=true , address=81.171.14.70:4034    , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334837583 (128h27m41.693496245s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.335363984 (128h27m41.694022646s) [noise=true , address=185.167.204.205:4005 , piece_id=VFVSPAC4QXC5RDOZWH5HS5GLIXCOSRJN67KX65IXBZD2WGULIAJQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.338489129 (128h27m41.697147785s) [noise=true , address=185.167.204.206:4039 , piece_id=S24WYTQCI7XAYTNW5CO6APLU3RRGU4AEJIANW3I5KT5CUHTP5WFQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.340260145 (128h27m41.698918799s) [noise=true , address=81.171.14.70:4040    , piece_id=4YLPSBJNFFRY4KJQRXR4FYNLV4DFOEO6SHIZGTJMSAUHRB4DTBWA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.342507930 (128h27m41.701166584s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.343055650 (128h27m41.701714293s) [noise=true , address=185.167.204.205:4024 , piece_id=EAG5CMHBVOSIFI2WFCQIXQFNGYU4ATNHUUIBQKYKM6B6XETO63YQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.346735021 (128h27m41.705393678s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.348599199 (128h27m41.707257859s) [noise=true , address=185.167.204.206:4051 , piece_id=3OFN2SAZSTHRRM4SNHQCU2IEVOCXMA3BZOLS2YNULUJ5IHFQQSPA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.349247455 (128h27m41.707906114s) [noise=true , address=89.149.201.147:4023  , piece_id=O533J4NWGNLHIAD4SA7VWCHP4WF7GGB33AG4EPFIUMZIVSMCZLSQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.355006125 (128h27m41.713664782s) [noise=true , address=185.167.204.205:4033 , piece_id=SWXEHUBOBIUDILZLZ2NC5G7MGHFPOWU2ZPODJAJV6NFUAYBUYZXQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.360471308 (128h27m41.719129963s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.374029787 (128h27m41.73268843s) [noise=true , address=89.149.201.147:4009  , piece_id=SEU3XXEIWPXZAES7EPYAZQTCKXCOEE7S6CLFL3SZZA3MTBNSMG2A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.789361201 (128h27m42.14801986s) [noise=true , address=81.171.14.70:4030    , piece_id=EPDZQGCWBKEEGW2EMHFP4FVUH4ZCOWFRRVJHH63TX7DF6BUELUIQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.804954891 (128h27m42.163613548s) [noise=true , address=81.171.14.70:4029    , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.805830432 (128h27m42.164489092s) [noise=true , address=81.171.14.70:4041    , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813392799 (128h27m42.172051464s) [noise=true , address=89.149.201.147:4015  , piece_id=W7BFUW3BP7ZK6RTZMKRDLTDIUSA5Y6HA3YXWDPB3MRD3RXDVYZKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813434571 (128h27m42.172093236s) [seg_pos={0 0}, upload=113070]: Segment reached optimal threshold of 26 pieces.
Nov 16 18:11:56.813848675 (128h27m42.172507339s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813864049 (128h27m42.172522714s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813894323 (128h27m42.172552985s) [noise=true , address=89.149.201.147:4022  , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813935878 (128h27m42.172594551s) [noise=true , address=89.149.201.147:4022  , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813968221 (128h27m42.172626877s) [seg_pos={0 0}, upload=113070]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 16 18:11:56.814067848 (128h27m42.172726507s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 16 18:11:56.814075640 (128h27m42.172734299s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 16 18:13:47.213254651 (128h29m32.571913308s) [upload=113070]: Done uploading segments...
Nov 16 18:13:47.213331906 (128h29m32.57199057s) [upload=113070]: Upload finished. err: metaclient: context deadline exceeded
Duration: 441.940495ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................]
duration:
858.423725ms
trace:
https://jaeger.dev.storj.io/trace/70994c85f165c3a0
FAIL (2025-11-16 18:54:13 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce...
Nov 16 18:11:56.176141393 (128h27m41.53480005s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176505694 (128h27m41.535164346s) [noise=true , address=81.171.14.70:4029    , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176694869 (128h27m41.535353535s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176906560 (128h27m41.535565213s) [noise=true , address=81.171.14.70:4034    , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178010924 (128h27m41.536669583s) [noise=true , address=81.171.14.70:4041    , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178162029 (128h27m41.53682069s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178624747 (128h27m41.537283407s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.179822806 (128h27m41.538481511s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.181092396 (128h27m41.539751055s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.182267056 (128h27m41.540925728s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.298224599 (128h27m41.656883262s) [upload=113070]: Next returned nil segment
Nov 16 18:11:56.298240977 (128h27m41.656899643s) [upload=113070]: Waiting for error group managing segments...
Nov 16 18:11:56.322992573 (128h27m41.681651228s) [noise=true , address=81.171.14.70:4031    , piece_id=WMGGCRBCTQTVREBKXGD37YVKTKSK2P5SFJV5LH2MGFI3RJXONTKQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.326677846 (128h27m41.6853365s) [noise=true , address=81.171.14.70:4033    , piece_id=UR3UBNCMPQSDNMI44MKZ34MRQ4MYPCLHGWGWNDEPVNJ3GGFDULDQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.327086439 (128h27m41.685745102s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330596159 (128h27m41.689254822s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330894325 (128h27m41.689552985s) [noise=true , address=185.167.204.205:4016 , piece_id=XTDJJJHRNTXLU4D3HJ4OCP2UQR6RF6KHCU6OWSQAPI2Q6SONPKYA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331200302 (128h27m41.689858955s) [noise=true , address=185.167.204.205:4019 , piece_id=LJCJSOQLF4FSLVI7G753ZYDJW6VJJIQCOESIN4KVUHQ36NPZZOHQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331708487 (128h27m41.69036714s) [noise=true , address=185.167.204.206:4061 , piece_id=VWC7K7VZIUF3B47V3XQKWG4WRWFIZSCI4QOW24JI5RC77KZ2VKNQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331819138 (128h27m41.690477798s) [noise=true , address=185.167.204.205:4002 , piece_id=NL2FGXMOTSJRIS7O4ZBTIE2636T4UBL4TBWO3YMA7LCKNTSDGYSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334312534 (128h27m41.692971206s) [noise=true , address=185.167.204.205:4031 , piece_id=J2H4MRWYBVR3FYDVOB7BHQV3XJ2PBXPBKTGIS5SK6N76DDQI3VJA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334376547 (128h27m41.693035205s) [noise=true , address=81.171.14.70:4034    , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334837583 (128h27m41.693496245s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.335363984 (128h27m41.694022646s) [noise=true , address=185.167.204.205:4005 , piece_id=VFVSPAC4QXC5RDOZWH5HS5GLIXCOSRJN67KX65IXBZD2WGULIAJQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.338489129 (128h27m41.697147785s) [noise=true , address=185.167.204.206:4039 , piece_id=S24WYTQCI7XAYTNW5CO6APLU3RRGU4AEJIANW3I5KT5CUHTP5WFQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.340260145 (128h27m41.698918799s) [noise=true , address=81.171.14.70:4040    , piece_id=4YLPSBJNFFRY4KJQRXR4FYNLV4DFOEO6SHIZGTJMSAUHRB4DTBWA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.342507930 (128h27m41.701166584s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.343055650 (128h27m41.701714293s) [noise=true , address=185.167.204.205:4024 , piece_id=EAG5CMHBVOSIFI2WFCQIXQFNGYU4ATNHUUIBQKYKM6B6XETO63YQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.346735021 (128h27m41.705393678s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.348599199 (128h27m41.707257859s) [noise=true , address=185.167.204.206:4051 , piece_id=3OFN2SAZSTHRRM4SNHQCU2IEVOCXMA3BZOLS2YNULUJ5IHFQQSPA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.349247455 (128h27m41.707906114s) [noise=true , address=89.149.201.147:4023  , piece_id=O533J4NWGNLHIAD4SA7VWCHP4WF7GGB33AG4EPFIUMZIVSMCZLSQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.355006125 (128h27m41.713664782s) [noise=true , address=185.167.204.205:4033 , piece_id=SWXEHUBOBIUDILZLZ2NC5G7MGHFPOWU2ZPODJAJV6NFUAYBUYZXQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.360471308 (128h27m41.719129963s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.374029787 (128h27m41.73268843s) [noise=true , address=89.149.201.147:4009  , piece_id=SEU3XXEIWPXZAES7EPYAZQTCKXCOEE7S6CLFL3SZZA3MTBNSMG2A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.789361201 (128h27m42.14801986s) [noise=true , address=81.171.14.70:4030    , piece_id=EPDZQGCWBKEEGW2EMHFP4FVUH4ZCOWFRRVJHH63TX7DF6BUELUIQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.804954891 (128h27m42.163613548s) [noise=true , address=81.171.14.70:4029    , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.805830432 (128h27m42.164489092s) [noise=true , address=81.171.14.70:4041    , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813392799 (128h27m42.172051464s) [noise=true , address=89.149.201.147:4015  , piece_id=W7BFUW3BP7ZK6RTZMKRDLTDIUSA5Y6HA3YXWDPB3MRD3RXDVYZKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813434571 (128h27m42.172093236s) [seg_pos={0 0}, upload=113070]: Segment reached optimal threshold of 26 pieces.
Nov 16 18:11:56.813848675 (128h27m42.172507339s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813864049 (128h27m42.172522714s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813894323 (128h27m42.172552985s) [noise=true , address=89.149.201.147:4022  , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813935878 (128h27m42.172594551s) [noise=true , address=89.149.201.147:4022  , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813968221 (128h27m42.172626877s) [seg_pos={0 0}, upload=113070]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 16 18:11:56.814067848 (128h27m42.172726507s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 16 18:11:56.814075640 (128h27m42.172734299s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 16 18:13:47.213254651 (128h29m32.571913308s) [upload=113070]: Done uploading segments...
Nov 16 18:13:47.213331906 (128h29m32.57199057s) [upload=113070]: Upload finished. err: metaclient: context deadline exceeded
Duration: 858.468854ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................]
duration:
431.474635ms
trace:
https://jaeger.dev.storj.io/trace/70994c85f165c3a0
FAIL (2025-11-16 18:53:04 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce...
Nov 16 18:11:56.176141393 (128h27m41.53480005s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176505694 (128h27m41.535164346s) [noise=true , address=81.171.14.70:4029    , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176694869 (128h27m41.535353535s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176906560 (128h27m41.535565213s) [noise=true , address=81.171.14.70:4034    , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178010924 (128h27m41.536669583s) [noise=true , address=81.171.14.70:4041    , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178162029 (128h27m41.53682069s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178624747 (128h27m41.537283407s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.179822806 (128h27m41.538481511s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.181092396 (128h27m41.539751055s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.182267056 (128h27m41.540925728s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.298224599 (128h27m41.656883262s) [upload=113070]: Next returned nil segment
Nov 16 18:11:56.298240977 (128h27m41.656899643s) [upload=113070]: Waiting for error group managing segments...
Nov 16 18:11:56.322992573 (128h27m41.681651228s) [noise=true , address=81.171.14.70:4031    , piece_id=WMGGCRBCTQTVREBKXGD37YVKTKSK2P5SFJV5LH2MGFI3RJXONTKQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.326677846 (128h27m41.6853365s) [noise=true , address=81.171.14.70:4033    , piece_id=UR3UBNCMPQSDNMI44MKZ34MRQ4MYPCLHGWGWNDEPVNJ3GGFDULDQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.327086439 (128h27m41.685745102s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330596159 (128h27m41.689254822s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330894325 (128h27m41.689552985s) [noise=true , address=185.167.204.205:4016 , piece_id=XTDJJJHRNTXLU4D3HJ4OCP2UQR6RF6KHCU6OWSQAPI2Q6SONPKYA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331200302 (128h27m41.689858955s) [noise=true , address=185.167.204.205:4019 , piece_id=LJCJSOQLF4FSLVI7G753ZYDJW6VJJIQCOESIN4KVUHQ36NPZZOHQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331708487 (128h27m41.69036714s) [noise=true , address=185.167.204.206:4061 , piece_id=VWC7K7VZIUF3B47V3XQKWG4WRWFIZSCI4QOW24JI5RC77KZ2VKNQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331819138 (128h27m41.690477798s) [noise=true , address=185.167.204.205:4002 , piece_id=NL2FGXMOTSJRIS7O4ZBTIE2636T4UBL4TBWO3YMA7LCKNTSDGYSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334312534 (128h27m41.692971206s) [noise=true , address=185.167.204.205:4031 , piece_id=J2H4MRWYBVR3FYDVOB7BHQV3XJ2PBXPBKTGIS5SK6N76DDQI3VJA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334376547 (128h27m41.693035205s) [noise=true , address=81.171.14.70:4034    , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334837583 (128h27m41.693496245s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.335363984 (128h27m41.694022646s) [noise=true , address=185.167.204.205:4005 , piece_id=VFVSPAC4QXC5RDOZWH5HS5GLIXCOSRJN67KX65IXBZD2WGULIAJQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.338489129 (128h27m41.697147785s) [noise=true , address=185.167.204.206:4039 , piece_id=S24WYTQCI7XAYTNW5CO6APLU3RRGU4AEJIANW3I5KT5CUHTP5WFQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.340260145 (128h27m41.698918799s) [noise=true , address=81.171.14.70:4040    , piece_id=4YLPSBJNFFRY4KJQRXR4FYNLV4DFOEO6SHIZGTJMSAUHRB4DTBWA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.342507930 (128h27m41.701166584s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.343055650 (128h27m41.701714293s) [noise=true , address=185.167.204.205:4024 , piece_id=EAG5CMHBVOSIFI2WFCQIXQFNGYU4ATNHUUIBQKYKM6B6XETO63YQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.346735021 (128h27m41.705393678s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.348599199 (128h27m41.707257859s) [noise=true , address=185.167.204.206:4051 , piece_id=3OFN2SAZSTHRRM4SNHQCU2IEVOCXMA3BZOLS2YNULUJ5IHFQQSPA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.349247455 (128h27m41.707906114s) [noise=true , address=89.149.201.147:4023  , piece_id=O533J4NWGNLHIAD4SA7VWCHP4WF7GGB33AG4EPFIUMZIVSMCZLSQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.355006125 (128h27m41.713664782s) [noise=true , address=185.167.204.205:4033 , piece_id=SWXEHUBOBIUDILZLZ2NC5G7MGHFPOWU2ZPODJAJV6NFUAYBUYZXQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.360471308 (128h27m41.719129963s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.374029787 (128h27m41.73268843s) [noise=true , address=89.149.201.147:4009  , piece_id=SEU3XXEIWPXZAES7EPYAZQTCKXCOEE7S6CLFL3SZZA3MTBNSMG2A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.789361201 (128h27m42.14801986s) [noise=true , address=81.171.14.70:4030    , piece_id=EPDZQGCWBKEEGW2EMHFP4FVUH4ZCOWFRRVJHH63TX7DF6BUELUIQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.804954891 (128h27m42.163613548s) [noise=true , address=81.171.14.70:4029    , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.805830432 (128h27m42.164489092s) [noise=true , address=81.171.14.70:4041    , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813392799 (128h27m42.172051464s) [noise=true , address=89.149.201.147:4015  , piece_id=W7BFUW3BP7ZK6RTZMKRDLTDIUSA5Y6HA3YXWDPB3MRD3RXDVYZKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813434571 (128h27m42.172093236s) [seg_pos={0 0}, upload=113070]: Segment reached optimal threshold of 26 pieces.
Nov 16 18:11:56.813848675 (128h27m42.172507339s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813864049 (128h27m42.172522714s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813894323 (128h27m42.172552985s) [noise=true , address=89.149.201.147:4022  , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813935878 (128h27m42.172594551s) [noise=true , address=89.149.201.147:4022  , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813968221 (128h27m42.172626877s) [seg_pos={0 0}, upload=113070]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 16 18:11:56.814067848 (128h27m42.172726507s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 16 18:11:56.814075640 (128h27m42.172734299s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 16 18:13:47.213254651 (128h29m32.571913308s) [upload=113070]: Done uploading segments...
Nov 16 18:13:47.213331906 (128h29m32.57199057s) [upload=113070]: Upload finished. err: metaclient: context deadline exceeded
Duration: 431.563433ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................]
duration:
610.651282ms
trace:
https://jaeger.dev.storj.io/trace/70994c85f165c3a0
FAIL (2025-11-16 18:52:23 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce...
Nov 16 18:11:56.176141393 (128h27m41.53480005s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176505694 (128h27m41.535164346s) [noise=true , address=81.171.14.70:4029    , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176694869 (128h27m41.535353535s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176906560 (128h27m41.535565213s) [noise=true , address=81.171.14.70:4034    , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178010924 (128h27m41.536669583s) [noise=true , address=81.171.14.70:4041    , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178162029 (128h27m41.53682069s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178624747 (128h27m41.537283407s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.179822806 (128h27m41.538481511s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.181092396 (128h27m41.539751055s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.182267056 (128h27m41.540925728s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.298224599 (128h27m41.656883262s) [upload=113070]: Next returned nil segment
Nov 16 18:11:56.298240977 (128h27m41.656899643s) [upload=113070]: Waiting for error group managing segments...
Nov 16 18:11:56.322992573 (128h27m41.681651228s) [noise=true , address=81.171.14.70:4031    , piece_id=WMGGCRBCTQTVREBKXGD37YVKTKSK2P5SFJV5LH2MGFI3RJXONTKQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.326677846 (128h27m41.6853365s) [noise=true , address=81.171.14.70:4033    , piece_id=UR3UBNCMPQSDNMI44MKZ34MRQ4MYPCLHGWGWNDEPVNJ3GGFDULDQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.327086439 (128h27m41.685745102s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330596159 (128h27m41.689254822s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330894325 (128h27m41.689552985s) [noise=true , address=185.167.204.205:4016 , piece_id=XTDJJJHRNTXLU4D3HJ4OCP2UQR6RF6KHCU6OWSQAPI2Q6SONPKYA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331200302 (128h27m41.689858955s) [noise=true , address=185.167.204.205:4019 , piece_id=LJCJSOQLF4FSLVI7G753ZYDJW6VJJIQCOESIN4KVUHQ36NPZZOHQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331708487 (128h27m41.69036714s) [noise=true , address=185.167.204.206:4061 , piece_id=VWC7K7VZIUF3B47V3XQKWG4WRWFIZSCI4QOW24JI5RC77KZ2VKNQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331819138 (128h27m41.690477798s) [noise=true , address=185.167.204.205:4002 , piece_id=NL2FGXMOTSJRIS7O4ZBTIE2636T4UBL4TBWO3YMA7LCKNTSDGYSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334312534 (128h27m41.692971206s) [noise=true , address=185.167.204.205:4031 , piece_id=J2H4MRWYBVR3FYDVOB7BHQV3XJ2PBXPBKTGIS5SK6N76DDQI3VJA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334376547 (128h27m41.693035205s) [noise=true , address=81.171.14.70:4034    , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334837583 (128h27m41.693496245s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.335363984 (128h27m41.694022646s) [noise=true , address=185.167.204.205:4005 , piece_id=VFVSPAC4QXC5RDOZWH5HS5GLIXCOSRJN67KX65IXBZD2WGULIAJQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.338489129 (128h27m41.697147785s) [noise=true , address=185.167.204.206:4039 , piece_id=S24WYTQCI7XAYTNW5CO6APLU3RRGU4AEJIANW3I5KT5CUHTP5WFQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.340260145 (128h27m41.698918799s) [noise=true , address=81.171.14.70:4040    , piece_id=4YLPSBJNFFRY4KJQRXR4FYNLV4DFOEO6SHIZGTJMSAUHRB4DTBWA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.342507930 (128h27m41.701166584s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.343055650 (128h27m41.701714293s) [noise=true , address=185.167.204.205:4024 , piece_id=EAG5CMHBVOSIFI2WFCQIXQFNGYU4ATNHUUIBQKYKM6B6XETO63YQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.346735021 (128h27m41.705393678s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.348599199 (128h27m41.707257859s) [noise=true , address=185.167.204.206:4051 , piece_id=3OFN2SAZSTHRRM4SNHQCU2IEVOCXMA3BZOLS2YNULUJ5IHFQQSPA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.349247455 (128h27m41.707906114s) [noise=true , address=89.149.201.147:4023  , piece_id=O533J4NWGNLHIAD4SA7VWCHP4WF7GGB33AG4EPFIUMZIVSMCZLSQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.355006125 (128h27m41.713664782s) [noise=true , address=185.167.204.205:4033 , piece_id=SWXEHUBOBIUDILZLZ2NC5G7MGHFPOWU2ZPODJAJV6NFUAYBUYZXQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.360471308 (128h27m41.719129963s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.374029787 (128h27m41.73268843s) [noise=true , address=89.149.201.147:4009  , piece_id=SEU3XXEIWPXZAES7EPYAZQTCKXCOEE7S6CLFL3SZZA3MTBNSMG2A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.789361201 (128h27m42.14801986s) [noise=true , address=81.171.14.70:4030    , piece_id=EPDZQGCWBKEEGW2EMHFP4FVUH4ZCOWFRRVJHH63TX7DF6BUELUIQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.804954891 (128h27m42.163613548s) [noise=true , address=81.171.14.70:4029    , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.805830432 (128h27m42.164489092s) [noise=true , address=81.171.14.70:4041    , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813392799 (128h27m42.172051464s) [noise=true , address=89.149.201.147:4015  , piece_id=W7BFUW3BP7ZK6RTZMKRDLTDIUSA5Y6HA3YXWDPB3MRD3RXDVYZKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813434571 (128h27m42.172093236s) [seg_pos={0 0}, upload=113070]: Segment reached optimal threshold of 26 pieces.
Nov 16 18:11:56.813848675 (128h27m42.172507339s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813864049 (128h27m42.172522714s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813894323 (128h27m42.172552985s) [noise=true , address=89.149.201.147:4022  , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813935878 (128h27m42.172594551s) [noise=true , address=89.149.201.147:4022  , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813968221 (128h27m42.172626877s) [seg_pos={0 0}, upload=113070]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 16 18:11:56.814067848 (128h27m42.172726507s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 16 18:11:56.814075640 (128h27m42.172734299s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 16 18:13:47.213254651 (128h29m32.571913308s) [upload=113070]: Done uploading segments...
Nov 16 18:13:47.213331906 (128h29m32.57199057s) [upload=113070]: Upload finished. err: metaclient: context deadline exceeded
Duration: 610.671617ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................]
duration:
845.808327ms
trace:
https://jaeger.dev.storj.io/trace/70994c85f165c3a0
FAIL (2025-11-16 18:51:44 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce...
Nov 16 18:11:56.176141393 (128h27m41.53480005s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176505694 (128h27m41.535164346s) [noise=true , address=81.171.14.70:4029    , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176694869 (128h27m41.535353535s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176906560 (128h27m41.535565213s) [noise=true , address=81.171.14.70:4034    , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178010924 (128h27m41.536669583s) [noise=true , address=81.171.14.70:4041    , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178162029 (128h27m41.53682069s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178624747 (128h27m41.537283407s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.179822806 (128h27m41.538481511s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.181092396 (128h27m41.539751055s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.182267056 (128h27m41.540925728s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.298224599 (128h27m41.656883262s) [upload=113070]: Next returned nil segment
Nov 16 18:11:56.298240977 (128h27m41.656899643s) [upload=113070]: Waiting for error group managing segments...
Nov 16 18:11:56.322992573 (128h27m41.681651228s) [noise=true , address=81.171.14.70:4031    , piece_id=WMGGCRBCTQTVREBKXGD37YVKTKSK2P5SFJV5LH2MGFI3RJXONTKQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.326677846 (128h27m41.6853365s) [noise=true , address=81.171.14.70:4033    , piece_id=UR3UBNCMPQSDNMI44MKZ34MRQ4MYPCLHGWGWNDEPVNJ3GGFDULDQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.327086439 (128h27m41.685745102s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330596159 (128h27m41.689254822s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330894325 (128h27m41.689552985s) [noise=true , address=185.167.204.205:4016 , piece_id=XTDJJJHRNTXLU4D3HJ4OCP2UQR6RF6KHCU6OWSQAPI2Q6SONPKYA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331200302 (128h27m41.689858955s) [noise=true , address=185.167.204.205:4019 , piece_id=LJCJSOQLF4FSLVI7G753ZYDJW6VJJIQCOESIN4KVUHQ36NPZZOHQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331708487 (128h27m41.69036714s) [noise=true , address=185.167.204.206:4061 , piece_id=VWC7K7VZIUF3B47V3XQKWG4WRWFIZSCI4QOW24JI5RC77KZ2VKNQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331819138 (128h27m41.690477798s) [noise=true , address=185.167.204.205:4002 , piece_id=NL2FGXMOTSJRIS7O4ZBTIE2636T4UBL4TBWO3YMA7LCKNTSDGYSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334312534 (128h27m41.692971206s) [noise=true , address=185.167.204.205:4031 , piece_id=J2H4MRWYBVR3FYDVOB7BHQV3XJ2PBXPBKTGIS5SK6N76DDQI3VJA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334376547 (128h27m41.693035205s) [noise=true , address=81.171.14.70:4034    , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334837583 (128h27m41.693496245s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.335363984 (128h27m41.694022646s) [noise=true , address=185.167.204.205:4005 , piece_id=VFVSPAC4QXC5RDOZWH5HS5GLIXCOSRJN67KX65IXBZD2WGULIAJQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.338489129 (128h27m41.697147785s) [noise=true , address=185.167.204.206:4039 , piece_id=S24WYTQCI7XAYTNW5CO6APLU3RRGU4AEJIANW3I5KT5CUHTP5WFQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.340260145 (128h27m41.698918799s) [noise=true , address=81.171.14.70:4040    , piece_id=4YLPSBJNFFRY4KJQRXR4FYNLV4DFOEO6SHIZGTJMSAUHRB4DTBWA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.342507930 (128h27m41.701166584s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.343055650 (128h27m41.701714293s) [noise=true , address=185.167.204.205:4024 , piece_id=EAG5CMHBVOSIFI2WFCQIXQFNGYU4ATNHUUIBQKYKM6B6XETO63YQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.346735021 (128h27m41.705393678s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.348599199 (128h27m41.707257859s) [noise=true , address=185.167.204.206:4051 , piece_id=3OFN2SAZSTHRRM4SNHQCU2IEVOCXMA3BZOLS2YNULUJ5IHFQQSPA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.349247455 (128h27m41.707906114s) [noise=true , address=89.149.201.147:4023  , piece_id=O533J4NWGNLHIAD4SA7VWCHP4WF7GGB33AG4EPFIUMZIVSMCZLSQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.355006125 (128h27m41.713664782s) [noise=true , address=185.167.204.205:4033 , piece_id=SWXEHUBOBIUDILZLZ2NC5G7MGHFPOWU2ZPODJAJV6NFUAYBUYZXQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.360471308 (128h27m41.719129963s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.374029787 (128h27m41.73268843s) [noise=true , address=89.149.201.147:4009  , piece_id=SEU3XXEIWPXZAES7EPYAZQTCKXCOEE7S6CLFL3SZZA3MTBNSMG2A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.789361201 (128h27m42.14801986s) [noise=true , address=81.171.14.70:4030    , piece_id=EPDZQGCWBKEEGW2EMHFP4FVUH4ZCOWFRRVJHH63TX7DF6BUELUIQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.804954891 (128h27m42.163613548s) [noise=true , address=81.171.14.70:4029    , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.805830432 (128h27m42.164489092s) [noise=true , address=81.171.14.70:4041    , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813392799 (128h27m42.172051464s) [noise=true , address=89.149.201.147:4015  , piece_id=W7BFUW3BP7ZK6RTZMKRDLTDIUSA5Y6HA3YXWDPB3MRD3RXDVYZKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813434571 (128h27m42.172093236s) [seg_pos={0 0}, upload=113070]: Segment reached optimal threshold of 26 pieces.
Nov 16 18:11:56.813848675 (128h27m42.172507339s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813864049 (128h27m42.172522714s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813894323 (128h27m42.172552985s) [noise=true , address=89.149.201.147:4022  , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813935878 (128h27m42.172594551s) [noise=true , address=89.149.201.147:4022  , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813968221 (128h27m42.172626877s) [seg_pos={0 0}, upload=113070]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 16 18:11:56.814067848 (128h27m42.172726507s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 16 18:11:56.814075640 (128h27m42.172734299s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 16 18:13:47.213254651 (128h29m32.571913308s) [upload=113070]: Done uploading segments...
Nov 16 18:13:47.213331906 (128h29m32.57199057s) [upload=113070]: Upload finished. err: metaclient: context deadline exceeded
Duration: 845.850602ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................]
duration:
388.587868ms
trace:
https://jaeger.dev.storj.io/trace/70994c85f165c3a0
FAIL (2025-11-16 18:51:18 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce...
Nov 16 18:11:56.176141393 (128h27m41.53480005s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176505694 (128h27m41.535164346s) [noise=true , address=81.171.14.70:4029    , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176694869 (128h27m41.535353535s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176906560 (128h27m41.535565213s) [noise=true , address=81.171.14.70:4034    , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178010924 (128h27m41.536669583s) [noise=true , address=81.171.14.70:4041    , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178162029 (128h27m41.53682069s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178624747 (128h27m41.537283407s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.179822806 (128h27m41.538481511s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.181092396 (128h27m41.539751055s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.182267056 (128h27m41.540925728s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.298224599 (128h27m41.656883262s) [upload=113070]: Next returned nil segment
Nov 16 18:11:56.298240977 (128h27m41.656899643s) [upload=113070]: Waiting for error group managing segments...
Nov 16 18:11:56.322992573 (128h27m41.681651228s) [noise=true , address=81.171.14.70:4031    , piece_id=WMGGCRBCTQTVREBKXGD37YVKTKSK2P5SFJV5LH2MGFI3RJXONTKQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.326677846 (128h27m41.6853365s) [noise=true , address=81.171.14.70:4033    , piece_id=UR3UBNCMPQSDNMI44MKZ34MRQ4MYPCLHGWGWNDEPVNJ3GGFDULDQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.327086439 (128h27m41.685745102s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330596159 (128h27m41.689254822s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330894325 (128h27m41.689552985s) [noise=true , address=185.167.204.205:4016 , piece_id=XTDJJJHRNTXLU4D3HJ4OCP2UQR6RF6KHCU6OWSQAPI2Q6SONPKYA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331200302 (128h27m41.689858955s) [noise=true , address=185.167.204.205:4019 , piece_id=LJCJSOQLF4FSLVI7G753ZYDJW6VJJIQCOESIN4KVUHQ36NPZZOHQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331708487 (128h27m41.69036714s) [noise=true , address=185.167.204.206:4061 , piece_id=VWC7K7VZIUF3B47V3XQKWG4WRWFIZSCI4QOW24JI5RC77KZ2VKNQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331819138 (128h27m41.690477798s) [noise=true , address=185.167.204.205:4002 , piece_id=NL2FGXMOTSJRIS7O4ZBTIE2636T4UBL4TBWO3YMA7LCKNTSDGYSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334312534 (128h27m41.692971206s) [noise=true , address=185.167.204.205:4031 , piece_id=J2H4MRWYBVR3FYDVOB7BHQV3XJ2PBXPBKTGIS5SK6N76DDQI3VJA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334376547 (128h27m41.693035205s) [noise=true , address=81.171.14.70:4034    , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334837583 (128h27m41.693496245s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.335363984 (128h27m41.694022646s) [noise=true , address=185.167.204.205:4005 , piece_id=VFVSPAC4QXC5RDOZWH5HS5GLIXCOSRJN67KX65IXBZD2WGULIAJQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.338489129 (128h27m41.697147785s) [noise=true , address=185.167.204.206:4039 , piece_id=S24WYTQCI7XAYTNW5CO6APLU3RRGU4AEJIANW3I5KT5CUHTP5WFQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.340260145 (128h27m41.698918799s) [noise=true , address=81.171.14.70:4040    , piece_id=4YLPSBJNFFRY4KJQRXR4FYNLV4DFOEO6SHIZGTJMSAUHRB4DTBWA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.342507930 (128h27m41.701166584s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.343055650 (128h27m41.701714293s) [noise=true , address=185.167.204.205:4024 , piece_id=EAG5CMHBVOSIFI2WFCQIXQFNGYU4ATNHUUIBQKYKM6B6XETO63YQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.346735021 (128h27m41.705393678s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.348599199 (128h27m41.707257859s) [noise=true , address=185.167.204.206:4051 , piece_id=3OFN2SAZSTHRRM4SNHQCU2IEVOCXMA3BZOLS2YNULUJ5IHFQQSPA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.349247455 (128h27m41.707906114s) [noise=true , address=89.149.201.147:4023  , piece_id=O533J4NWGNLHIAD4SA7VWCHP4WF7GGB33AG4EPFIUMZIVSMCZLSQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.355006125 (128h27m41.713664782s) [noise=true , address=185.167.204.205:4033 , piece_id=SWXEHUBOBIUDILZLZ2NC5G7MGHFPOWU2ZPODJAJV6NFUAYBUYZXQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.360471308 (128h27m41.719129963s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.374029787 (128h27m41.73268843s) [noise=true , address=89.149.201.147:4009  , piece_id=SEU3XXEIWPXZAES7EPYAZQTCKXCOEE7S6CLFL3SZZA3MTBNSMG2A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.789361201 (128h27m42.14801986s) [noise=true , address=81.171.14.70:4030    , piece_id=EPDZQGCWBKEEGW2EMHFP4FVUH4ZCOWFRRVJHH63TX7DF6BUELUIQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.804954891 (128h27m42.163613548s) [noise=true , address=81.171.14.70:4029    , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.805830432 (128h27m42.164489092s) [noise=true , address=81.171.14.70:4041    , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813392799 (128h27m42.172051464s) [noise=true , address=89.149.201.147:4015  , piece_id=W7BFUW3BP7ZK6RTZMKRDLTDIUSA5Y6HA3YXWDPB3MRD3RXDVYZKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813434571 (128h27m42.172093236s) [seg_pos={0 0}, upload=113070]: Segment reached optimal threshold of 26 pieces.
Nov 16 18:11:56.813848675 (128h27m42.172507339s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813864049 (128h27m42.172522714s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813894323 (128h27m42.172552985s) [noise=true , address=89.149.201.147:4022  , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813935878 (128h27m42.172594551s) [noise=true , address=89.149.201.147:4022  , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813968221 (128h27m42.172626877s) [seg_pos={0 0}, upload=113070]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 16 18:11:56.814067848 (128h27m42.172726507s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 16 18:11:56.814075640 (128h27m42.172734299s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 16 18:13:47.213254651 (128h29m32.571913308s) [upload=113070]: Done uploading segments...
Nov 16 18:13:47.213331906 (128h29m32.57199057s) [upload=113070]: Upload finished. err: metaclient: context deadline exceeded
Duration: 388.618618ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................]
duration:
506.615773ms
trace:
https://jaeger.dev.storj.io/trace/70994c85f165c3a0
FAIL (2025-11-16 18:50:53 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce...
Nov 16 18:11:56.176141393 (128h27m41.53480005s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176505694 (128h27m41.535164346s) [noise=true , address=81.171.14.70:4029    , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176694869 (128h27m41.535353535s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176906560 (128h27m41.535565213s) [noise=true , address=81.171.14.70:4034    , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178010924 (128h27m41.536669583s) [noise=true , address=81.171.14.70:4041    , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178162029 (128h27m41.53682069s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178624747 (128h27m41.537283407s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.179822806 (128h27m41.538481511s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.181092396 (128h27m41.539751055s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.182267056 (128h27m41.540925728s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.298224599 (128h27m41.656883262s) [upload=113070]: Next returned nil segment
Nov 16 18:11:56.298240977 (128h27m41.656899643s) [upload=113070]: Waiting for error group managing segments...
Nov 16 18:11:56.322992573 (128h27m41.681651228s) [noise=true , address=81.171.14.70:4031    , piece_id=WMGGCRBCTQTVREBKXGD37YVKTKSK2P5SFJV5LH2MGFI3RJXONTKQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.326677846 (128h27m41.6853365s) [noise=true , address=81.171.14.70:4033    , piece_id=UR3UBNCMPQSDNMI44MKZ34MRQ4MYPCLHGWGWNDEPVNJ3GGFDULDQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.327086439 (128h27m41.685745102s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330596159 (128h27m41.689254822s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330894325 (128h27m41.689552985s) [noise=true , address=185.167.204.205:4016 , piece_id=XTDJJJHRNTXLU4D3HJ4OCP2UQR6RF6KHCU6OWSQAPI2Q6SONPKYA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331200302 (128h27m41.689858955s) [noise=true , address=185.167.204.205:4019 , piece_id=LJCJSOQLF4FSLVI7G753ZYDJW6VJJIQCOESIN4KVUHQ36NPZZOHQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331708487 (128h27m41.69036714s) [noise=true , address=185.167.204.206:4061 , piece_id=VWC7K7VZIUF3B47V3XQKWG4WRWFIZSCI4QOW24JI5RC77KZ2VKNQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331819138 (128h27m41.690477798s) [noise=true , address=185.167.204.205:4002 , piece_id=NL2FGXMOTSJRIS7O4ZBTIE2636T4UBL4TBWO3YMA7LCKNTSDGYSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334312534 (128h27m41.692971206s) [noise=true , address=185.167.204.205:4031 , piece_id=J2H4MRWYBVR3FYDVOB7BHQV3XJ2PBXPBKTGIS5SK6N76DDQI3VJA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334376547 (128h27m41.693035205s) [noise=true , address=81.171.14.70:4034    , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334837583 (128h27m41.693496245s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.335363984 (128h27m41.694022646s) [noise=true , address=185.167.204.205:4005 , piece_id=VFVSPAC4QXC5RDOZWH5HS5GLIXCOSRJN67KX65IXBZD2WGULIAJQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.338489129 (128h27m41.697147785s) [noise=true , address=185.167.204.206:4039 , piece_id=S24WYTQCI7XAYTNW5CO6APLU3RRGU4AEJIANW3I5KT5CUHTP5WFQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.340260145 (128h27m41.698918799s) [noise=true , address=81.171.14.70:4040    , piece_id=4YLPSBJNFFRY4KJQRXR4FYNLV4DFOEO6SHIZGTJMSAUHRB4DTBWA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.342507930 (128h27m41.701166584s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.343055650 (128h27m41.701714293s) [noise=true , address=185.167.204.205:4024 , piece_id=EAG5CMHBVOSIFI2WFCQIXQFNGYU4ATNHUUIBQKYKM6B6XETO63YQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.346735021 (128h27m41.705393678s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.348599199 (128h27m41.707257859s) [noise=true , address=185.167.204.206:4051 , piece_id=3OFN2SAZSTHRRM4SNHQCU2IEVOCXMA3BZOLS2YNULUJ5IHFQQSPA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.349247455 (128h27m41.707906114s) [noise=true , address=89.149.201.147:4023  , piece_id=O533J4NWGNLHIAD4SA7VWCHP4WF7GGB33AG4EPFIUMZIVSMCZLSQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.355006125 (128h27m41.713664782s) [noise=true , address=185.167.204.205:4033 , piece_id=SWXEHUBOBIUDILZLZ2NC5G7MGHFPOWU2ZPODJAJV6NFUAYBUYZXQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.360471308 (128h27m41.719129963s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.374029787 (128h27m41.73268843s) [noise=true , address=89.149.201.147:4009  , piece_id=SEU3XXEIWPXZAES7EPYAZQTCKXCOEE7S6CLFL3SZZA3MTBNSMG2A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.789361201 (128h27m42.14801986s) [noise=true , address=81.171.14.70:4030    , piece_id=EPDZQGCWBKEEGW2EMHFP4FVUH4ZCOWFRRVJHH63TX7DF6BUELUIQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.804954891 (128h27m42.163613548s) [noise=true , address=81.171.14.70:4029    , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.805830432 (128h27m42.164489092s) [noise=true , address=81.171.14.70:4041    , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813392799 (128h27m42.172051464s) [noise=true , address=89.149.201.147:4015  , piece_id=W7BFUW3BP7ZK6RTZMKRDLTDIUSA5Y6HA3YXWDPB3MRD3RXDVYZKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813434571 (128h27m42.172093236s) [seg_pos={0 0}, upload=113070]: Segment reached optimal threshold of 26 pieces.
Nov 16 18:11:56.813848675 (128h27m42.172507339s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813864049 (128h27m42.172522714s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813894323 (128h27m42.172552985s) [noise=true , address=89.149.201.147:4022  , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813935878 (128h27m42.172594551s) [noise=true , address=89.149.201.147:4022  , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813968221 (128h27m42.172626877s) [seg_pos={0 0}, upload=113070]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 16 18:11:56.814067848 (128h27m42.172726507s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 16 18:11:56.814075640 (128h27m42.172734299s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 16 18:13:47.213254651 (128h29m32.571913308s) [upload=113070]: Done uploading segments...
Nov 16 18:13:47.213331906 (128h29m32.57199057s) [upload=113070]: Upload finished. err: metaclient: context deadline exceeded
Duration: 506.649322ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................]
duration:
441.326487ms
trace:
https://jaeger.dev.storj.io/trace/70994c85f165c3a0
FAIL (2025-11-16 18:49:46 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce...
Nov 16 18:11:56.176141393 (128h27m41.53480005s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176505694 (128h27m41.535164346s) [noise=true , address=81.171.14.70:4029    , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176694869 (128h27m41.535353535s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176906560 (128h27m41.535565213s) [noise=true , address=81.171.14.70:4034    , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178010924 (128h27m41.536669583s) [noise=true , address=81.171.14.70:4041    , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178162029 (128h27m41.53682069s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178624747 (128h27m41.537283407s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.179822806 (128h27m41.538481511s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.181092396 (128h27m41.539751055s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.182267056 (128h27m41.540925728s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.298224599 (128h27m41.656883262s) [upload=113070]: Next returned nil segment
Nov 16 18:11:56.298240977 (128h27m41.656899643s) [upload=113070]: Waiting for error group managing segments...
Nov 16 18:11:56.322992573 (128h27m41.681651228s) [noise=true , address=81.171.14.70:4031    , piece_id=WMGGCRBCTQTVREBKXGD37YVKTKSK2P5SFJV5LH2MGFI3RJXONTKQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.326677846 (128h27m41.6853365s) [noise=true , address=81.171.14.70:4033    , piece_id=UR3UBNCMPQSDNMI44MKZ34MRQ4MYPCLHGWGWNDEPVNJ3GGFDULDQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.327086439 (128h27m41.685745102s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330596159 (128h27m41.689254822s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330894325 (128h27m41.689552985s) [noise=true , address=185.167.204.205:4016 , piece_id=XTDJJJHRNTXLU4D3HJ4OCP2UQR6RF6KHCU6OWSQAPI2Q6SONPKYA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331200302 (128h27m41.689858955s) [noise=true , address=185.167.204.205:4019 , piece_id=LJCJSOQLF4FSLVI7G753ZYDJW6VJJIQCOESIN4KVUHQ36NPZZOHQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331708487 (128h27m41.69036714s) [noise=true , address=185.167.204.206:4061 , piece_id=VWC7K7VZIUF3B47V3XQKWG4WRWFIZSCI4QOW24JI5RC77KZ2VKNQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331819138 (128h27m41.690477798s) [noise=true , address=185.167.204.205:4002 , piece_id=NL2FGXMOTSJRIS7O4ZBTIE2636T4UBL4TBWO3YMA7LCKNTSDGYSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334312534 (128h27m41.692971206s) [noise=true , address=185.167.204.205:4031 , piece_id=J2H4MRWYBVR3FYDVOB7BHQV3XJ2PBXPBKTGIS5SK6N76DDQI3VJA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334376547 (128h27m41.693035205s) [noise=true , address=81.171.14.70:4034    , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334837583 (128h27m41.693496245s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.335363984 (128h27m41.694022646s) [noise=true , address=185.167.204.205:4005 , piece_id=VFVSPAC4QXC5RDOZWH5HS5GLIXCOSRJN67KX65IXBZD2WGULIAJQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.338489129 (128h27m41.697147785s) [noise=true , address=185.167.204.206:4039 , piece_id=S24WYTQCI7XAYTNW5CO6APLU3RRGU4AEJIANW3I5KT5CUHTP5WFQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.340260145 (128h27m41.698918799s) [noise=true , address=81.171.14.70:4040    , piece_id=4YLPSBJNFFRY4KJQRXR4FYNLV4DFOEO6SHIZGTJMSAUHRB4DTBWA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.342507930 (128h27m41.701166584s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.343055650 (128h27m41.701714293s) [noise=true , address=185.167.204.205:4024 , piece_id=EAG5CMHBVOSIFI2WFCQIXQFNGYU4ATNHUUIBQKYKM6B6XETO63YQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.346735021 (128h27m41.705393678s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.348599199 (128h27m41.707257859s) [noise=true , address=185.167.204.206:4051 , piece_id=3OFN2SAZSTHRRM4SNHQCU2IEVOCXMA3BZOLS2YNULUJ5IHFQQSPA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.349247455 (128h27m41.707906114s) [noise=true , address=89.149.201.147:4023  , piece_id=O533J4NWGNLHIAD4SA7VWCHP4WF7GGB33AG4EPFIUMZIVSMCZLSQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.355006125 (128h27m41.713664782s) [noise=true , address=185.167.204.205:4033 , piece_id=SWXEHUBOBIUDILZLZ2NC5G7MGHFPOWU2ZPODJAJV6NFUAYBUYZXQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.360471308 (128h27m41.719129963s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.374029787 (128h27m41.73268843s) [noise=true , address=89.149.201.147:4009  , piece_id=SEU3XXEIWPXZAES7EPYAZQTCKXCOEE7S6CLFL3SZZA3MTBNSMG2A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.789361201 (128h27m42.14801986s) [noise=true , address=81.171.14.70:4030    , piece_id=EPDZQGCWBKEEGW2EMHFP4FVUH4ZCOWFRRVJHH63TX7DF6BUELUIQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.804954891 (128h27m42.163613548s) [noise=true , address=81.171.14.70:4029    , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.805830432 (128h27m42.164489092s) [noise=true , address=81.171.14.70:4041    , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813392799 (128h27m42.172051464s) [noise=true , address=89.149.201.147:4015  , piece_id=W7BFUW3BP7ZK6RTZMKRDLTDIUSA5Y6HA3YXWDPB3MRD3RXDVYZKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813434571 (128h27m42.172093236s) [seg_pos={0 0}, upload=113070]: Segment reached optimal threshold of 26 pieces.
Nov 16 18:11:56.813848675 (128h27m42.172507339s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813864049 (128h27m42.172522714s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813894323 (128h27m42.172552985s) [noise=true , address=89.149.201.147:4022  , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813935878 (128h27m42.172594551s) [noise=true , address=89.149.201.147:4022  , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813968221 (128h27m42.172626877s) [seg_pos={0 0}, upload=113070]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 16 18:11:56.814067848 (128h27m42.172726507s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 16 18:11:56.814075640 (128h27m42.172734299s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 16 18:13:47.213254651 (128h29m32.571913308s) [upload=113070]: Done uploading segments...
Nov 16 18:13:47.213331906 (128h29m32.57199057s) [upload=113070]: Upload finished. err: metaclient: context deadline exceeded
Duration: 441.370185ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................]
duration:
845.277453ms
trace:
https://jaeger.dev.storj.io/trace/70994c85f165c3a0
FAIL (2025-11-16 18:49:27 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce...
Nov 16 18:11:56.176141393 (128h27m41.53480005s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176505694 (128h27m41.535164346s) [noise=true , address=81.171.14.70:4029    , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176694869 (128h27m41.535353535s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176906560 (128h27m41.535565213s) [noise=true , address=81.171.14.70:4034    , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178010924 (128h27m41.536669583s) [noise=true , address=81.171.14.70:4041    , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178162029 (128h27m41.53682069s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178624747 (128h27m41.537283407s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.179822806 (128h27m41.538481511s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.181092396 (128h27m41.539751055s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.182267056 (128h27m41.540925728s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.298224599 (128h27m41.656883262s) [upload=113070]: Next returned nil segment
Nov 16 18:11:56.298240977 (128h27m41.656899643s) [upload=113070]: Waiting for error group managing segments...
Nov 16 18:11:56.322992573 (128h27m41.681651228s) [noise=true , address=81.171.14.70:4031    , piece_id=WMGGCRBCTQTVREBKXGD37YVKTKSK2P5SFJV5LH2MGFI3RJXONTKQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.326677846 (128h27m41.6853365s) [noise=true , address=81.171.14.70:4033    , piece_id=UR3UBNCMPQSDNMI44MKZ34MRQ4MYPCLHGWGWNDEPVNJ3GGFDULDQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.327086439 (128h27m41.685745102s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330596159 (128h27m41.689254822s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330894325 (128h27m41.689552985s) [noise=true , address=185.167.204.205:4016 , piece_id=XTDJJJHRNTXLU4D3HJ4OCP2UQR6RF6KHCU6OWSQAPI2Q6SONPKYA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331200302 (128h27m41.689858955s) [noise=true , address=185.167.204.205:4019 , piece_id=LJCJSOQLF4FSLVI7G753ZYDJW6VJJIQCOESIN4KVUHQ36NPZZOHQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331708487 (128h27m41.69036714s) [noise=true , address=185.167.204.206:4061 , piece_id=VWC7K7VZIUF3B47V3XQKWG4WRWFIZSCI4QOW24JI5RC77KZ2VKNQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331819138 (128h27m41.690477798s) [noise=true , address=185.167.204.205:4002 , piece_id=NL2FGXMOTSJRIS7O4ZBTIE2636T4UBL4TBWO3YMA7LCKNTSDGYSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334312534 (128h27m41.692971206s) [noise=true , address=185.167.204.205:4031 , piece_id=J2H4MRWYBVR3FYDVOB7BHQV3XJ2PBXPBKTGIS5SK6N76DDQI3VJA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334376547 (128h27m41.693035205s) [noise=true , address=81.171.14.70:4034    , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334837583 (128h27m41.693496245s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.335363984 (128h27m41.694022646s) [noise=true , address=185.167.204.205:4005 , piece_id=VFVSPAC4QXC5RDOZWH5HS5GLIXCOSRJN67KX65IXBZD2WGULIAJQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.338489129 (128h27m41.697147785s) [noise=true , address=185.167.204.206:4039 , piece_id=S24WYTQCI7XAYTNW5CO6APLU3RRGU4AEJIANW3I5KT5CUHTP5WFQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.340260145 (128h27m41.698918799s) [noise=true , address=81.171.14.70:4040    , piece_id=4YLPSBJNFFRY4KJQRXR4FYNLV4DFOEO6SHIZGTJMSAUHRB4DTBWA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.342507930 (128h27m41.701166584s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.343055650 (128h27m41.701714293s) [noise=true , address=185.167.204.205:4024 , piece_id=EAG5CMHBVOSIFI2WFCQIXQFNGYU4ATNHUUIBQKYKM6B6XETO63YQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.346735021 (128h27m41.705393678s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.348599199 (128h27m41.707257859s) [noise=true , address=185.167.204.206:4051 , piece_id=3OFN2SAZSTHRRM4SNHQCU2IEVOCXMA3BZOLS2YNULUJ5IHFQQSPA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.349247455 (128h27m41.707906114s) [noise=true , address=89.149.201.147:4023  , piece_id=O533J4NWGNLHIAD4SA7VWCHP4WF7GGB33AG4EPFIUMZIVSMCZLSQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.355006125 (128h27m41.713664782s) [noise=true , address=185.167.204.205:4033 , piece_id=SWXEHUBOBIUDILZLZ2NC5G7MGHFPOWU2ZPODJAJV6NFUAYBUYZXQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.360471308 (128h27m41.719129963s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.374029787 (128h27m41.73268843s) [noise=true , address=89.149.201.147:4009  , piece_id=SEU3XXEIWPXZAES7EPYAZQTCKXCOEE7S6CLFL3SZZA3MTBNSMG2A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.789361201 (128h27m42.14801986s) [noise=true , address=81.171.14.70:4030    , piece_id=EPDZQGCWBKEEGW2EMHFP4FVUH4ZCOWFRRVJHH63TX7DF6BUELUIQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.804954891 (128h27m42.163613548s) [noise=true , address=81.171.14.70:4029    , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.805830432 (128h27m42.164489092s) [noise=true , address=81.171.14.70:4041    , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813392799 (128h27m42.172051464s) [noise=true , address=89.149.201.147:4015  , piece_id=W7BFUW3BP7ZK6RTZMKRDLTDIUSA5Y6HA3YXWDPB3MRD3RXDVYZKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813434571 (128h27m42.172093236s) [seg_pos={0 0}, upload=113070]: Segment reached optimal threshold of 26 pieces.
Nov 16 18:11:56.813848675 (128h27m42.172507339s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813864049 (128h27m42.172522714s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813894323 (128h27m42.172552985s) [noise=true , address=89.149.201.147:4022  , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813935878 (128h27m42.172594551s) [noise=true , address=89.149.201.147:4022  , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813968221 (128h27m42.172626877s) [seg_pos={0 0}, upload=113070]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 16 18:11:56.814067848 (128h27m42.172726507s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 16 18:11:56.814075640 (128h27m42.172734299s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 16 18:13:47.213254651 (128h29m32.571913308s) [upload=113070]: Done uploading segments...
Nov 16 18:13:47.213331906 (128h29m32.57199057s) [upload=113070]: Upload finished. err: metaclient: context deadline exceeded
Duration: 845.301357ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................]
duration:
397.454866ms
trace:
https://jaeger.dev.storj.io/trace/70994c85f165c3a0
FAIL (2025-11-16 18:48:57 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce...
Nov 16 18:11:56.176141393 (128h27m41.53480005s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176505694 (128h27m41.535164346s) [noise=true , address=81.171.14.70:4029    , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176694869 (128h27m41.535353535s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176906560 (128h27m41.535565213s) [noise=true , address=81.171.14.70:4034    , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178010924 (128h27m41.536669583s) [noise=true , address=81.171.14.70:4041    , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178162029 (128h27m41.53682069s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178624747 (128h27m41.537283407s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.179822806 (128h27m41.538481511s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.181092396 (128h27m41.539751055s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.182267056 (128h27m41.540925728s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.298224599 (128h27m41.656883262s) [upload=113070]: Next returned nil segment
Nov 16 18:11:56.298240977 (128h27m41.656899643s) [upload=113070]: Waiting for error group managing segments...
Nov 16 18:11:56.322992573 (128h27m41.681651228s) [noise=true , address=81.171.14.70:4031    , piece_id=WMGGCRBCTQTVREBKXGD37YVKTKSK2P5SFJV5LH2MGFI3RJXONTKQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.326677846 (128h27m41.6853365s) [noise=true , address=81.171.14.70:4033    , piece_id=UR3UBNCMPQSDNMI44MKZ34MRQ4MYPCLHGWGWNDEPVNJ3GGFDULDQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.327086439 (128h27m41.685745102s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330596159 (128h27m41.689254822s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330894325 (128h27m41.689552985s) [noise=true , address=185.167.204.205:4016 , piece_id=XTDJJJHRNTXLU4D3HJ4OCP2UQR6RF6KHCU6OWSQAPI2Q6SONPKYA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331200302 (128h27m41.689858955s) [noise=true , address=185.167.204.205:4019 , piece_id=LJCJSOQLF4FSLVI7G753ZYDJW6VJJIQCOESIN4KVUHQ36NPZZOHQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331708487 (128h27m41.69036714s) [noise=true , address=185.167.204.206:4061 , piece_id=VWC7K7VZIUF3B47V3XQKWG4WRWFIZSCI4QOW24JI5RC77KZ2VKNQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331819138 (128h27m41.690477798s) [noise=true , address=185.167.204.205:4002 , piece_id=NL2FGXMOTSJRIS7O4ZBTIE2636T4UBL4TBWO3YMA7LCKNTSDGYSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334312534 (128h27m41.692971206s) [noise=true , address=185.167.204.205:4031 , piece_id=J2H4MRWYBVR3FYDVOB7BHQV3XJ2PBXPBKTGIS5SK6N76DDQI3VJA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334376547 (128h27m41.693035205s) [noise=true , address=81.171.14.70:4034    , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334837583 (128h27m41.693496245s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.335363984 (128h27m41.694022646s) [noise=true , address=185.167.204.205:4005 , piece_id=VFVSPAC4QXC5RDOZWH5HS5GLIXCOSRJN67KX65IXBZD2WGULIAJQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.338489129 (128h27m41.697147785s) [noise=true , address=185.167.204.206:4039 , piece_id=S24WYTQCI7XAYTNW5CO6APLU3RRGU4AEJIANW3I5KT5CUHTP5WFQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.340260145 (128h27m41.698918799s) [noise=true , address=81.171.14.70:4040    , piece_id=4YLPSBJNFFRY4KJQRXR4FYNLV4DFOEO6SHIZGTJMSAUHRB4DTBWA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.342507930 (128h27m41.701166584s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.343055650 (128h27m41.701714293s) [noise=true , address=185.167.204.205:4024 , piece_id=EAG5CMHBVOSIFI2WFCQIXQFNGYU4ATNHUUIBQKYKM6B6XETO63YQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.346735021 (128h27m41.705393678s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.348599199 (128h27m41.707257859s) [noise=true , address=185.167.204.206:4051 , piece_id=3OFN2SAZSTHRRM4SNHQCU2IEVOCXMA3BZOLS2YNULUJ5IHFQQSPA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.349247455 (128h27m41.707906114s) [noise=true , address=89.149.201.147:4023  , piece_id=O533J4NWGNLHIAD4SA7VWCHP4WF7GGB33AG4EPFIUMZIVSMCZLSQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.355006125 (128h27m41.713664782s) [noise=true , address=185.167.204.205:4033 , piece_id=SWXEHUBOBIUDILZLZ2NC5G7MGHFPOWU2ZPODJAJV6NFUAYBUYZXQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.360471308 (128h27m41.719129963s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.374029787 (128h27m41.73268843s) [noise=true , address=89.149.201.147:4009  , piece_id=SEU3XXEIWPXZAES7EPYAZQTCKXCOEE7S6CLFL3SZZA3MTBNSMG2A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.789361201 (128h27m42.14801986s) [noise=true , address=81.171.14.70:4030    , piece_id=EPDZQGCWBKEEGW2EMHFP4FVUH4ZCOWFRRVJHH63TX7DF6BUELUIQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.804954891 (128h27m42.163613548s) [noise=true , address=81.171.14.70:4029    , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.805830432 (128h27m42.164489092s) [noise=true , address=81.171.14.70:4041    , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813392799 (128h27m42.172051464s) [noise=true , address=89.149.201.147:4015  , piece_id=W7BFUW3BP7ZK6RTZMKRDLTDIUSA5Y6HA3YXWDPB3MRD3RXDVYZKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813434571 (128h27m42.172093236s) [seg_pos={0 0}, upload=113070]: Segment reached optimal threshold of 26 pieces.
Nov 16 18:11:56.813848675 (128h27m42.172507339s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813864049 (128h27m42.172522714s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813894323 (128h27m42.172552985s) [noise=true , address=89.149.201.147:4022  , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813935878 (128h27m42.172594551s) [noise=true , address=89.149.201.147:4022  , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813968221 (128h27m42.172626877s) [seg_pos={0 0}, upload=113070]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 16 18:11:56.814067848 (128h27m42.172726507s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 16 18:11:56.814075640 (128h27m42.172734299s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 16 18:13:47.213254651 (128h29m32.571913308s) [upload=113070]: Done uploading segments...
Nov 16 18:13:47.213331906 (128h29m32.57199057s) [upload=113070]: Upload finished. err: metaclient: context deadline exceeded
Duration: 397.483482ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................]
duration:
829.043048ms
trace:
https://jaeger.dev.storj.io/trace/70994c85f165c3a0
FAIL (2025-11-16 18:48:42 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce...
Nov 16 18:11:56.176141393 (128h27m41.53480005s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176505694 (128h27m41.535164346s) [noise=true , address=81.171.14.70:4029    , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176694869 (128h27m41.535353535s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176906560 (128h27m41.535565213s) [noise=true , address=81.171.14.70:4034    , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178010924 (128h27m41.536669583s) [noise=true , address=81.171.14.70:4041    , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178162029 (128h27m41.53682069s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178624747 (128h27m41.537283407s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.179822806 (128h27m41.538481511s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.181092396 (128h27m41.539751055s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.182267056 (128h27m41.540925728s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.298224599 (128h27m41.656883262s) [upload=113070]: Next returned nil segment
Nov 16 18:11:56.298240977 (128h27m41.656899643s) [upload=113070]: Waiting for error group managing segments...
Nov 16 18:11:56.322992573 (128h27m41.681651228s) [noise=true , address=81.171.14.70:4031    , piece_id=WMGGCRBCTQTVREBKXGD37YVKTKSK2P5SFJV5LH2MGFI3RJXONTKQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.326677846 (128h27m41.6853365s) [noise=true , address=81.171.14.70:4033    , piece_id=UR3UBNCMPQSDNMI44MKZ34MRQ4MYPCLHGWGWNDEPVNJ3GGFDULDQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.327086439 (128h27m41.685745102s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330596159 (128h27m41.689254822s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330894325 (128h27m41.689552985s) [noise=true , address=185.167.204.205:4016 , piece_id=XTDJJJHRNTXLU4D3HJ4OCP2UQR6RF6KHCU6OWSQAPI2Q6SONPKYA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331200302 (128h27m41.689858955s) [noise=true , address=185.167.204.205:4019 , piece_id=LJCJSOQLF4FSLVI7G753ZYDJW6VJJIQCOESIN4KVUHQ36NPZZOHQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331708487 (128h27m41.69036714s) [noise=true , address=185.167.204.206:4061 , piece_id=VWC7K7VZIUF3B47V3XQKWG4WRWFIZSCI4QOW24JI5RC77KZ2VKNQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331819138 (128h27m41.690477798s) [noise=true , address=185.167.204.205:4002 , piece_id=NL2FGXMOTSJRIS7O4ZBTIE2636T4UBL4TBWO3YMA7LCKNTSDGYSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334312534 (128h27m41.692971206s) [noise=true , address=185.167.204.205:4031 , piece_id=J2H4MRWYBVR3FYDVOB7BHQV3XJ2PBXPBKTGIS5SK6N76DDQI3VJA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334376547 (128h27m41.693035205s) [noise=true , address=81.171.14.70:4034    , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334837583 (128h27m41.693496245s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.335363984 (128h27m41.694022646s) [noise=true , address=185.167.204.205:4005 , piece_id=VFVSPAC4QXC5RDOZWH5HS5GLIXCOSRJN67KX65IXBZD2WGULIAJQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.338489129 (128h27m41.697147785s) [noise=true , address=185.167.204.206:4039 , piece_id=S24WYTQCI7XAYTNW5CO6APLU3RRGU4AEJIANW3I5KT5CUHTP5WFQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.340260145 (128h27m41.698918799s) [noise=true , address=81.171.14.70:4040    , piece_id=4YLPSBJNFFRY4KJQRXR4FYNLV4DFOEO6SHIZGTJMSAUHRB4DTBWA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.342507930 (128h27m41.701166584s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.343055650 (128h27m41.701714293s) [noise=true , address=185.167.204.205:4024 , piece_id=EAG5CMHBVOSIFI2WFCQIXQFNGYU4ATNHUUIBQKYKM6B6XETO63YQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.346735021 (128h27m41.705393678s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.348599199 (128h27m41.707257859s) [noise=true , address=185.167.204.206:4051 , piece_id=3OFN2SAZSTHRRM4SNHQCU2IEVOCXMA3BZOLS2YNULUJ5IHFQQSPA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.349247455 (128h27m41.707906114s) [noise=true , address=89.149.201.147:4023  , piece_id=O533J4NWGNLHIAD4SA7VWCHP4WF7GGB33AG4EPFIUMZIVSMCZLSQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.355006125 (128h27m41.713664782s) [noise=true , address=185.167.204.205:4033 , piece_id=SWXEHUBOBIUDILZLZ2NC5G7MGHFPOWU2ZPODJAJV6NFUAYBUYZXQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.360471308 (128h27m41.719129963s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.374029787 (128h27m41.73268843s) [noise=true , address=89.149.201.147:4009  , piece_id=SEU3XXEIWPXZAES7EPYAZQTCKXCOEE7S6CLFL3SZZA3MTBNSMG2A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.789361201 (128h27m42.14801986s) [noise=true , address=81.171.14.70:4030    , piece_id=EPDZQGCWBKEEGW2EMHFP4FVUH4ZCOWFRRVJHH63TX7DF6BUELUIQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.804954891 (128h27m42.163613548s) [noise=true , address=81.171.14.70:4029    , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.805830432 (128h27m42.164489092s) [noise=true , address=81.171.14.70:4041    , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813392799 (128h27m42.172051464s) [noise=true , address=89.149.201.147:4015  , piece_id=W7BFUW3BP7ZK6RTZMKRDLTDIUSA5Y6HA3YXWDPB3MRD3RXDVYZKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813434571 (128h27m42.172093236s) [seg_pos={0 0}, upload=113070]: Segment reached optimal threshold of 26 pieces.
Nov 16 18:11:56.813848675 (128h27m42.172507339s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813864049 (128h27m42.172522714s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813894323 (128h27m42.172552985s) [noise=true , address=89.149.201.147:4022  , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813935878 (128h27m42.172594551s) [noise=true , address=89.149.201.147:4022  , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813968221 (128h27m42.172626877s) [seg_pos={0 0}, upload=113070]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 16 18:11:56.814067848 (128h27m42.172726507s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 16 18:11:56.814075640 (128h27m42.172734299s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 16 18:13:47.213254651 (128h29m32.571913308s) [upload=113070]: Done uploading segments...
Nov 16 18:13:47.213331906 (128h29m32.57199057s) [upload=113070]: Upload finished. err: metaclient: context deadline exceeded
Duration: 829.089391ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................]
duration:
585.969094ms
trace:
https://jaeger.dev.storj.io/trace/70994c85f165c3a0
FAIL (2025-11-16 18:47:55 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce...
Nov 16 18:11:56.176141393 (128h27m41.53480005s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176505694 (128h27m41.535164346s) [noise=true , address=81.171.14.70:4029    , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176694869 (128h27m41.535353535s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176906560 (128h27m41.535565213s) [noise=true , address=81.171.14.70:4034    , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178010924 (128h27m41.536669583s) [noise=true , address=81.171.14.70:4041    , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178162029 (128h27m41.53682069s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178624747 (128h27m41.537283407s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.179822806 (128h27m41.538481511s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.181092396 (128h27m41.539751055s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.182267056 (128h27m41.540925728s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.298224599 (128h27m41.656883262s) [upload=113070]: Next returned nil segment
Nov 16 18:11:56.298240977 (128h27m41.656899643s) [upload=113070]: Waiting for error group managing segments...
Nov 16 18:11:56.322992573 (128h27m41.681651228s) [noise=true , address=81.171.14.70:4031    , piece_id=WMGGCRBCTQTVREBKXGD37YVKTKSK2P5SFJV5LH2MGFI3RJXONTKQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.326677846 (128h27m41.6853365s) [noise=true , address=81.171.14.70:4033    , piece_id=UR3UBNCMPQSDNMI44MKZ34MRQ4MYPCLHGWGWNDEPVNJ3GGFDULDQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.327086439 (128h27m41.685745102s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330596159 (128h27m41.689254822s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330894325 (128h27m41.689552985s) [noise=true , address=185.167.204.205:4016 , piece_id=XTDJJJHRNTXLU4D3HJ4OCP2UQR6RF6KHCU6OWSQAPI2Q6SONPKYA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331200302 (128h27m41.689858955s) [noise=true , address=185.167.204.205:4019 , piece_id=LJCJSOQLF4FSLVI7G753ZYDJW6VJJIQCOESIN4KVUHQ36NPZZOHQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331708487 (128h27m41.69036714s) [noise=true , address=185.167.204.206:4061 , piece_id=VWC7K7VZIUF3B47V3XQKWG4WRWFIZSCI4QOW24JI5RC77KZ2VKNQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331819138 (128h27m41.690477798s) [noise=true , address=185.167.204.205:4002 , piece_id=NL2FGXMOTSJRIS7O4ZBTIE2636T4UBL4TBWO3YMA7LCKNTSDGYSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334312534 (128h27m41.692971206s) [noise=true , address=185.167.204.205:4031 , piece_id=J2H4MRWYBVR3FYDVOB7BHQV3XJ2PBXPBKTGIS5SK6N76DDQI3VJA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334376547 (128h27m41.693035205s) [noise=true , address=81.171.14.70:4034    , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334837583 (128h27m41.693496245s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.335363984 (128h27m41.694022646s) [noise=true , address=185.167.204.205:4005 , piece_id=VFVSPAC4QXC5RDOZWH5HS5GLIXCOSRJN67KX65IXBZD2WGULIAJQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.338489129 (128h27m41.697147785s) [noise=true , address=185.167.204.206:4039 , piece_id=S24WYTQCI7XAYTNW5CO6APLU3RRGU4AEJIANW3I5KT5CUHTP5WFQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.340260145 (128h27m41.698918799s) [noise=true , address=81.171.14.70:4040    , piece_id=4YLPSBJNFFRY4KJQRXR4FYNLV4DFOEO6SHIZGTJMSAUHRB4DTBWA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.342507930 (128h27m41.701166584s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.343055650 (128h27m41.701714293s) [noise=true , address=185.167.204.205:4024 , piece_id=EAG5CMHBVOSIFI2WFCQIXQFNGYU4ATNHUUIBQKYKM6B6XETO63YQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.346735021 (128h27m41.705393678s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.348599199 (128h27m41.707257859s) [noise=true , address=185.167.204.206:4051 , piece_id=3OFN2SAZSTHRRM4SNHQCU2IEVOCXMA3BZOLS2YNULUJ5IHFQQSPA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.349247455 (128h27m41.707906114s) [noise=true , address=89.149.201.147:4023  , piece_id=O533J4NWGNLHIAD4SA7VWCHP4WF7GGB33AG4EPFIUMZIVSMCZLSQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.355006125 (128h27m41.713664782s) [noise=true , address=185.167.204.205:4033 , piece_id=SWXEHUBOBIUDILZLZ2NC5G7MGHFPOWU2ZPODJAJV6NFUAYBUYZXQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.360471308 (128h27m41.719129963s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.374029787 (128h27m41.73268843s) [noise=true , address=89.149.201.147:4009  , piece_id=SEU3XXEIWPXZAES7EPYAZQTCKXCOEE7S6CLFL3SZZA3MTBNSMG2A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.789361201 (128h27m42.14801986s) [noise=true , address=81.171.14.70:4030    , piece_id=EPDZQGCWBKEEGW2EMHFP4FVUH4ZCOWFRRVJHH63TX7DF6BUELUIQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.804954891 (128h27m42.163613548s) [noise=true , address=81.171.14.70:4029    , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.805830432 (128h27m42.164489092s) [noise=true , address=81.171.14.70:4041    , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813392799 (128h27m42.172051464s) [noise=true , address=89.149.201.147:4015  , piece_id=W7BFUW3BP7ZK6RTZMKRDLTDIUSA5Y6HA3YXWDPB3MRD3RXDVYZKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813434571 (128h27m42.172093236s) [seg_pos={0 0}, upload=113070]: Segment reached optimal threshold of 26 pieces.
Nov 16 18:11:56.813848675 (128h27m42.172507339s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813864049 (128h27m42.172522714s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813894323 (128h27m42.172552985s) [noise=true , address=89.149.201.147:4022  , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813935878 (128h27m42.172594551s) [noise=true , address=89.149.201.147:4022  , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813968221 (128h27m42.172626877s) [seg_pos={0 0}, upload=113070]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 16 18:11:56.814067848 (128h27m42.172726507s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 16 18:11:56.814075640 (128h27m42.172734299s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 16 18:13:47.213254651 (128h29m32.571913308s) [upload=113070]: Done uploading segments...
Nov 16 18:13:47.213331906 (128h29m32.57199057s) [upload=113070]: Upload finished. err: metaclient: context deadline exceeded
Duration: 585.993686ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................]
duration:
843.781933ms
trace:
https://jaeger.dev.storj.io/trace/70994c85f165c3a0
FAIL (2025-11-16 18:47:29 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce...
Nov 16 18:11:56.176141393 (128h27m41.53480005s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176505694 (128h27m41.535164346s) [noise=true , address=81.171.14.70:4029    , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176694869 (128h27m41.535353535s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176906560 (128h27m41.535565213s) [noise=true , address=81.171.14.70:4034    , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178010924 (128h27m41.536669583s) [noise=true , address=81.171.14.70:4041    , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178162029 (128h27m41.53682069s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178624747 (128h27m41.537283407s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.179822806 (128h27m41.538481511s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.181092396 (128h27m41.539751055s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.182267056 (128h27m41.540925728s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.298224599 (128h27m41.656883262s) [upload=113070]: Next returned nil segment
Nov 16 18:11:56.298240977 (128h27m41.656899643s) [upload=113070]: Waiting for error group managing segments...
Nov 16 18:11:56.322992573 (128h27m41.681651228s) [noise=true , address=81.171.14.70:4031    , piece_id=WMGGCRBCTQTVREBKXGD37YVKTKSK2P5SFJV5LH2MGFI3RJXONTKQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.326677846 (128h27m41.6853365s) [noise=true , address=81.171.14.70:4033    , piece_id=UR3UBNCMPQSDNMI44MKZ34MRQ4MYPCLHGWGWNDEPVNJ3GGFDULDQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.327086439 (128h27m41.685745102s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330596159 (128h27m41.689254822s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330894325 (128h27m41.689552985s) [noise=true , address=185.167.204.205:4016 , piece_id=XTDJJJHRNTXLU4D3HJ4OCP2UQR6RF6KHCU6OWSQAPI2Q6SONPKYA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331200302 (128h27m41.689858955s) [noise=true , address=185.167.204.205:4019 , piece_id=LJCJSOQLF4FSLVI7G753ZYDJW6VJJIQCOESIN4KVUHQ36NPZZOHQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331708487 (128h27m41.69036714s) [noise=true , address=185.167.204.206:4061 , piece_id=VWC7K7VZIUF3B47V3XQKWG4WRWFIZSCI4QOW24JI5RC77KZ2VKNQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331819138 (128h27m41.690477798s) [noise=true , address=185.167.204.205:4002 , piece_id=NL2FGXMOTSJRIS7O4ZBTIE2636T4UBL4TBWO3YMA7LCKNTSDGYSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334312534 (128h27m41.692971206s) [noise=true , address=185.167.204.205:4031 , piece_id=J2H4MRWYBVR3FYDVOB7BHQV3XJ2PBXPBKTGIS5SK6N76DDQI3VJA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334376547 (128h27m41.693035205s) [noise=true , address=81.171.14.70:4034    , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334837583 (128h27m41.693496245s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.335363984 (128h27m41.694022646s) [noise=true , address=185.167.204.205:4005 , piece_id=VFVSPAC4QXC5RDOZWH5HS5GLIXCOSRJN67KX65IXBZD2WGULIAJQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.338489129 (128h27m41.697147785s) [noise=true , address=185.167.204.206:4039 , piece_id=S24WYTQCI7XAYTNW5CO6APLU3RRGU4AEJIANW3I5KT5CUHTP5WFQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.340260145 (128h27m41.698918799s) [noise=true , address=81.171.14.70:4040    , piece_id=4YLPSBJNFFRY4KJQRXR4FYNLV4DFOEO6SHIZGTJMSAUHRB4DTBWA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.342507930 (128h27m41.701166584s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.343055650 (128h27m41.701714293s) [noise=true , address=185.167.204.205:4024 , piece_id=EAG5CMHBVOSIFI2WFCQIXQFNGYU4ATNHUUIBQKYKM6B6XETO63YQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.346735021 (128h27m41.705393678s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.348599199 (128h27m41.707257859s) [noise=true , address=185.167.204.206:4051 , piece_id=3OFN2SAZSTHRRM4SNHQCU2IEVOCXMA3BZOLS2YNULUJ5IHFQQSPA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.349247455 (128h27m41.707906114s) [noise=true , address=89.149.201.147:4023  , piece_id=O533J4NWGNLHIAD4SA7VWCHP4WF7GGB33AG4EPFIUMZIVSMCZLSQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.355006125 (128h27m41.713664782s) [noise=true , address=185.167.204.205:4033 , piece_id=SWXEHUBOBIUDILZLZ2NC5G7MGHFPOWU2ZPODJAJV6NFUAYBUYZXQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.360471308 (128h27m41.719129963s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.374029787 (128h27m41.73268843s) [noise=true , address=89.149.201.147:4009  , piece_id=SEU3XXEIWPXZAES7EPYAZQTCKXCOEE7S6CLFL3SZZA3MTBNSMG2A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.789361201 (128h27m42.14801986s) [noise=true , address=81.171.14.70:4030    , piece_id=EPDZQGCWBKEEGW2EMHFP4FVUH4ZCOWFRRVJHH63TX7DF6BUELUIQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.804954891 (128h27m42.163613548s) [noise=true , address=81.171.14.70:4029    , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.805830432 (128h27m42.164489092s) [noise=true , address=81.171.14.70:4041    , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813392799 (128h27m42.172051464s) [noise=true , address=89.149.201.147:4015  , piece_id=W7BFUW3BP7ZK6RTZMKRDLTDIUSA5Y6HA3YXWDPB3MRD3RXDVYZKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813434571 (128h27m42.172093236s) [seg_pos={0 0}, upload=113070]: Segment reached optimal threshold of 26 pieces.
Nov 16 18:11:56.813848675 (128h27m42.172507339s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813864049 (128h27m42.172522714s) [noise=true , address=89.149.201.147:4020  , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813894323 (128h27m42.172552985s) [noise=true , address=89.149.201.147:4022  , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813935878 (128h27m42.172594551s) [noise=true , address=89.149.201.147:4022  , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813968221 (128h27m42.172626877s) [seg_pos={0 0}, upload=113070]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 16 18:11:56.814067848 (128h27m42.172726507s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 16 18:11:56.814075640 (128h27m42.172734299s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 16 18:13:47.213254651 (128h29m32.571913308s) [upload=113070]: Done uploading segments...
Nov 16 18:13:47.213331906 (128h29m32.57199057s) [upload=113070]: Upload finished. err: metaclient: context deadline exceeded
Duration: 843.807972ms core uplink eu-select-1 eu1-placement-15