Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
2.633628341s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:42:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.63364433s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
2.852091126s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:41:18 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.852115086s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
2.596076623s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:40:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.596105918s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
2.733821566s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:39:50 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.733843003s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
2.738587721s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:38:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.738611996s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.684161335s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:38:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.684201519s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.728683602s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:38:08 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.728704593s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.822326452s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:36:56 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.82235254s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.730919437s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:35:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.730946021s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.726545596s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:34:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.726577078s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.718390842s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:33:47 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.718412632s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.690384605s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:32:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.690487806s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.861667671s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:31:55 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.861714522s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.572325821s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:31:20 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.572441633s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.704338359s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:30:50 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.704362528s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.881783424s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:29:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.881805954s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.760887816s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:29:15 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.76091552s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
2.74075679s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:28:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.740780188s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.830937138s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:27:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.830969167s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.834073609s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:26:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.834102548s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.690410545s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:25:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.690437205s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.544386454s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:25:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.54441041s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.8084464s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:24:17 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.808471369s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.642359491s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:23:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.642382923s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.74972007s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:23:17 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.749744124s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.856080047s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:22:15 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.856095397s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.72758194s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:21:05 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.727608221s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.8660863s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:20:37 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.866115624s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.636385972s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:19:56 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.63641148s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.749323599s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:19:36 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.749384224s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.845256944s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:19:12 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.84528039s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.890569315s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:18:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.890593209s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.731620145s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:17:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.731650968s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.748383088s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:16:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.748416853s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.731508713s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:16:14 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.731536779s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001023988s trace:
https://jaeger.dev.storj.io/trace/66ce46c82d430cfa
FAIL (2025-11-17 00:15:53 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001048125s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
419.901549ms trace:
https://jaeger.dev.storj.io/trace/70994c85f165c3a0
FAIL (2025-11-16 18:56:03 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce...
Nov 16 18:11:56.176141393 (128h27m41.53480005s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176505694 (128h27m41.535164346s) [noise=true , address=81.171.14.70:4029 , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176694869 (128h27m41.535353535s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176906560 (128h27m41.535565213s) [noise=true , address=81.171.14.70:4034 , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178010924 (128h27m41.536669583s) [noise=true , address=81.171.14.70:4041 , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178162029 (128h27m41.53682069s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178624747 (128h27m41.537283407s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.179822806 (128h27m41.538481511s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.181092396 (128h27m41.539751055s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.182267056 (128h27m41.540925728s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.298224599 (128h27m41.656883262s) [upload=113070]: Next returned nil segment
Nov 16 18:11:56.298240977 (128h27m41.656899643s) [upload=113070]: Waiting for error group managing segments...
Nov 16 18:11:56.322992573 (128h27m41.681651228s) [noise=true , address=81.171.14.70:4031 , piece_id=WMGGCRBCTQTVREBKXGD37YVKTKSK2P5SFJV5LH2MGFI3RJXONTKQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.326677846 (128h27m41.6853365s) [noise=true , address=81.171.14.70:4033 , piece_id=UR3UBNCMPQSDNMI44MKZ34MRQ4MYPCLHGWGWNDEPVNJ3GGFDULDQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.327086439 (128h27m41.685745102s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330596159 (128h27m41.689254822s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330894325 (128h27m41.689552985s) [noise=true , address=185.167.204.205:4016 , piece_id=XTDJJJHRNTXLU4D3HJ4OCP2UQR6RF6KHCU6OWSQAPI2Q6SONPKYA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331200302 (128h27m41.689858955s) [noise=true , address=185.167.204.205:4019 , piece_id=LJCJSOQLF4FSLVI7G753ZYDJW6VJJIQCOESIN4KVUHQ36NPZZOHQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331708487 (128h27m41.69036714s) [noise=true , address=185.167.204.206:4061 , piece_id=VWC7K7VZIUF3B47V3XQKWG4WRWFIZSCI4QOW24JI5RC77KZ2VKNQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331819138 (128h27m41.690477798s) [noise=true , address=185.167.204.205:4002 , piece_id=NL2FGXMOTSJRIS7O4ZBTIE2636T4UBL4TBWO3YMA7LCKNTSDGYSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334312534 (128h27m41.692971206s) [noise=true , address=185.167.204.205:4031 , piece_id=J2H4MRWYBVR3FYDVOB7BHQV3XJ2PBXPBKTGIS5SK6N76DDQI3VJA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334376547 (128h27m41.693035205s) [noise=true , address=81.171.14.70:4034 , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334837583 (128h27m41.693496245s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.335363984 (128h27m41.694022646s) [noise=true , address=185.167.204.205:4005 , piece_id=VFVSPAC4QXC5RDOZWH5HS5GLIXCOSRJN67KX65IXBZD2WGULIAJQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.338489129 (128h27m41.697147785s) [noise=true , address=185.167.204.206:4039 , piece_id=S24WYTQCI7XAYTNW5CO6APLU3RRGU4AEJIANW3I5KT5CUHTP5WFQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.340260145 (128h27m41.698918799s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLPSBJNFFRY4KJQRXR4FYNLV4DFOEO6SHIZGTJMSAUHRB4DTBWA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.342507930 (128h27m41.701166584s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.343055650 (128h27m41.701714293s) [noise=true , address=185.167.204.205:4024 , piece_id=EAG5CMHBVOSIFI2WFCQIXQFNGYU4ATNHUUIBQKYKM6B6XETO63YQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.346735021 (128h27m41.705393678s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.348599199 (128h27m41.707257859s) [noise=true , address=185.167.204.206:4051 , piece_id=3OFN2SAZSTHRRM4SNHQCU2IEVOCXMA3BZOLS2YNULUJ5IHFQQSPA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.349247455 (128h27m41.707906114s) [noise=true , address=89.149.201.147:4023 , piece_id=O533J4NWGNLHIAD4SA7VWCHP4WF7GGB33AG4EPFIUMZIVSMCZLSQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.355006125 (128h27m41.713664782s) [noise=true , address=185.167.204.205:4033 , piece_id=SWXEHUBOBIUDILZLZ2NC5G7MGHFPOWU2ZPODJAJV6NFUAYBUYZXQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.360471308 (128h27m41.719129963s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.374029787 (128h27m41.73268843s) [noise=true , address=89.149.201.147:4009 , piece_id=SEU3XXEIWPXZAES7EPYAZQTCKXCOEE7S6CLFL3SZZA3MTBNSMG2A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.789361201 (128h27m42.14801986s) [noise=true , address=81.171.14.70:4030 , piece_id=EPDZQGCWBKEEGW2EMHFP4FVUH4ZCOWFRRVJHH63TX7DF6BUELUIQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.804954891 (128h27m42.163613548s) [noise=true , address=81.171.14.70:4029 , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.805830432 (128h27m42.164489092s) [noise=true , address=81.171.14.70:4041 , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813392799 (128h27m42.172051464s) [noise=true , address=89.149.201.147:4015 , piece_id=W7BFUW3BP7ZK6RTZMKRDLTDIUSA5Y6HA3YXWDPB3MRD3RXDVYZKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813434571 (128h27m42.172093236s) [seg_pos={0 0}, upload=113070]: Segment reached optimal threshold of 26 pieces.
Nov 16 18:11:56.813848675 (128h27m42.172507339s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813864049 (128h27m42.172522714s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813894323 (128h27m42.172552985s) [noise=true , address=89.149.201.147:4022 , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813935878 (128h27m42.172594551s) [noise=true , address=89.149.201.147:4022 , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813968221 (128h27m42.172626877s) [seg_pos={0 0}, upload=113070]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 16 18:11:56.814067848 (128h27m42.172726507s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 16 18:11:56.814075640 (128h27m42.172734299s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 16 18:13:47.213254651 (128h29m32.571913308s) [upload=113070]: Done uploading segments...
Nov 16 18:13:47.213331906 (128h29m32.57199057s) [upload=113070]: Upload finished. err: metaclient: context deadline exceeded
Duration: 419.937207ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
441.911273ms trace:
https://jaeger.dev.storj.io/trace/70994c85f165c3a0
FAIL (2025-11-16 18:55:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce...
Nov 16 18:11:56.176141393 (128h27m41.53480005s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176505694 (128h27m41.535164346s) [noise=true , address=81.171.14.70:4029 , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176694869 (128h27m41.535353535s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176906560 (128h27m41.535565213s) [noise=true , address=81.171.14.70:4034 , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178010924 (128h27m41.536669583s) [noise=true , address=81.171.14.70:4041 , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178162029 (128h27m41.53682069s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178624747 (128h27m41.537283407s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.179822806 (128h27m41.538481511s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.181092396 (128h27m41.539751055s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.182267056 (128h27m41.540925728s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.298224599 (128h27m41.656883262s) [upload=113070]: Next returned nil segment
Nov 16 18:11:56.298240977 (128h27m41.656899643s) [upload=113070]: Waiting for error group managing segments...
Nov 16 18:11:56.322992573 (128h27m41.681651228s) [noise=true , address=81.171.14.70:4031 , piece_id=WMGGCRBCTQTVREBKXGD37YVKTKSK2P5SFJV5LH2MGFI3RJXONTKQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.326677846 (128h27m41.6853365s) [noise=true , address=81.171.14.70:4033 , piece_id=UR3UBNCMPQSDNMI44MKZ34MRQ4MYPCLHGWGWNDEPVNJ3GGFDULDQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.327086439 (128h27m41.685745102s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330596159 (128h27m41.689254822s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330894325 (128h27m41.689552985s) [noise=true , address=185.167.204.205:4016 , piece_id=XTDJJJHRNTXLU4D3HJ4OCP2UQR6RF6KHCU6OWSQAPI2Q6SONPKYA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331200302 (128h27m41.689858955s) [noise=true , address=185.167.204.205:4019 , piece_id=LJCJSOQLF4FSLVI7G753ZYDJW6VJJIQCOESIN4KVUHQ36NPZZOHQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331708487 (128h27m41.69036714s) [noise=true , address=185.167.204.206:4061 , piece_id=VWC7K7VZIUF3B47V3XQKWG4WRWFIZSCI4QOW24JI5RC77KZ2VKNQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331819138 (128h27m41.690477798s) [noise=true , address=185.167.204.205:4002 , piece_id=NL2FGXMOTSJRIS7O4ZBTIE2636T4UBL4TBWO3YMA7LCKNTSDGYSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334312534 (128h27m41.692971206s) [noise=true , address=185.167.204.205:4031 , piece_id=J2H4MRWYBVR3FYDVOB7BHQV3XJ2PBXPBKTGIS5SK6N76DDQI3VJA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334376547 (128h27m41.693035205s) [noise=true , address=81.171.14.70:4034 , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334837583 (128h27m41.693496245s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.335363984 (128h27m41.694022646s) [noise=true , address=185.167.204.205:4005 , piece_id=VFVSPAC4QXC5RDOZWH5HS5GLIXCOSRJN67KX65IXBZD2WGULIAJQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.338489129 (128h27m41.697147785s) [noise=true , address=185.167.204.206:4039 , piece_id=S24WYTQCI7XAYTNW5CO6APLU3RRGU4AEJIANW3I5KT5CUHTP5WFQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.340260145 (128h27m41.698918799s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLPSBJNFFRY4KJQRXR4FYNLV4DFOEO6SHIZGTJMSAUHRB4DTBWA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.342507930 (128h27m41.701166584s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.343055650 (128h27m41.701714293s) [noise=true , address=185.167.204.205:4024 , piece_id=EAG5CMHBVOSIFI2WFCQIXQFNGYU4ATNHUUIBQKYKM6B6XETO63YQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.346735021 (128h27m41.705393678s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.348599199 (128h27m41.707257859s) [noise=true , address=185.167.204.206:4051 , piece_id=3OFN2SAZSTHRRM4SNHQCU2IEVOCXMA3BZOLS2YNULUJ5IHFQQSPA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.349247455 (128h27m41.707906114s) [noise=true , address=89.149.201.147:4023 , piece_id=O533J4NWGNLHIAD4SA7VWCHP4WF7GGB33AG4EPFIUMZIVSMCZLSQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.355006125 (128h27m41.713664782s) [noise=true , address=185.167.204.205:4033 , piece_id=SWXEHUBOBIUDILZLZ2NC5G7MGHFPOWU2ZPODJAJV6NFUAYBUYZXQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.360471308 (128h27m41.719129963s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.374029787 (128h27m41.73268843s) [noise=true , address=89.149.201.147:4009 , piece_id=SEU3XXEIWPXZAES7EPYAZQTCKXCOEE7S6CLFL3SZZA3MTBNSMG2A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.789361201 (128h27m42.14801986s) [noise=true , address=81.171.14.70:4030 , piece_id=EPDZQGCWBKEEGW2EMHFP4FVUH4ZCOWFRRVJHH63TX7DF6BUELUIQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.804954891 (128h27m42.163613548s) [noise=true , address=81.171.14.70:4029 , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.805830432 (128h27m42.164489092s) [noise=true , address=81.171.14.70:4041 , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813392799 (128h27m42.172051464s) [noise=true , address=89.149.201.147:4015 , piece_id=W7BFUW3BP7ZK6RTZMKRDLTDIUSA5Y6HA3YXWDPB3MRD3RXDVYZKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813434571 (128h27m42.172093236s) [seg_pos={0 0}, upload=113070]: Segment reached optimal threshold of 26 pieces.
Nov 16 18:11:56.813848675 (128h27m42.172507339s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813864049 (128h27m42.172522714s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813894323 (128h27m42.172552985s) [noise=true , address=89.149.201.147:4022 , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813935878 (128h27m42.172594551s) [noise=true , address=89.149.201.147:4022 , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813968221 (128h27m42.172626877s) [seg_pos={0 0}, upload=113070]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 16 18:11:56.814067848 (128h27m42.172726507s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 16 18:11:56.814075640 (128h27m42.172734299s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 16 18:13:47.213254651 (128h29m32.571913308s) [upload=113070]: Done uploading segments...
Nov 16 18:13:47.213331906 (128h29m32.57199057s) [upload=113070]: Upload finished. err: metaclient: context deadline exceeded
Duration: 441.940495ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
858.423725ms trace:
https://jaeger.dev.storj.io/trace/70994c85f165c3a0
FAIL (2025-11-16 18:54:13 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce...
Nov 16 18:11:56.176141393 (128h27m41.53480005s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176505694 (128h27m41.535164346s) [noise=true , address=81.171.14.70:4029 , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176694869 (128h27m41.535353535s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176906560 (128h27m41.535565213s) [noise=true , address=81.171.14.70:4034 , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178010924 (128h27m41.536669583s) [noise=true , address=81.171.14.70:4041 , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178162029 (128h27m41.53682069s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178624747 (128h27m41.537283407s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.179822806 (128h27m41.538481511s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.181092396 (128h27m41.539751055s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.182267056 (128h27m41.540925728s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.298224599 (128h27m41.656883262s) [upload=113070]: Next returned nil segment
Nov 16 18:11:56.298240977 (128h27m41.656899643s) [upload=113070]: Waiting for error group managing segments...
Nov 16 18:11:56.322992573 (128h27m41.681651228s) [noise=true , address=81.171.14.70:4031 , piece_id=WMGGCRBCTQTVREBKXGD37YVKTKSK2P5SFJV5LH2MGFI3RJXONTKQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.326677846 (128h27m41.6853365s) [noise=true , address=81.171.14.70:4033 , piece_id=UR3UBNCMPQSDNMI44MKZ34MRQ4MYPCLHGWGWNDEPVNJ3GGFDULDQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.327086439 (128h27m41.685745102s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330596159 (128h27m41.689254822s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330894325 (128h27m41.689552985s) [noise=true , address=185.167.204.205:4016 , piece_id=XTDJJJHRNTXLU4D3HJ4OCP2UQR6RF6KHCU6OWSQAPI2Q6SONPKYA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331200302 (128h27m41.689858955s) [noise=true , address=185.167.204.205:4019 , piece_id=LJCJSOQLF4FSLVI7G753ZYDJW6VJJIQCOESIN4KVUHQ36NPZZOHQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331708487 (128h27m41.69036714s) [noise=true , address=185.167.204.206:4061 , piece_id=VWC7K7VZIUF3B47V3XQKWG4WRWFIZSCI4QOW24JI5RC77KZ2VKNQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331819138 (128h27m41.690477798s) [noise=true , address=185.167.204.205:4002 , piece_id=NL2FGXMOTSJRIS7O4ZBTIE2636T4UBL4TBWO3YMA7LCKNTSDGYSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334312534 (128h27m41.692971206s) [noise=true , address=185.167.204.205:4031 , piece_id=J2H4MRWYBVR3FYDVOB7BHQV3XJ2PBXPBKTGIS5SK6N76DDQI3VJA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334376547 (128h27m41.693035205s) [noise=true , address=81.171.14.70:4034 , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334837583 (128h27m41.693496245s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.335363984 (128h27m41.694022646s) [noise=true , address=185.167.204.205:4005 , piece_id=VFVSPAC4QXC5RDOZWH5HS5GLIXCOSRJN67KX65IXBZD2WGULIAJQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.338489129 (128h27m41.697147785s) [noise=true , address=185.167.204.206:4039 , piece_id=S24WYTQCI7XAYTNW5CO6APLU3RRGU4AEJIANW3I5KT5CUHTP5WFQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.340260145 (128h27m41.698918799s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLPSBJNFFRY4KJQRXR4FYNLV4DFOEO6SHIZGTJMSAUHRB4DTBWA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.342507930 (128h27m41.701166584s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.343055650 (128h27m41.701714293s) [noise=true , address=185.167.204.205:4024 , piece_id=EAG5CMHBVOSIFI2WFCQIXQFNGYU4ATNHUUIBQKYKM6B6XETO63YQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.346735021 (128h27m41.705393678s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.348599199 (128h27m41.707257859s) [noise=true , address=185.167.204.206:4051 , piece_id=3OFN2SAZSTHRRM4SNHQCU2IEVOCXMA3BZOLS2YNULUJ5IHFQQSPA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.349247455 (128h27m41.707906114s) [noise=true , address=89.149.201.147:4023 , piece_id=O533J4NWGNLHIAD4SA7VWCHP4WF7GGB33AG4EPFIUMZIVSMCZLSQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.355006125 (128h27m41.713664782s) [noise=true , address=185.167.204.205:4033 , piece_id=SWXEHUBOBIUDILZLZ2NC5G7MGHFPOWU2ZPODJAJV6NFUAYBUYZXQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.360471308 (128h27m41.719129963s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.374029787 (128h27m41.73268843s) [noise=true , address=89.149.201.147:4009 , piece_id=SEU3XXEIWPXZAES7EPYAZQTCKXCOEE7S6CLFL3SZZA3MTBNSMG2A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.789361201 (128h27m42.14801986s) [noise=true , address=81.171.14.70:4030 , piece_id=EPDZQGCWBKEEGW2EMHFP4FVUH4ZCOWFRRVJHH63TX7DF6BUELUIQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.804954891 (128h27m42.163613548s) [noise=true , address=81.171.14.70:4029 , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.805830432 (128h27m42.164489092s) [noise=true , address=81.171.14.70:4041 , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813392799 (128h27m42.172051464s) [noise=true , address=89.149.201.147:4015 , piece_id=W7BFUW3BP7ZK6RTZMKRDLTDIUSA5Y6HA3YXWDPB3MRD3RXDVYZKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813434571 (128h27m42.172093236s) [seg_pos={0 0}, upload=113070]: Segment reached optimal threshold of 26 pieces.
Nov 16 18:11:56.813848675 (128h27m42.172507339s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813864049 (128h27m42.172522714s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813894323 (128h27m42.172552985s) [noise=true , address=89.149.201.147:4022 , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813935878 (128h27m42.172594551s) [noise=true , address=89.149.201.147:4022 , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813968221 (128h27m42.172626877s) [seg_pos={0 0}, upload=113070]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 16 18:11:56.814067848 (128h27m42.172726507s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 16 18:11:56.814075640 (128h27m42.172734299s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 16 18:13:47.213254651 (128h29m32.571913308s) [upload=113070]: Done uploading segments...
Nov 16 18:13:47.213331906 (128h29m32.57199057s) [upload=113070]: Upload finished. err: metaclient: context deadline exceeded
Duration: 858.468854ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
431.474635ms trace:
https://jaeger.dev.storj.io/trace/70994c85f165c3a0
FAIL (2025-11-16 18:53:04 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce...
Nov 16 18:11:56.176141393 (128h27m41.53480005s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176505694 (128h27m41.535164346s) [noise=true , address=81.171.14.70:4029 , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176694869 (128h27m41.535353535s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176906560 (128h27m41.535565213s) [noise=true , address=81.171.14.70:4034 , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178010924 (128h27m41.536669583s) [noise=true , address=81.171.14.70:4041 , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178162029 (128h27m41.53682069s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178624747 (128h27m41.537283407s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.179822806 (128h27m41.538481511s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.181092396 (128h27m41.539751055s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.182267056 (128h27m41.540925728s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.298224599 (128h27m41.656883262s) [upload=113070]: Next returned nil segment
Nov 16 18:11:56.298240977 (128h27m41.656899643s) [upload=113070]: Waiting for error group managing segments...
Nov 16 18:11:56.322992573 (128h27m41.681651228s) [noise=true , address=81.171.14.70:4031 , piece_id=WMGGCRBCTQTVREBKXGD37YVKTKSK2P5SFJV5LH2MGFI3RJXONTKQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.326677846 (128h27m41.6853365s) [noise=true , address=81.171.14.70:4033 , piece_id=UR3UBNCMPQSDNMI44MKZ34MRQ4MYPCLHGWGWNDEPVNJ3GGFDULDQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.327086439 (128h27m41.685745102s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330596159 (128h27m41.689254822s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330894325 (128h27m41.689552985s) [noise=true , address=185.167.204.205:4016 , piece_id=XTDJJJHRNTXLU4D3HJ4OCP2UQR6RF6KHCU6OWSQAPI2Q6SONPKYA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331200302 (128h27m41.689858955s) [noise=true , address=185.167.204.205:4019 , piece_id=LJCJSOQLF4FSLVI7G753ZYDJW6VJJIQCOESIN4KVUHQ36NPZZOHQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331708487 (128h27m41.69036714s) [noise=true , address=185.167.204.206:4061 , piece_id=VWC7K7VZIUF3B47V3XQKWG4WRWFIZSCI4QOW24JI5RC77KZ2VKNQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331819138 (128h27m41.690477798s) [noise=true , address=185.167.204.205:4002 , piece_id=NL2FGXMOTSJRIS7O4ZBTIE2636T4UBL4TBWO3YMA7LCKNTSDGYSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334312534 (128h27m41.692971206s) [noise=true , address=185.167.204.205:4031 , piece_id=J2H4MRWYBVR3FYDVOB7BHQV3XJ2PBXPBKTGIS5SK6N76DDQI3VJA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334376547 (128h27m41.693035205s) [noise=true , address=81.171.14.70:4034 , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334837583 (128h27m41.693496245s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.335363984 (128h27m41.694022646s) [noise=true , address=185.167.204.205:4005 , piece_id=VFVSPAC4QXC5RDOZWH5HS5GLIXCOSRJN67KX65IXBZD2WGULIAJQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.338489129 (128h27m41.697147785s) [noise=true , address=185.167.204.206:4039 , piece_id=S24WYTQCI7XAYTNW5CO6APLU3RRGU4AEJIANW3I5KT5CUHTP5WFQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.340260145 (128h27m41.698918799s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLPSBJNFFRY4KJQRXR4FYNLV4DFOEO6SHIZGTJMSAUHRB4DTBWA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.342507930 (128h27m41.701166584s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.343055650 (128h27m41.701714293s) [noise=true , address=185.167.204.205:4024 , piece_id=EAG5CMHBVOSIFI2WFCQIXQFNGYU4ATNHUUIBQKYKM6B6XETO63YQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.346735021 (128h27m41.705393678s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.348599199 (128h27m41.707257859s) [noise=true , address=185.167.204.206:4051 , piece_id=3OFN2SAZSTHRRM4SNHQCU2IEVOCXMA3BZOLS2YNULUJ5IHFQQSPA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.349247455 (128h27m41.707906114s) [noise=true , address=89.149.201.147:4023 , piece_id=O533J4NWGNLHIAD4SA7VWCHP4WF7GGB33AG4EPFIUMZIVSMCZLSQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.355006125 (128h27m41.713664782s) [noise=true , address=185.167.204.205:4033 , piece_id=SWXEHUBOBIUDILZLZ2NC5G7MGHFPOWU2ZPODJAJV6NFUAYBUYZXQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.360471308 (128h27m41.719129963s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.374029787 (128h27m41.73268843s) [noise=true , address=89.149.201.147:4009 , piece_id=SEU3XXEIWPXZAES7EPYAZQTCKXCOEE7S6CLFL3SZZA3MTBNSMG2A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.789361201 (128h27m42.14801986s) [noise=true , address=81.171.14.70:4030 , piece_id=EPDZQGCWBKEEGW2EMHFP4FVUH4ZCOWFRRVJHH63TX7DF6BUELUIQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.804954891 (128h27m42.163613548s) [noise=true , address=81.171.14.70:4029 , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.805830432 (128h27m42.164489092s) [noise=true , address=81.171.14.70:4041 , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813392799 (128h27m42.172051464s) [noise=true , address=89.149.201.147:4015 , piece_id=W7BFUW3BP7ZK6RTZMKRDLTDIUSA5Y6HA3YXWDPB3MRD3RXDVYZKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813434571 (128h27m42.172093236s) [seg_pos={0 0}, upload=113070]: Segment reached optimal threshold of 26 pieces.
Nov 16 18:11:56.813848675 (128h27m42.172507339s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813864049 (128h27m42.172522714s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813894323 (128h27m42.172552985s) [noise=true , address=89.149.201.147:4022 , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813935878 (128h27m42.172594551s) [noise=true , address=89.149.201.147:4022 , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813968221 (128h27m42.172626877s) [seg_pos={0 0}, upload=113070]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 16 18:11:56.814067848 (128h27m42.172726507s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 16 18:11:56.814075640 (128h27m42.172734299s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 16 18:13:47.213254651 (128h29m32.571913308s) [upload=113070]: Done uploading segments...
Nov 16 18:13:47.213331906 (128h29m32.57199057s) [upload=113070]: Upload finished. err: metaclient: context deadline exceeded
Duration: 431.563433ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
610.651282ms trace:
https://jaeger.dev.storj.io/trace/70994c85f165c3a0
FAIL (2025-11-16 18:52:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce...
Nov 16 18:11:56.176141393 (128h27m41.53480005s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176505694 (128h27m41.535164346s) [noise=true , address=81.171.14.70:4029 , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176694869 (128h27m41.535353535s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176906560 (128h27m41.535565213s) [noise=true , address=81.171.14.70:4034 , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178010924 (128h27m41.536669583s) [noise=true , address=81.171.14.70:4041 , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178162029 (128h27m41.53682069s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178624747 (128h27m41.537283407s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.179822806 (128h27m41.538481511s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.181092396 (128h27m41.539751055s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.182267056 (128h27m41.540925728s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.298224599 (128h27m41.656883262s) [upload=113070]: Next returned nil segment
Nov 16 18:11:56.298240977 (128h27m41.656899643s) [upload=113070]: Waiting for error group managing segments...
Nov 16 18:11:56.322992573 (128h27m41.681651228s) [noise=true , address=81.171.14.70:4031 , piece_id=WMGGCRBCTQTVREBKXGD37YVKTKSK2P5SFJV5LH2MGFI3RJXONTKQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.326677846 (128h27m41.6853365s) [noise=true , address=81.171.14.70:4033 , piece_id=UR3UBNCMPQSDNMI44MKZ34MRQ4MYPCLHGWGWNDEPVNJ3GGFDULDQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.327086439 (128h27m41.685745102s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330596159 (128h27m41.689254822s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330894325 (128h27m41.689552985s) [noise=true , address=185.167.204.205:4016 , piece_id=XTDJJJHRNTXLU4D3HJ4OCP2UQR6RF6KHCU6OWSQAPI2Q6SONPKYA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331200302 (128h27m41.689858955s) [noise=true , address=185.167.204.205:4019 , piece_id=LJCJSOQLF4FSLVI7G753ZYDJW6VJJIQCOESIN4KVUHQ36NPZZOHQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331708487 (128h27m41.69036714s) [noise=true , address=185.167.204.206:4061 , piece_id=VWC7K7VZIUF3B47V3XQKWG4WRWFIZSCI4QOW24JI5RC77KZ2VKNQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331819138 (128h27m41.690477798s) [noise=true , address=185.167.204.205:4002 , piece_id=NL2FGXMOTSJRIS7O4ZBTIE2636T4UBL4TBWO3YMA7LCKNTSDGYSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334312534 (128h27m41.692971206s) [noise=true , address=185.167.204.205:4031 , piece_id=J2H4MRWYBVR3FYDVOB7BHQV3XJ2PBXPBKTGIS5SK6N76DDQI3VJA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334376547 (128h27m41.693035205s) [noise=true , address=81.171.14.70:4034 , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334837583 (128h27m41.693496245s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.335363984 (128h27m41.694022646s) [noise=true , address=185.167.204.205:4005 , piece_id=VFVSPAC4QXC5RDOZWH5HS5GLIXCOSRJN67KX65IXBZD2WGULIAJQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.338489129 (128h27m41.697147785s) [noise=true , address=185.167.204.206:4039 , piece_id=S24WYTQCI7XAYTNW5CO6APLU3RRGU4AEJIANW3I5KT5CUHTP5WFQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.340260145 (128h27m41.698918799s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLPSBJNFFRY4KJQRXR4FYNLV4DFOEO6SHIZGTJMSAUHRB4DTBWA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.342507930 (128h27m41.701166584s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.343055650 (128h27m41.701714293s) [noise=true , address=185.167.204.205:4024 , piece_id=EAG5CMHBVOSIFI2WFCQIXQFNGYU4ATNHUUIBQKYKM6B6XETO63YQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.346735021 (128h27m41.705393678s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.348599199 (128h27m41.707257859s) [noise=true , address=185.167.204.206:4051 , piece_id=3OFN2SAZSTHRRM4SNHQCU2IEVOCXMA3BZOLS2YNULUJ5IHFQQSPA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.349247455 (128h27m41.707906114s) [noise=true , address=89.149.201.147:4023 , piece_id=O533J4NWGNLHIAD4SA7VWCHP4WF7GGB33AG4EPFIUMZIVSMCZLSQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.355006125 (128h27m41.713664782s) [noise=true , address=185.167.204.205:4033 , piece_id=SWXEHUBOBIUDILZLZ2NC5G7MGHFPOWU2ZPODJAJV6NFUAYBUYZXQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.360471308 (128h27m41.719129963s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.374029787 (128h27m41.73268843s) [noise=true , address=89.149.201.147:4009 , piece_id=SEU3XXEIWPXZAES7EPYAZQTCKXCOEE7S6CLFL3SZZA3MTBNSMG2A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.789361201 (128h27m42.14801986s) [noise=true , address=81.171.14.70:4030 , piece_id=EPDZQGCWBKEEGW2EMHFP4FVUH4ZCOWFRRVJHH63TX7DF6BUELUIQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.804954891 (128h27m42.163613548s) [noise=true , address=81.171.14.70:4029 , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.805830432 (128h27m42.164489092s) [noise=true , address=81.171.14.70:4041 , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813392799 (128h27m42.172051464s) [noise=true , address=89.149.201.147:4015 , piece_id=W7BFUW3BP7ZK6RTZMKRDLTDIUSA5Y6HA3YXWDPB3MRD3RXDVYZKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813434571 (128h27m42.172093236s) [seg_pos={0 0}, upload=113070]: Segment reached optimal threshold of 26 pieces.
Nov 16 18:11:56.813848675 (128h27m42.172507339s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813864049 (128h27m42.172522714s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813894323 (128h27m42.172552985s) [noise=true , address=89.149.201.147:4022 , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813935878 (128h27m42.172594551s) [noise=true , address=89.149.201.147:4022 , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813968221 (128h27m42.172626877s) [seg_pos={0 0}, upload=113070]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 16 18:11:56.814067848 (128h27m42.172726507s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 16 18:11:56.814075640 (128h27m42.172734299s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 16 18:13:47.213254651 (128h29m32.571913308s) [upload=113070]: Done uploading segments...
Nov 16 18:13:47.213331906 (128h29m32.57199057s) [upload=113070]: Upload finished. err: metaclient: context deadline exceeded
Duration: 610.671617ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
845.808327ms trace:
https://jaeger.dev.storj.io/trace/70994c85f165c3a0
FAIL (2025-11-16 18:51:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce...
Nov 16 18:11:56.176141393 (128h27m41.53480005s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176505694 (128h27m41.535164346s) [noise=true , address=81.171.14.70:4029 , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176694869 (128h27m41.535353535s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176906560 (128h27m41.535565213s) [noise=true , address=81.171.14.70:4034 , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178010924 (128h27m41.536669583s) [noise=true , address=81.171.14.70:4041 , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178162029 (128h27m41.53682069s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178624747 (128h27m41.537283407s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.179822806 (128h27m41.538481511s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.181092396 (128h27m41.539751055s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.182267056 (128h27m41.540925728s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.298224599 (128h27m41.656883262s) [upload=113070]: Next returned nil segment
Nov 16 18:11:56.298240977 (128h27m41.656899643s) [upload=113070]: Waiting for error group managing segments...
Nov 16 18:11:56.322992573 (128h27m41.681651228s) [noise=true , address=81.171.14.70:4031 , piece_id=WMGGCRBCTQTVREBKXGD37YVKTKSK2P5SFJV5LH2MGFI3RJXONTKQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.326677846 (128h27m41.6853365s) [noise=true , address=81.171.14.70:4033 , piece_id=UR3UBNCMPQSDNMI44MKZ34MRQ4MYPCLHGWGWNDEPVNJ3GGFDULDQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.327086439 (128h27m41.685745102s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330596159 (128h27m41.689254822s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330894325 (128h27m41.689552985s) [noise=true , address=185.167.204.205:4016 , piece_id=XTDJJJHRNTXLU4D3HJ4OCP2UQR6RF6KHCU6OWSQAPI2Q6SONPKYA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331200302 (128h27m41.689858955s) [noise=true , address=185.167.204.205:4019 , piece_id=LJCJSOQLF4FSLVI7G753ZYDJW6VJJIQCOESIN4KVUHQ36NPZZOHQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331708487 (128h27m41.69036714s) [noise=true , address=185.167.204.206:4061 , piece_id=VWC7K7VZIUF3B47V3XQKWG4WRWFIZSCI4QOW24JI5RC77KZ2VKNQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331819138 (128h27m41.690477798s) [noise=true , address=185.167.204.205:4002 , piece_id=NL2FGXMOTSJRIS7O4ZBTIE2636T4UBL4TBWO3YMA7LCKNTSDGYSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334312534 (128h27m41.692971206s) [noise=true , address=185.167.204.205:4031 , piece_id=J2H4MRWYBVR3FYDVOB7BHQV3XJ2PBXPBKTGIS5SK6N76DDQI3VJA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334376547 (128h27m41.693035205s) [noise=true , address=81.171.14.70:4034 , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334837583 (128h27m41.693496245s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.335363984 (128h27m41.694022646s) [noise=true , address=185.167.204.205:4005 , piece_id=VFVSPAC4QXC5RDOZWH5HS5GLIXCOSRJN67KX65IXBZD2WGULIAJQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.338489129 (128h27m41.697147785s) [noise=true , address=185.167.204.206:4039 , piece_id=S24WYTQCI7XAYTNW5CO6APLU3RRGU4AEJIANW3I5KT5CUHTP5WFQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.340260145 (128h27m41.698918799s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLPSBJNFFRY4KJQRXR4FYNLV4DFOEO6SHIZGTJMSAUHRB4DTBWA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.342507930 (128h27m41.701166584s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.343055650 (128h27m41.701714293s) [noise=true , address=185.167.204.205:4024 , piece_id=EAG5CMHBVOSIFI2WFCQIXQFNGYU4ATNHUUIBQKYKM6B6XETO63YQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.346735021 (128h27m41.705393678s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.348599199 (128h27m41.707257859s) [noise=true , address=185.167.204.206:4051 , piece_id=3OFN2SAZSTHRRM4SNHQCU2IEVOCXMA3BZOLS2YNULUJ5IHFQQSPA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.349247455 (128h27m41.707906114s) [noise=true , address=89.149.201.147:4023 , piece_id=O533J4NWGNLHIAD4SA7VWCHP4WF7GGB33AG4EPFIUMZIVSMCZLSQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.355006125 (128h27m41.713664782s) [noise=true , address=185.167.204.205:4033 , piece_id=SWXEHUBOBIUDILZLZ2NC5G7MGHFPOWU2ZPODJAJV6NFUAYBUYZXQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.360471308 (128h27m41.719129963s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.374029787 (128h27m41.73268843s) [noise=true , address=89.149.201.147:4009 , piece_id=SEU3XXEIWPXZAES7EPYAZQTCKXCOEE7S6CLFL3SZZA3MTBNSMG2A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.789361201 (128h27m42.14801986s) [noise=true , address=81.171.14.70:4030 , piece_id=EPDZQGCWBKEEGW2EMHFP4FVUH4ZCOWFRRVJHH63TX7DF6BUELUIQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.804954891 (128h27m42.163613548s) [noise=true , address=81.171.14.70:4029 , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.805830432 (128h27m42.164489092s) [noise=true , address=81.171.14.70:4041 , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813392799 (128h27m42.172051464s) [noise=true , address=89.149.201.147:4015 , piece_id=W7BFUW3BP7ZK6RTZMKRDLTDIUSA5Y6HA3YXWDPB3MRD3RXDVYZKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813434571 (128h27m42.172093236s) [seg_pos={0 0}, upload=113070]: Segment reached optimal threshold of 26 pieces.
Nov 16 18:11:56.813848675 (128h27m42.172507339s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813864049 (128h27m42.172522714s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813894323 (128h27m42.172552985s) [noise=true , address=89.149.201.147:4022 , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813935878 (128h27m42.172594551s) [noise=true , address=89.149.201.147:4022 , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813968221 (128h27m42.172626877s) [seg_pos={0 0}, upload=113070]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 16 18:11:56.814067848 (128h27m42.172726507s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 16 18:11:56.814075640 (128h27m42.172734299s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 16 18:13:47.213254651 (128h29m32.571913308s) [upload=113070]: Done uploading segments...
Nov 16 18:13:47.213331906 (128h29m32.57199057s) [upload=113070]: Upload finished. err: metaclient: context deadline exceeded
Duration: 845.850602ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
388.587868ms trace:
https://jaeger.dev.storj.io/trace/70994c85f165c3a0
FAIL (2025-11-16 18:51:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce...
Nov 16 18:11:56.176141393 (128h27m41.53480005s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176505694 (128h27m41.535164346s) [noise=true , address=81.171.14.70:4029 , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176694869 (128h27m41.535353535s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176906560 (128h27m41.535565213s) [noise=true , address=81.171.14.70:4034 , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178010924 (128h27m41.536669583s) [noise=true , address=81.171.14.70:4041 , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178162029 (128h27m41.53682069s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178624747 (128h27m41.537283407s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.179822806 (128h27m41.538481511s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.181092396 (128h27m41.539751055s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.182267056 (128h27m41.540925728s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.298224599 (128h27m41.656883262s) [upload=113070]: Next returned nil segment
Nov 16 18:11:56.298240977 (128h27m41.656899643s) [upload=113070]: Waiting for error group managing segments...
Nov 16 18:11:56.322992573 (128h27m41.681651228s) [noise=true , address=81.171.14.70:4031 , piece_id=WMGGCRBCTQTVREBKXGD37YVKTKSK2P5SFJV5LH2MGFI3RJXONTKQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.326677846 (128h27m41.6853365s) [noise=true , address=81.171.14.70:4033 , piece_id=UR3UBNCMPQSDNMI44MKZ34MRQ4MYPCLHGWGWNDEPVNJ3GGFDULDQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.327086439 (128h27m41.685745102s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330596159 (128h27m41.689254822s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330894325 (128h27m41.689552985s) [noise=true , address=185.167.204.205:4016 , piece_id=XTDJJJHRNTXLU4D3HJ4OCP2UQR6RF6KHCU6OWSQAPI2Q6SONPKYA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331200302 (128h27m41.689858955s) [noise=true , address=185.167.204.205:4019 , piece_id=LJCJSOQLF4FSLVI7G753ZYDJW6VJJIQCOESIN4KVUHQ36NPZZOHQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331708487 (128h27m41.69036714s) [noise=true , address=185.167.204.206:4061 , piece_id=VWC7K7VZIUF3B47V3XQKWG4WRWFIZSCI4QOW24JI5RC77KZ2VKNQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331819138 (128h27m41.690477798s) [noise=true , address=185.167.204.205:4002 , piece_id=NL2FGXMOTSJRIS7O4ZBTIE2636T4UBL4TBWO3YMA7LCKNTSDGYSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334312534 (128h27m41.692971206s) [noise=true , address=185.167.204.205:4031 , piece_id=J2H4MRWYBVR3FYDVOB7BHQV3XJ2PBXPBKTGIS5SK6N76DDQI3VJA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334376547 (128h27m41.693035205s) [noise=true , address=81.171.14.70:4034 , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334837583 (128h27m41.693496245s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.335363984 (128h27m41.694022646s) [noise=true , address=185.167.204.205:4005 , piece_id=VFVSPAC4QXC5RDOZWH5HS5GLIXCOSRJN67KX65IXBZD2WGULIAJQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.338489129 (128h27m41.697147785s) [noise=true , address=185.167.204.206:4039 , piece_id=S24WYTQCI7XAYTNW5CO6APLU3RRGU4AEJIANW3I5KT5CUHTP5WFQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.340260145 (128h27m41.698918799s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLPSBJNFFRY4KJQRXR4FYNLV4DFOEO6SHIZGTJMSAUHRB4DTBWA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.342507930 (128h27m41.701166584s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.343055650 (128h27m41.701714293s) [noise=true , address=185.167.204.205:4024 , piece_id=EAG5CMHBVOSIFI2WFCQIXQFNGYU4ATNHUUIBQKYKM6B6XETO63YQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.346735021 (128h27m41.705393678s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.348599199 (128h27m41.707257859s) [noise=true , address=185.167.204.206:4051 , piece_id=3OFN2SAZSTHRRM4SNHQCU2IEVOCXMA3BZOLS2YNULUJ5IHFQQSPA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.349247455 (128h27m41.707906114s) [noise=true , address=89.149.201.147:4023 , piece_id=O533J4NWGNLHIAD4SA7VWCHP4WF7GGB33AG4EPFIUMZIVSMCZLSQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.355006125 (128h27m41.713664782s) [noise=true , address=185.167.204.205:4033 , piece_id=SWXEHUBOBIUDILZLZ2NC5G7MGHFPOWU2ZPODJAJV6NFUAYBUYZXQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.360471308 (128h27m41.719129963s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.374029787 (128h27m41.73268843s) [noise=true , address=89.149.201.147:4009 , piece_id=SEU3XXEIWPXZAES7EPYAZQTCKXCOEE7S6CLFL3SZZA3MTBNSMG2A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.789361201 (128h27m42.14801986s) [noise=true , address=81.171.14.70:4030 , piece_id=EPDZQGCWBKEEGW2EMHFP4FVUH4ZCOWFRRVJHH63TX7DF6BUELUIQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.804954891 (128h27m42.163613548s) [noise=true , address=81.171.14.70:4029 , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.805830432 (128h27m42.164489092s) [noise=true , address=81.171.14.70:4041 , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813392799 (128h27m42.172051464s) [noise=true , address=89.149.201.147:4015 , piece_id=W7BFUW3BP7ZK6RTZMKRDLTDIUSA5Y6HA3YXWDPB3MRD3RXDVYZKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813434571 (128h27m42.172093236s) [seg_pos={0 0}, upload=113070]: Segment reached optimal threshold of 26 pieces.
Nov 16 18:11:56.813848675 (128h27m42.172507339s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813864049 (128h27m42.172522714s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813894323 (128h27m42.172552985s) [noise=true , address=89.149.201.147:4022 , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813935878 (128h27m42.172594551s) [noise=true , address=89.149.201.147:4022 , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813968221 (128h27m42.172626877s) [seg_pos={0 0}, upload=113070]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 16 18:11:56.814067848 (128h27m42.172726507s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 16 18:11:56.814075640 (128h27m42.172734299s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 16 18:13:47.213254651 (128h29m32.571913308s) [upload=113070]: Done uploading segments...
Nov 16 18:13:47.213331906 (128h29m32.57199057s) [upload=113070]: Upload finished. err: metaclient: context deadline exceeded
Duration: 388.618618ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
506.615773ms trace:
https://jaeger.dev.storj.io/trace/70994c85f165c3a0
FAIL (2025-11-16 18:50:53 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce...
Nov 16 18:11:56.176141393 (128h27m41.53480005s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176505694 (128h27m41.535164346s) [noise=true , address=81.171.14.70:4029 , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176694869 (128h27m41.535353535s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176906560 (128h27m41.535565213s) [noise=true , address=81.171.14.70:4034 , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178010924 (128h27m41.536669583s) [noise=true , address=81.171.14.70:4041 , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178162029 (128h27m41.53682069s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178624747 (128h27m41.537283407s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.179822806 (128h27m41.538481511s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.181092396 (128h27m41.539751055s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.182267056 (128h27m41.540925728s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.298224599 (128h27m41.656883262s) [upload=113070]: Next returned nil segment
Nov 16 18:11:56.298240977 (128h27m41.656899643s) [upload=113070]: Waiting for error group managing segments...
Nov 16 18:11:56.322992573 (128h27m41.681651228s) [noise=true , address=81.171.14.70:4031 , piece_id=WMGGCRBCTQTVREBKXGD37YVKTKSK2P5SFJV5LH2MGFI3RJXONTKQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.326677846 (128h27m41.6853365s) [noise=true , address=81.171.14.70:4033 , piece_id=UR3UBNCMPQSDNMI44MKZ34MRQ4MYPCLHGWGWNDEPVNJ3GGFDULDQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.327086439 (128h27m41.685745102s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330596159 (128h27m41.689254822s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330894325 (128h27m41.689552985s) [noise=true , address=185.167.204.205:4016 , piece_id=XTDJJJHRNTXLU4D3HJ4OCP2UQR6RF6KHCU6OWSQAPI2Q6SONPKYA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331200302 (128h27m41.689858955s) [noise=true , address=185.167.204.205:4019 , piece_id=LJCJSOQLF4FSLVI7G753ZYDJW6VJJIQCOESIN4KVUHQ36NPZZOHQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331708487 (128h27m41.69036714s) [noise=true , address=185.167.204.206:4061 , piece_id=VWC7K7VZIUF3B47V3XQKWG4WRWFIZSCI4QOW24JI5RC77KZ2VKNQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331819138 (128h27m41.690477798s) [noise=true , address=185.167.204.205:4002 , piece_id=NL2FGXMOTSJRIS7O4ZBTIE2636T4UBL4TBWO3YMA7LCKNTSDGYSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334312534 (128h27m41.692971206s) [noise=true , address=185.167.204.205:4031 , piece_id=J2H4MRWYBVR3FYDVOB7BHQV3XJ2PBXPBKTGIS5SK6N76DDQI3VJA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334376547 (128h27m41.693035205s) [noise=true , address=81.171.14.70:4034 , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334837583 (128h27m41.693496245s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.335363984 (128h27m41.694022646s) [noise=true , address=185.167.204.205:4005 , piece_id=VFVSPAC4QXC5RDOZWH5HS5GLIXCOSRJN67KX65IXBZD2WGULIAJQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.338489129 (128h27m41.697147785s) [noise=true , address=185.167.204.206:4039 , piece_id=S24WYTQCI7XAYTNW5CO6APLU3RRGU4AEJIANW3I5KT5CUHTP5WFQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.340260145 (128h27m41.698918799s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLPSBJNFFRY4KJQRXR4FYNLV4DFOEO6SHIZGTJMSAUHRB4DTBWA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.342507930 (128h27m41.701166584s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.343055650 (128h27m41.701714293s) [noise=true , address=185.167.204.205:4024 , piece_id=EAG5CMHBVOSIFI2WFCQIXQFNGYU4ATNHUUIBQKYKM6B6XETO63YQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.346735021 (128h27m41.705393678s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.348599199 (128h27m41.707257859s) [noise=true , address=185.167.204.206:4051 , piece_id=3OFN2SAZSTHRRM4SNHQCU2IEVOCXMA3BZOLS2YNULUJ5IHFQQSPA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.349247455 (128h27m41.707906114s) [noise=true , address=89.149.201.147:4023 , piece_id=O533J4NWGNLHIAD4SA7VWCHP4WF7GGB33AG4EPFIUMZIVSMCZLSQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.355006125 (128h27m41.713664782s) [noise=true , address=185.167.204.205:4033 , piece_id=SWXEHUBOBIUDILZLZ2NC5G7MGHFPOWU2ZPODJAJV6NFUAYBUYZXQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.360471308 (128h27m41.719129963s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.374029787 (128h27m41.73268843s) [noise=true , address=89.149.201.147:4009 , piece_id=SEU3XXEIWPXZAES7EPYAZQTCKXCOEE7S6CLFL3SZZA3MTBNSMG2A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.789361201 (128h27m42.14801986s) [noise=true , address=81.171.14.70:4030 , piece_id=EPDZQGCWBKEEGW2EMHFP4FVUH4ZCOWFRRVJHH63TX7DF6BUELUIQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.804954891 (128h27m42.163613548s) [noise=true , address=81.171.14.70:4029 , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.805830432 (128h27m42.164489092s) [noise=true , address=81.171.14.70:4041 , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813392799 (128h27m42.172051464s) [noise=true , address=89.149.201.147:4015 , piece_id=W7BFUW3BP7ZK6RTZMKRDLTDIUSA5Y6HA3YXWDPB3MRD3RXDVYZKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813434571 (128h27m42.172093236s) [seg_pos={0 0}, upload=113070]: Segment reached optimal threshold of 26 pieces.
Nov 16 18:11:56.813848675 (128h27m42.172507339s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813864049 (128h27m42.172522714s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813894323 (128h27m42.172552985s) [noise=true , address=89.149.201.147:4022 , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813935878 (128h27m42.172594551s) [noise=true , address=89.149.201.147:4022 , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813968221 (128h27m42.172626877s) [seg_pos={0 0}, upload=113070]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 16 18:11:56.814067848 (128h27m42.172726507s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 16 18:11:56.814075640 (128h27m42.172734299s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 16 18:13:47.213254651 (128h29m32.571913308s) [upload=113070]: Done uploading segments...
Nov 16 18:13:47.213331906 (128h29m32.57199057s) [upload=113070]: Upload finished. err: metaclient: context deadline exceeded
Duration: 506.649322ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
441.326487ms trace:
https://jaeger.dev.storj.io/trace/70994c85f165c3a0
FAIL (2025-11-16 18:49:46 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce...
Nov 16 18:11:56.176141393 (128h27m41.53480005s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176505694 (128h27m41.535164346s) [noise=true , address=81.171.14.70:4029 , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176694869 (128h27m41.535353535s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176906560 (128h27m41.535565213s) [noise=true , address=81.171.14.70:4034 , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178010924 (128h27m41.536669583s) [noise=true , address=81.171.14.70:4041 , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178162029 (128h27m41.53682069s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178624747 (128h27m41.537283407s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.179822806 (128h27m41.538481511s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.181092396 (128h27m41.539751055s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.182267056 (128h27m41.540925728s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.298224599 (128h27m41.656883262s) [upload=113070]: Next returned nil segment
Nov 16 18:11:56.298240977 (128h27m41.656899643s) [upload=113070]: Waiting for error group managing segments...
Nov 16 18:11:56.322992573 (128h27m41.681651228s) [noise=true , address=81.171.14.70:4031 , piece_id=WMGGCRBCTQTVREBKXGD37YVKTKSK2P5SFJV5LH2MGFI3RJXONTKQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.326677846 (128h27m41.6853365s) [noise=true , address=81.171.14.70:4033 , piece_id=UR3UBNCMPQSDNMI44MKZ34MRQ4MYPCLHGWGWNDEPVNJ3GGFDULDQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.327086439 (128h27m41.685745102s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330596159 (128h27m41.689254822s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330894325 (128h27m41.689552985s) [noise=true , address=185.167.204.205:4016 , piece_id=XTDJJJHRNTXLU4D3HJ4OCP2UQR6RF6KHCU6OWSQAPI2Q6SONPKYA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331200302 (128h27m41.689858955s) [noise=true , address=185.167.204.205:4019 , piece_id=LJCJSOQLF4FSLVI7G753ZYDJW6VJJIQCOESIN4KVUHQ36NPZZOHQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331708487 (128h27m41.69036714s) [noise=true , address=185.167.204.206:4061 , piece_id=VWC7K7VZIUF3B47V3XQKWG4WRWFIZSCI4QOW24JI5RC77KZ2VKNQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331819138 (128h27m41.690477798s) [noise=true , address=185.167.204.205:4002 , piece_id=NL2FGXMOTSJRIS7O4ZBTIE2636T4UBL4TBWO3YMA7LCKNTSDGYSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334312534 (128h27m41.692971206s) [noise=true , address=185.167.204.205:4031 , piece_id=J2H4MRWYBVR3FYDVOB7BHQV3XJ2PBXPBKTGIS5SK6N76DDQI3VJA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334376547 (128h27m41.693035205s) [noise=true , address=81.171.14.70:4034 , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334837583 (128h27m41.693496245s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.335363984 (128h27m41.694022646s) [noise=true , address=185.167.204.205:4005 , piece_id=VFVSPAC4QXC5RDOZWH5HS5GLIXCOSRJN67KX65IXBZD2WGULIAJQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.338489129 (128h27m41.697147785s) [noise=true , address=185.167.204.206:4039 , piece_id=S24WYTQCI7XAYTNW5CO6APLU3RRGU4AEJIANW3I5KT5CUHTP5WFQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.340260145 (128h27m41.698918799s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLPSBJNFFRY4KJQRXR4FYNLV4DFOEO6SHIZGTJMSAUHRB4DTBWA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.342507930 (128h27m41.701166584s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.343055650 (128h27m41.701714293s) [noise=true , address=185.167.204.205:4024 , piece_id=EAG5CMHBVOSIFI2WFCQIXQFNGYU4ATNHUUIBQKYKM6B6XETO63YQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.346735021 (128h27m41.705393678s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.348599199 (128h27m41.707257859s) [noise=true , address=185.167.204.206:4051 , piece_id=3OFN2SAZSTHRRM4SNHQCU2IEVOCXMA3BZOLS2YNULUJ5IHFQQSPA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.349247455 (128h27m41.707906114s) [noise=true , address=89.149.201.147:4023 , piece_id=O533J4NWGNLHIAD4SA7VWCHP4WF7GGB33AG4EPFIUMZIVSMCZLSQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.355006125 (128h27m41.713664782s) [noise=true , address=185.167.204.205:4033 , piece_id=SWXEHUBOBIUDILZLZ2NC5G7MGHFPOWU2ZPODJAJV6NFUAYBUYZXQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.360471308 (128h27m41.719129963s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.374029787 (128h27m41.73268843s) [noise=true , address=89.149.201.147:4009 , piece_id=SEU3XXEIWPXZAES7EPYAZQTCKXCOEE7S6CLFL3SZZA3MTBNSMG2A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.789361201 (128h27m42.14801986s) [noise=true , address=81.171.14.70:4030 , piece_id=EPDZQGCWBKEEGW2EMHFP4FVUH4ZCOWFRRVJHH63TX7DF6BUELUIQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.804954891 (128h27m42.163613548s) [noise=true , address=81.171.14.70:4029 , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.805830432 (128h27m42.164489092s) [noise=true , address=81.171.14.70:4041 , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813392799 (128h27m42.172051464s) [noise=true , address=89.149.201.147:4015 , piece_id=W7BFUW3BP7ZK6RTZMKRDLTDIUSA5Y6HA3YXWDPB3MRD3RXDVYZKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813434571 (128h27m42.172093236s) [seg_pos={0 0}, upload=113070]: Segment reached optimal threshold of 26 pieces.
Nov 16 18:11:56.813848675 (128h27m42.172507339s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813864049 (128h27m42.172522714s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813894323 (128h27m42.172552985s) [noise=true , address=89.149.201.147:4022 , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813935878 (128h27m42.172594551s) [noise=true , address=89.149.201.147:4022 , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813968221 (128h27m42.172626877s) [seg_pos={0 0}, upload=113070]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 16 18:11:56.814067848 (128h27m42.172726507s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 16 18:11:56.814075640 (128h27m42.172734299s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 16 18:13:47.213254651 (128h29m32.571913308s) [upload=113070]: Done uploading segments...
Nov 16 18:13:47.213331906 (128h29m32.57199057s) [upload=113070]: Upload finished. err: metaclient: context deadline exceeded
Duration: 441.370185ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
845.277453ms trace:
https://jaeger.dev.storj.io/trace/70994c85f165c3a0
FAIL (2025-11-16 18:49:27 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce...
Nov 16 18:11:56.176141393 (128h27m41.53480005s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176505694 (128h27m41.535164346s) [noise=true , address=81.171.14.70:4029 , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176694869 (128h27m41.535353535s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176906560 (128h27m41.535565213s) [noise=true , address=81.171.14.70:4034 , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178010924 (128h27m41.536669583s) [noise=true , address=81.171.14.70:4041 , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178162029 (128h27m41.53682069s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178624747 (128h27m41.537283407s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.179822806 (128h27m41.538481511s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.181092396 (128h27m41.539751055s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.182267056 (128h27m41.540925728s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.298224599 (128h27m41.656883262s) [upload=113070]: Next returned nil segment
Nov 16 18:11:56.298240977 (128h27m41.656899643s) [upload=113070]: Waiting for error group managing segments...
Nov 16 18:11:56.322992573 (128h27m41.681651228s) [noise=true , address=81.171.14.70:4031 , piece_id=WMGGCRBCTQTVREBKXGD37YVKTKSK2P5SFJV5LH2MGFI3RJXONTKQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.326677846 (128h27m41.6853365s) [noise=true , address=81.171.14.70:4033 , piece_id=UR3UBNCMPQSDNMI44MKZ34MRQ4MYPCLHGWGWNDEPVNJ3GGFDULDQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.327086439 (128h27m41.685745102s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330596159 (128h27m41.689254822s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330894325 (128h27m41.689552985s) [noise=true , address=185.167.204.205:4016 , piece_id=XTDJJJHRNTXLU4D3HJ4OCP2UQR6RF6KHCU6OWSQAPI2Q6SONPKYA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331200302 (128h27m41.689858955s) [noise=true , address=185.167.204.205:4019 , piece_id=LJCJSOQLF4FSLVI7G753ZYDJW6VJJIQCOESIN4KVUHQ36NPZZOHQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331708487 (128h27m41.69036714s) [noise=true , address=185.167.204.206:4061 , piece_id=VWC7K7VZIUF3B47V3XQKWG4WRWFIZSCI4QOW24JI5RC77KZ2VKNQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331819138 (128h27m41.690477798s) [noise=true , address=185.167.204.205:4002 , piece_id=NL2FGXMOTSJRIS7O4ZBTIE2636T4UBL4TBWO3YMA7LCKNTSDGYSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334312534 (128h27m41.692971206s) [noise=true , address=185.167.204.205:4031 , piece_id=J2H4MRWYBVR3FYDVOB7BHQV3XJ2PBXPBKTGIS5SK6N76DDQI3VJA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334376547 (128h27m41.693035205s) [noise=true , address=81.171.14.70:4034 , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334837583 (128h27m41.693496245s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.335363984 (128h27m41.694022646s) [noise=true , address=185.167.204.205:4005 , piece_id=VFVSPAC4QXC5RDOZWH5HS5GLIXCOSRJN67KX65IXBZD2WGULIAJQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.338489129 (128h27m41.697147785s) [noise=true , address=185.167.204.206:4039 , piece_id=S24WYTQCI7XAYTNW5CO6APLU3RRGU4AEJIANW3I5KT5CUHTP5WFQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.340260145 (128h27m41.698918799s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLPSBJNFFRY4KJQRXR4FYNLV4DFOEO6SHIZGTJMSAUHRB4DTBWA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.342507930 (128h27m41.701166584s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.343055650 (128h27m41.701714293s) [noise=true , address=185.167.204.205:4024 , piece_id=EAG5CMHBVOSIFI2WFCQIXQFNGYU4ATNHUUIBQKYKM6B6XETO63YQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.346735021 (128h27m41.705393678s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.348599199 (128h27m41.707257859s) [noise=true , address=185.167.204.206:4051 , piece_id=3OFN2SAZSTHRRM4SNHQCU2IEVOCXMA3BZOLS2YNULUJ5IHFQQSPA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.349247455 (128h27m41.707906114s) [noise=true , address=89.149.201.147:4023 , piece_id=O533J4NWGNLHIAD4SA7VWCHP4WF7GGB33AG4EPFIUMZIVSMCZLSQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.355006125 (128h27m41.713664782s) [noise=true , address=185.167.204.205:4033 , piece_id=SWXEHUBOBIUDILZLZ2NC5G7MGHFPOWU2ZPODJAJV6NFUAYBUYZXQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.360471308 (128h27m41.719129963s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.374029787 (128h27m41.73268843s) [noise=true , address=89.149.201.147:4009 , piece_id=SEU3XXEIWPXZAES7EPYAZQTCKXCOEE7S6CLFL3SZZA3MTBNSMG2A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.789361201 (128h27m42.14801986s) [noise=true , address=81.171.14.70:4030 , piece_id=EPDZQGCWBKEEGW2EMHFP4FVUH4ZCOWFRRVJHH63TX7DF6BUELUIQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.804954891 (128h27m42.163613548s) [noise=true , address=81.171.14.70:4029 , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.805830432 (128h27m42.164489092s) [noise=true , address=81.171.14.70:4041 , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813392799 (128h27m42.172051464s) [noise=true , address=89.149.201.147:4015 , piece_id=W7BFUW3BP7ZK6RTZMKRDLTDIUSA5Y6HA3YXWDPB3MRD3RXDVYZKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813434571 (128h27m42.172093236s) [seg_pos={0 0}, upload=113070]: Segment reached optimal threshold of 26 pieces.
Nov 16 18:11:56.813848675 (128h27m42.172507339s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813864049 (128h27m42.172522714s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813894323 (128h27m42.172552985s) [noise=true , address=89.149.201.147:4022 , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813935878 (128h27m42.172594551s) [noise=true , address=89.149.201.147:4022 , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813968221 (128h27m42.172626877s) [seg_pos={0 0}, upload=113070]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 16 18:11:56.814067848 (128h27m42.172726507s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 16 18:11:56.814075640 (128h27m42.172734299s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 16 18:13:47.213254651 (128h29m32.571913308s) [upload=113070]: Done uploading segments...
Nov 16 18:13:47.213331906 (128h29m32.57199057s) [upload=113070]: Upload finished. err: metaclient: context deadline exceeded
Duration: 845.301357ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
397.454866ms trace:
https://jaeger.dev.storj.io/trace/70994c85f165c3a0
FAIL (2025-11-16 18:48:57 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce...
Nov 16 18:11:56.176141393 (128h27m41.53480005s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176505694 (128h27m41.535164346s) [noise=true , address=81.171.14.70:4029 , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176694869 (128h27m41.535353535s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176906560 (128h27m41.535565213s) [noise=true , address=81.171.14.70:4034 , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178010924 (128h27m41.536669583s) [noise=true , address=81.171.14.70:4041 , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178162029 (128h27m41.53682069s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178624747 (128h27m41.537283407s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.179822806 (128h27m41.538481511s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.181092396 (128h27m41.539751055s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.182267056 (128h27m41.540925728s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.298224599 (128h27m41.656883262s) [upload=113070]: Next returned nil segment
Nov 16 18:11:56.298240977 (128h27m41.656899643s) [upload=113070]: Waiting for error group managing segments...
Nov 16 18:11:56.322992573 (128h27m41.681651228s) [noise=true , address=81.171.14.70:4031 , piece_id=WMGGCRBCTQTVREBKXGD37YVKTKSK2P5SFJV5LH2MGFI3RJXONTKQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.326677846 (128h27m41.6853365s) [noise=true , address=81.171.14.70:4033 , piece_id=UR3UBNCMPQSDNMI44MKZ34MRQ4MYPCLHGWGWNDEPVNJ3GGFDULDQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.327086439 (128h27m41.685745102s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330596159 (128h27m41.689254822s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330894325 (128h27m41.689552985s) [noise=true , address=185.167.204.205:4016 , piece_id=XTDJJJHRNTXLU4D3HJ4OCP2UQR6RF6KHCU6OWSQAPI2Q6SONPKYA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331200302 (128h27m41.689858955s) [noise=true , address=185.167.204.205:4019 , piece_id=LJCJSOQLF4FSLVI7G753ZYDJW6VJJIQCOESIN4KVUHQ36NPZZOHQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331708487 (128h27m41.69036714s) [noise=true , address=185.167.204.206:4061 , piece_id=VWC7K7VZIUF3B47V3XQKWG4WRWFIZSCI4QOW24JI5RC77KZ2VKNQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331819138 (128h27m41.690477798s) [noise=true , address=185.167.204.205:4002 , piece_id=NL2FGXMOTSJRIS7O4ZBTIE2636T4UBL4TBWO3YMA7LCKNTSDGYSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334312534 (128h27m41.692971206s) [noise=true , address=185.167.204.205:4031 , piece_id=J2H4MRWYBVR3FYDVOB7BHQV3XJ2PBXPBKTGIS5SK6N76DDQI3VJA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334376547 (128h27m41.693035205s) [noise=true , address=81.171.14.70:4034 , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334837583 (128h27m41.693496245s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.335363984 (128h27m41.694022646s) [noise=true , address=185.167.204.205:4005 , piece_id=VFVSPAC4QXC5RDOZWH5HS5GLIXCOSRJN67KX65IXBZD2WGULIAJQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.338489129 (128h27m41.697147785s) [noise=true , address=185.167.204.206:4039 , piece_id=S24WYTQCI7XAYTNW5CO6APLU3RRGU4AEJIANW3I5KT5CUHTP5WFQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.340260145 (128h27m41.698918799s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLPSBJNFFRY4KJQRXR4FYNLV4DFOEO6SHIZGTJMSAUHRB4DTBWA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.342507930 (128h27m41.701166584s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.343055650 (128h27m41.701714293s) [noise=true , address=185.167.204.205:4024 , piece_id=EAG5CMHBVOSIFI2WFCQIXQFNGYU4ATNHUUIBQKYKM6B6XETO63YQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.346735021 (128h27m41.705393678s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.348599199 (128h27m41.707257859s) [noise=true , address=185.167.204.206:4051 , piece_id=3OFN2SAZSTHRRM4SNHQCU2IEVOCXMA3BZOLS2YNULUJ5IHFQQSPA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.349247455 (128h27m41.707906114s) [noise=true , address=89.149.201.147:4023 , piece_id=O533J4NWGNLHIAD4SA7VWCHP4WF7GGB33AG4EPFIUMZIVSMCZLSQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.355006125 (128h27m41.713664782s) [noise=true , address=185.167.204.205:4033 , piece_id=SWXEHUBOBIUDILZLZ2NC5G7MGHFPOWU2ZPODJAJV6NFUAYBUYZXQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.360471308 (128h27m41.719129963s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.374029787 (128h27m41.73268843s) [noise=true , address=89.149.201.147:4009 , piece_id=SEU3XXEIWPXZAES7EPYAZQTCKXCOEE7S6CLFL3SZZA3MTBNSMG2A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.789361201 (128h27m42.14801986s) [noise=true , address=81.171.14.70:4030 , piece_id=EPDZQGCWBKEEGW2EMHFP4FVUH4ZCOWFRRVJHH63TX7DF6BUELUIQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.804954891 (128h27m42.163613548s) [noise=true , address=81.171.14.70:4029 , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.805830432 (128h27m42.164489092s) [noise=true , address=81.171.14.70:4041 , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813392799 (128h27m42.172051464s) [noise=true , address=89.149.201.147:4015 , piece_id=W7BFUW3BP7ZK6RTZMKRDLTDIUSA5Y6HA3YXWDPB3MRD3RXDVYZKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813434571 (128h27m42.172093236s) [seg_pos={0 0}, upload=113070]: Segment reached optimal threshold of 26 pieces.
Nov 16 18:11:56.813848675 (128h27m42.172507339s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813864049 (128h27m42.172522714s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813894323 (128h27m42.172552985s) [noise=true , address=89.149.201.147:4022 , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813935878 (128h27m42.172594551s) [noise=true , address=89.149.201.147:4022 , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813968221 (128h27m42.172626877s) [seg_pos={0 0}, upload=113070]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 16 18:11:56.814067848 (128h27m42.172726507s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 16 18:11:56.814075640 (128h27m42.172734299s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 16 18:13:47.213254651 (128h29m32.571913308s) [upload=113070]: Done uploading segments...
Nov 16 18:13:47.213331906 (128h29m32.57199057s) [upload=113070]: Upload finished. err: metaclient: context deadline exceeded
Duration: 397.483482ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
829.043048ms trace:
https://jaeger.dev.storj.io/trace/70994c85f165c3a0
FAIL (2025-11-16 18:48:42 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce...
Nov 16 18:11:56.176141393 (128h27m41.53480005s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176505694 (128h27m41.535164346s) [noise=true , address=81.171.14.70:4029 , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176694869 (128h27m41.535353535s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176906560 (128h27m41.535565213s) [noise=true , address=81.171.14.70:4034 , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178010924 (128h27m41.536669583s) [noise=true , address=81.171.14.70:4041 , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178162029 (128h27m41.53682069s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178624747 (128h27m41.537283407s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.179822806 (128h27m41.538481511s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.181092396 (128h27m41.539751055s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.182267056 (128h27m41.540925728s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.298224599 (128h27m41.656883262s) [upload=113070]: Next returned nil segment
Nov 16 18:11:56.298240977 (128h27m41.656899643s) [upload=113070]: Waiting for error group managing segments...
Nov 16 18:11:56.322992573 (128h27m41.681651228s) [noise=true , address=81.171.14.70:4031 , piece_id=WMGGCRBCTQTVREBKXGD37YVKTKSK2P5SFJV5LH2MGFI3RJXONTKQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.326677846 (128h27m41.6853365s) [noise=true , address=81.171.14.70:4033 , piece_id=UR3UBNCMPQSDNMI44MKZ34MRQ4MYPCLHGWGWNDEPVNJ3GGFDULDQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.327086439 (128h27m41.685745102s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330596159 (128h27m41.689254822s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330894325 (128h27m41.689552985s) [noise=true , address=185.167.204.205:4016 , piece_id=XTDJJJHRNTXLU4D3HJ4OCP2UQR6RF6KHCU6OWSQAPI2Q6SONPKYA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331200302 (128h27m41.689858955s) [noise=true , address=185.167.204.205:4019 , piece_id=LJCJSOQLF4FSLVI7G753ZYDJW6VJJIQCOESIN4KVUHQ36NPZZOHQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331708487 (128h27m41.69036714s) [noise=true , address=185.167.204.206:4061 , piece_id=VWC7K7VZIUF3B47V3XQKWG4WRWFIZSCI4QOW24JI5RC77KZ2VKNQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331819138 (128h27m41.690477798s) [noise=true , address=185.167.204.205:4002 , piece_id=NL2FGXMOTSJRIS7O4ZBTIE2636T4UBL4TBWO3YMA7LCKNTSDGYSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334312534 (128h27m41.692971206s) [noise=true , address=185.167.204.205:4031 , piece_id=J2H4MRWYBVR3FYDVOB7BHQV3XJ2PBXPBKTGIS5SK6N76DDQI3VJA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334376547 (128h27m41.693035205s) [noise=true , address=81.171.14.70:4034 , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334837583 (128h27m41.693496245s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.335363984 (128h27m41.694022646s) [noise=true , address=185.167.204.205:4005 , piece_id=VFVSPAC4QXC5RDOZWH5HS5GLIXCOSRJN67KX65IXBZD2WGULIAJQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.338489129 (128h27m41.697147785s) [noise=true , address=185.167.204.206:4039 , piece_id=S24WYTQCI7XAYTNW5CO6APLU3RRGU4AEJIANW3I5KT5CUHTP5WFQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.340260145 (128h27m41.698918799s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLPSBJNFFRY4KJQRXR4FYNLV4DFOEO6SHIZGTJMSAUHRB4DTBWA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.342507930 (128h27m41.701166584s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.343055650 (128h27m41.701714293s) [noise=true , address=185.167.204.205:4024 , piece_id=EAG5CMHBVOSIFI2WFCQIXQFNGYU4ATNHUUIBQKYKM6B6XETO63YQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.346735021 (128h27m41.705393678s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.348599199 (128h27m41.707257859s) [noise=true , address=185.167.204.206:4051 , piece_id=3OFN2SAZSTHRRM4SNHQCU2IEVOCXMA3BZOLS2YNULUJ5IHFQQSPA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.349247455 (128h27m41.707906114s) [noise=true , address=89.149.201.147:4023 , piece_id=O533J4NWGNLHIAD4SA7VWCHP4WF7GGB33AG4EPFIUMZIVSMCZLSQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.355006125 (128h27m41.713664782s) [noise=true , address=185.167.204.205:4033 , piece_id=SWXEHUBOBIUDILZLZ2NC5G7MGHFPOWU2ZPODJAJV6NFUAYBUYZXQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.360471308 (128h27m41.719129963s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.374029787 (128h27m41.73268843s) [noise=true , address=89.149.201.147:4009 , piece_id=SEU3XXEIWPXZAES7EPYAZQTCKXCOEE7S6CLFL3SZZA3MTBNSMG2A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.789361201 (128h27m42.14801986s) [noise=true , address=81.171.14.70:4030 , piece_id=EPDZQGCWBKEEGW2EMHFP4FVUH4ZCOWFRRVJHH63TX7DF6BUELUIQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.804954891 (128h27m42.163613548s) [noise=true , address=81.171.14.70:4029 , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.805830432 (128h27m42.164489092s) [noise=true , address=81.171.14.70:4041 , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813392799 (128h27m42.172051464s) [noise=true , address=89.149.201.147:4015 , piece_id=W7BFUW3BP7ZK6RTZMKRDLTDIUSA5Y6HA3YXWDPB3MRD3RXDVYZKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813434571 (128h27m42.172093236s) [seg_pos={0 0}, upload=113070]: Segment reached optimal threshold of 26 pieces.
Nov 16 18:11:56.813848675 (128h27m42.172507339s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813864049 (128h27m42.172522714s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813894323 (128h27m42.172552985s) [noise=true , address=89.149.201.147:4022 , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813935878 (128h27m42.172594551s) [noise=true , address=89.149.201.147:4022 , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813968221 (128h27m42.172626877s) [seg_pos={0 0}, upload=113070]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 16 18:11:56.814067848 (128h27m42.172726507s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 16 18:11:56.814075640 (128h27m42.172734299s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 16 18:13:47.213254651 (128h29m32.571913308s) [upload=113070]: Done uploading segments...
Nov 16 18:13:47.213331906 (128h29m32.57199057s) [upload=113070]: Upload finished. err: metaclient: context deadline exceeded
Duration: 829.089391ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
585.969094ms trace:
https://jaeger.dev.storj.io/trace/70994c85f165c3a0
FAIL (2025-11-16 18:47:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce...
Nov 16 18:11:56.176141393 (128h27m41.53480005s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176505694 (128h27m41.535164346s) [noise=true , address=81.171.14.70:4029 , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176694869 (128h27m41.535353535s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176906560 (128h27m41.535565213s) [noise=true , address=81.171.14.70:4034 , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178010924 (128h27m41.536669583s) [noise=true , address=81.171.14.70:4041 , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178162029 (128h27m41.53682069s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178624747 (128h27m41.537283407s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.179822806 (128h27m41.538481511s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.181092396 (128h27m41.539751055s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.182267056 (128h27m41.540925728s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.298224599 (128h27m41.656883262s) [upload=113070]: Next returned nil segment
Nov 16 18:11:56.298240977 (128h27m41.656899643s) [upload=113070]: Waiting for error group managing segments...
Nov 16 18:11:56.322992573 (128h27m41.681651228s) [noise=true , address=81.171.14.70:4031 , piece_id=WMGGCRBCTQTVREBKXGD37YVKTKSK2P5SFJV5LH2MGFI3RJXONTKQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.326677846 (128h27m41.6853365s) [noise=true , address=81.171.14.70:4033 , piece_id=UR3UBNCMPQSDNMI44MKZ34MRQ4MYPCLHGWGWNDEPVNJ3GGFDULDQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.327086439 (128h27m41.685745102s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330596159 (128h27m41.689254822s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330894325 (128h27m41.689552985s) [noise=true , address=185.167.204.205:4016 , piece_id=XTDJJJHRNTXLU4D3HJ4OCP2UQR6RF6KHCU6OWSQAPI2Q6SONPKYA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331200302 (128h27m41.689858955s) [noise=true , address=185.167.204.205:4019 , piece_id=LJCJSOQLF4FSLVI7G753ZYDJW6VJJIQCOESIN4KVUHQ36NPZZOHQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331708487 (128h27m41.69036714s) [noise=true , address=185.167.204.206:4061 , piece_id=VWC7K7VZIUF3B47V3XQKWG4WRWFIZSCI4QOW24JI5RC77KZ2VKNQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331819138 (128h27m41.690477798s) [noise=true , address=185.167.204.205:4002 , piece_id=NL2FGXMOTSJRIS7O4ZBTIE2636T4UBL4TBWO3YMA7LCKNTSDGYSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334312534 (128h27m41.692971206s) [noise=true , address=185.167.204.205:4031 , piece_id=J2H4MRWYBVR3FYDVOB7BHQV3XJ2PBXPBKTGIS5SK6N76DDQI3VJA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334376547 (128h27m41.693035205s) [noise=true , address=81.171.14.70:4034 , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334837583 (128h27m41.693496245s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.335363984 (128h27m41.694022646s) [noise=true , address=185.167.204.205:4005 , piece_id=VFVSPAC4QXC5RDOZWH5HS5GLIXCOSRJN67KX65IXBZD2WGULIAJQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.338489129 (128h27m41.697147785s) [noise=true , address=185.167.204.206:4039 , piece_id=S24WYTQCI7XAYTNW5CO6APLU3RRGU4AEJIANW3I5KT5CUHTP5WFQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.340260145 (128h27m41.698918799s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLPSBJNFFRY4KJQRXR4FYNLV4DFOEO6SHIZGTJMSAUHRB4DTBWA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.342507930 (128h27m41.701166584s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.343055650 (128h27m41.701714293s) [noise=true , address=185.167.204.205:4024 , piece_id=EAG5CMHBVOSIFI2WFCQIXQFNGYU4ATNHUUIBQKYKM6B6XETO63YQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.346735021 (128h27m41.705393678s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.348599199 (128h27m41.707257859s) [noise=true , address=185.167.204.206:4051 , piece_id=3OFN2SAZSTHRRM4SNHQCU2IEVOCXMA3BZOLS2YNULUJ5IHFQQSPA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.349247455 (128h27m41.707906114s) [noise=true , address=89.149.201.147:4023 , piece_id=O533J4NWGNLHIAD4SA7VWCHP4WF7GGB33AG4EPFIUMZIVSMCZLSQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.355006125 (128h27m41.713664782s) [noise=true , address=185.167.204.205:4033 , piece_id=SWXEHUBOBIUDILZLZ2NC5G7MGHFPOWU2ZPODJAJV6NFUAYBUYZXQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.360471308 (128h27m41.719129963s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.374029787 (128h27m41.73268843s) [noise=true , address=89.149.201.147:4009 , piece_id=SEU3XXEIWPXZAES7EPYAZQTCKXCOEE7S6CLFL3SZZA3MTBNSMG2A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.789361201 (128h27m42.14801986s) [noise=true , address=81.171.14.70:4030 , piece_id=EPDZQGCWBKEEGW2EMHFP4FVUH4ZCOWFRRVJHH63TX7DF6BUELUIQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.804954891 (128h27m42.163613548s) [noise=true , address=81.171.14.70:4029 , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.805830432 (128h27m42.164489092s) [noise=true , address=81.171.14.70:4041 , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813392799 (128h27m42.172051464s) [noise=true , address=89.149.201.147:4015 , piece_id=W7BFUW3BP7ZK6RTZMKRDLTDIUSA5Y6HA3YXWDPB3MRD3RXDVYZKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813434571 (128h27m42.172093236s) [seg_pos={0 0}, upload=113070]: Segment reached optimal threshold of 26 pieces.
Nov 16 18:11:56.813848675 (128h27m42.172507339s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813864049 (128h27m42.172522714s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813894323 (128h27m42.172552985s) [noise=true , address=89.149.201.147:4022 , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813935878 (128h27m42.172594551s) [noise=true , address=89.149.201.147:4022 , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813968221 (128h27m42.172626877s) [seg_pos={0 0}, upload=113070]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 16 18:11:56.814067848 (128h27m42.172726507s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 16 18:11:56.814075640 (128h27m42.172734299s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 16 18:13:47.213254651 (128h29m32.571913308s) [upload=113070]: Done uploading segments...
Nov 16 18:13:47.213331906 (128h29m32.57199057s) [upload=113070]: Upload finished. err: metaclient: context deadline exceeded
Duration: 585.993686ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
843.781933ms trace:
https://jaeger.dev.storj.io/trace/70994c85f165c3a0
FAIL (2025-11-16 18:47:29 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce...
Nov 16 18:11:56.176141393 (128h27m41.53480005s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176505694 (128h27m41.535164346s) [noise=true , address=81.171.14.70:4029 , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176694869 (128h27m41.535353535s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.176906560 (128h27m41.535565213s) [noise=true , address=81.171.14.70:4034 , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178010924 (128h27m41.536669583s) [noise=true , address=81.171.14.70:4041 , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178162029 (128h27m41.53682069s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.178624747 (128h27m41.537283407s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.179822806 (128h27m41.538481511s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.181092396 (128h27m41.539751055s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.182267056 (128h27m41.540925728s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Uploading piece...
Nov 16 18:11:56.298224599 (128h27m41.656883262s) [upload=113070]: Next returned nil segment
Nov 16 18:11:56.298240977 (128h27m41.656899643s) [upload=113070]: Waiting for error group managing segments...
Nov 16 18:11:56.322992573 (128h27m41.681651228s) [noise=true , address=81.171.14.70:4031 , piece_id=WMGGCRBCTQTVREBKXGD37YVKTKSK2P5SFJV5LH2MGFI3RJXONTKQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.326677846 (128h27m41.6853365s) [noise=true , address=81.171.14.70:4033 , piece_id=UR3UBNCMPQSDNMI44MKZ34MRQ4MYPCLHGWGWNDEPVNJ3GGFDULDQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.327086439 (128h27m41.685745102s) [noise=true , address=185.167.204.205:4028 , piece_id=G5BXCSGHR7FAQBHCZ3ENJOJZU2NRFD3LNW5GJQ6J4S7WR5WCNZLA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330596159 (128h27m41.689254822s) [noise=true , address=185.167.204.206:4046 , piece_id=N5F6QPOYULCUG2XN4X2VZ5NZWTJ6SEJCFUY5STUA4PCQOR35JIYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.330894325 (128h27m41.689552985s) [noise=true , address=185.167.204.205:4016 , piece_id=XTDJJJHRNTXLU4D3HJ4OCP2UQR6RF6KHCU6OWSQAPI2Q6SONPKYA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331200302 (128h27m41.689858955s) [noise=true , address=185.167.204.205:4019 , piece_id=LJCJSOQLF4FSLVI7G753ZYDJW6VJJIQCOESIN4KVUHQ36NPZZOHQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331708487 (128h27m41.69036714s) [noise=true , address=185.167.204.206:4061 , piece_id=VWC7K7VZIUF3B47V3XQKWG4WRWFIZSCI4QOW24JI5RC77KZ2VKNQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.331819138 (128h27m41.690477798s) [noise=true , address=185.167.204.205:4002 , piece_id=NL2FGXMOTSJRIS7O4ZBTIE2636T4UBL4TBWO3YMA7LCKNTSDGYSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334312534 (128h27m41.692971206s) [noise=true , address=185.167.204.205:4031 , piece_id=J2H4MRWYBVR3FYDVOB7BHQV3XJ2PBXPBKTGIS5SK6N76DDQI3VJA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334376547 (128h27m41.693035205s) [noise=true , address=81.171.14.70:4034 , piece_id=QLIKWTIUMSKIQOHGJ2DHXMKXK4Z5JT6X33SXEGSWP3ETIE634Z5A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.334837583 (128h27m41.693496245s) [noise=true , address=185.167.204.206:4066 , piece_id=CDSTTDZLRC2NNEJOO2Y4DO3V67N6FZIGMNZ3UFXUU2Q3AO34NRAQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.335363984 (128h27m41.694022646s) [noise=true , address=185.167.204.205:4005 , piece_id=VFVSPAC4QXC5RDOZWH5HS5GLIXCOSRJN67KX65IXBZD2WGULIAJQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.338489129 (128h27m41.697147785s) [noise=true , address=185.167.204.206:4039 , piece_id=S24WYTQCI7XAYTNW5CO6APLU3RRGU4AEJIANW3I5KT5CUHTP5WFQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.340260145 (128h27m41.698918799s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLPSBJNFFRY4KJQRXR4FYNLV4DFOEO6SHIZGTJMSAUHRB4DTBWA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.342507930 (128h27m41.701166584s) [noise=true , address=185.167.204.206:4050 , piece_id=5G3GDM33B33GDIX4WC6DBM4NI2ZVINFVUYYZMRD22WB53XS2235A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.343055650 (128h27m41.701714293s) [noise=true , address=185.167.204.205:4024 , piece_id=EAG5CMHBVOSIFI2WFCQIXQFNGYU4ATNHUUIBQKYKM6B6XETO63YQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.346735021 (128h27m41.705393678s) [noise=true , address=185.167.204.205:4003 , piece_id=L4QSQNZALCUV6PQS4MPIAMD5SKPQOAFG374L7XWV7PPV7NTMPBSA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.348599199 (128h27m41.707257859s) [noise=true , address=185.167.204.206:4051 , piece_id=3OFN2SAZSTHRRM4SNHQCU2IEVOCXMA3BZOLS2YNULUJ5IHFQQSPA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.349247455 (128h27m41.707906114s) [noise=true , address=89.149.201.147:4023 , piece_id=O533J4NWGNLHIAD4SA7VWCHP4WF7GGB33AG4EPFIUMZIVSMCZLSQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.355006125 (128h27m41.713664782s) [noise=true , address=185.167.204.205:4033 , piece_id=SWXEHUBOBIUDILZLZ2NC5G7MGHFPOWU2ZPODJAJV6NFUAYBUYZXQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.360471308 (128h27m41.719129963s) [noise=true , address=185.167.204.205:4008 , piece_id=S2XUX5ZXG2Z2Q66H6BYIW2JDHITKILKQ3KLPUQBUAO3HYLLSIEYQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.374029787 (128h27m41.73268843s) [noise=true , address=89.149.201.147:4009 , piece_id=SEU3XXEIWPXZAES7EPYAZQTCKXCOEE7S6CLFL3SZZA3MTBNSMG2A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.789361201 (128h27m42.14801986s) [noise=true , address=81.171.14.70:4030 , piece_id=EPDZQGCWBKEEGW2EMHFP4FVUH4ZCOWFRRVJHH63TX7DF6BUELUIQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.804954891 (128h27m42.163613548s) [noise=true , address=81.171.14.70:4029 , piece_id=BA3OZUPTVGRPA2QMLBFSHBQOGYR2SJP4OTC4DPYRBD2OI44T4C7A, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.805830432 (128h27m42.164489092s) [noise=true , address=81.171.14.70:4041 , piece_id=3J7WHLNPTN5T7R4QOGUQPLY6JLGDK2ZD64PK7IREZHO6OT3GRPZA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813392799 (128h27m42.172051464s) [noise=true , address=89.149.201.147:4015 , piece_id=W7BFUW3BP7ZK6RTZMKRDLTDIUSA5Y6HA3YXWDPB3MRD3RXDVYZKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: <nil>
Nov 16 18:11:56.813434571 (128h27m42.172093236s) [seg_pos={0 0}, upload=113070]: Segment reached optimal threshold of 26 pieces.
Nov 16 18:11:56.813848675 (128h27m42.172507339s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813864049 (128h27m42.172522714s) [noise=true , address=89.149.201.147:4020 , piece_id=YDL724ONO53WQM4PEEXQLU6CHF2JXYMLIAADCDCGCGTODFOVT4AQ, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813894323 (128h27m42.172552985s) [noise=true , address=89.149.201.147:4022 , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
Nov 16 18:11:56.813935878 (128h27m42.172594551s) [noise=true , address=89.149.201.147:4022 , piece_id=E3GDAJLEJKK624PX4XQJQQEW4XAHWT5HVXUPHHEVWBM45PIZBFKA, seg_pos={0 0}, upload=113070]: Long tail cancellation due to optimal threshold
Nov 16 18:11:56.813968221 (128h27m42.172626877s) [seg_pos={0 0}, upload=113070]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 16 18:11:56.814067848 (128h27m42.172726507s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 16 18:11:56.814075640 (128h27m42.172734299s) [upload=113070]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 16 18:13:47.213254651 (128h29m32.571913308s) [upload=113070]: Done uploading segments...
Nov 16 18:13:47.213331906 (128h29m32.57199057s) [upload=113070]: Upload finished. err: metaclient: context deadline exceeded
Duration: 843.807972ms
core
uplink
eu-select-1
eu1-placement-15
|