Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [............................X...............................] duration:
1.6050824s trace:
https://jaeger.dev.storj.io/trace/2b72b56b09d882ee
FAIL (2025-10-31 20:45:13 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.605131007s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.............................X..............................] duration:
1.565775784s trace:
https://jaeger.dev.storj.io/trace/2b72b56b09d882ee
FAIL (2025-10-31 20:44:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.565801581s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..............................X.............................] duration:
1.718451224s trace:
https://jaeger.dev.storj.io/trace/2b72b56b09d882ee
FAIL (2025-10-31 20:43:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.71848141s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...............................X............................] duration:
1.671031045s trace:
https://jaeger.dev.storj.io/trace/2b72b56b09d882ee
FAIL (2025-10-31 20:42:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.671056199s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [................................X...........................] duration:
1.656661274s trace:
https://jaeger.dev.storj.io/trace/2b72b56b09d882ee
FAIL (2025-10-31 20:41:38 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.656680466s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.................................X..........................] duration:
2.082608451s trace:
https://jaeger.dev.storj.io/trace/2b72b56b09d882ee
FAIL (2025-10-31 20:41:04 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.082637915s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..................................X.........................] duration:
1.619914525s trace:
https://jaeger.dev.storj.io/trace/2b72b56b09d882ee
FAIL (2025-10-31 20:40:46 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.619957572s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...................................X........................] duration:
1.712171858s trace:
https://jaeger.dev.storj.io/trace/2b72b56b09d882ee
FAIL (2025-10-31 20:39:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.712198599s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....................................X.......................] duration:
1.603440659s trace:
https://jaeger.dev.storj.io/trace/2b72b56b09d882ee
FAIL (2025-10-31 20:39:15 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.603469495s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....................................X......................] duration:
1.647333923s trace:
https://jaeger.dev.storj.io/trace/2b72b56b09d882ee
FAIL (2025-10-31 20:38:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.647376542s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......................................X.....................] duration:
1.667808308s trace:
https://jaeger.dev.storj.io/trace/2b72b56b09d882ee
FAIL (2025-10-31 20:37:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.667834054s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......................................X....................] duration:
1.569497901s trace:
https://jaeger.dev.storj.io/trace/2b72b56b09d882ee
FAIL (2025-10-31 20:37:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.569524816s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........................................X...................] duration:
1.702887497s trace:
https://jaeger.dev.storj.io/trace/2b72b56b09d882ee
FAIL (2025-10-31 20:37:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.702909987s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........................................X..................] duration:
2.100959114s trace:
https://jaeger.dev.storj.io/trace/2b72b56b09d882ee
FAIL (2025-10-31 20:36:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.101019883s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........................................X.................] duration:
1.571179296s trace:
https://jaeger.dev.storj.io/trace/2b72b56b09d882ee
FAIL (2025-10-31 20:36:23 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.57120907s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........................................X................] duration:
1.573387291s trace:
https://jaeger.dev.storj.io/trace/2b72b56b09d882ee
FAIL (2025-10-31 20:36:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.573422674s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [............................................X...............] duration:
1.573014276s trace:
https://jaeger.dev.storj.io/trace/2b72b56b09d882ee
FAIL (2025-10-31 20:35:30 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.573044592s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.............................................X..............] duration:
1.596219321s trace:
https://jaeger.dev.storj.io/trace/2b72b56b09d882ee
FAIL (2025-10-31 20:34:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.596255215s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..............................................X.............] duration:
1.622620715s trace:
https://jaeger.dev.storj.io/trace/2b72b56b09d882ee
FAIL (2025-10-31 20:33:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.622675142s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...............................................X............] duration:
1.760319492s trace:
https://jaeger.dev.storj.io/trace/2b72b56b09d882ee
FAIL (2025-10-31 20:33:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.760339149s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [................................................X...........] duration:
1.633368652s trace:
https://jaeger.dev.storj.io/trace/2b72b56b09d882ee
FAIL (2025-10-31 20:32:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.633391603s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.................................................X..........] duration:
1.62228692s trace:
https://jaeger.dev.storj.io/trace/2b72b56b09d882ee
FAIL (2025-10-31 20:31:56 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.622309936s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..................................................X.........] duration:
1.623030276s trace:
https://jaeger.dev.storj.io/trace/2b72b56b09d882ee
FAIL (2025-10-31 20:31:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.623067766s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...................................................X........] duration:
1.727575351s trace:
https://jaeger.dev.storj.io/trace/2b72b56b09d882ee
FAIL (2025-10-31 20:30:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.727624876s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....................................................X.......] duration:
1.695985358s trace:
https://jaeger.dev.storj.io/trace/2b72b56b09d882ee
FAIL (2025-10-31 20:30:05 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.696013404s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....................................................X......] duration:
2.861620242s trace:
https://jaeger.dev.storj.io/trace/2b72b56b09d882ee
FAIL (2025-10-31 20:29:18 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.861641066s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......................................................X.....] duration:
1.582032356s trace:
https://jaeger.dev.storj.io/trace/2b72b56b09d882ee
FAIL (2025-10-31 20:28:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.582066692s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......................................................X....] duration:
1.619670671s trace:
https://jaeger.dev.storj.io/trace/2b72b56b09d882ee
FAIL (2025-10-31 20:27:30 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.619699902s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........................................................X...] duration:
1.677974251s trace:
https://jaeger.dev.storj.io/trace/2b72b56b09d882ee
FAIL (2025-10-31 20:27:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.678001964s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........................................................X..] duration:
1.603891956s trace:
https://jaeger.dev.storj.io/trace/2b72b56b09d882ee
FAIL (2025-10-31 20:26:00 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.603935907s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........................................................X.] duration:
2.122048303s trace:
https://jaeger.dev.storj.io/trace/2b72b56b09d882ee
FAIL (2025-10-31 20:25:38 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.122751343s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........................................................X] duration:
5.001841851s trace:
https://jaeger.dev.storj.io/trace/2b72b56b09d882ee
FAIL (2025-10-31 20:24:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001864061s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
670.378244ms trace:
https://jaeger.dev.storj.io/trace/6f03109d869521d
FAIL (2025-10-31 20:08:51 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
67.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956053430 (31h44m11.657645883s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956513382 (31h44m11.658105833s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957203079 (31h44m11.658795537s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957810763 (31h44m11.65940323s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.958490731 (31h44m11.660083188s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.959102151 (31h44m11.660694608s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960053970 (31h44m11.661646453s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960748416 (31h44m11.66234087s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.961426224 (31h44m11.663018685s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.962221532 (31h44m11.663813994s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:09.089405055 (31h44m11.790997516s) [upload=27918]: Next returned nil segment
Oct 31 19:25:09.089426932 (31h44m11.791019394s) [upload=27918]: Waiting for error group managing segments...
Oct 31 19:25:09.094025091 (31h44m11.795617543s) [noise=true , address=89.149.201.147:4008 , piece_id=S7N4S3EQEKJDZGX6R4AIJTJFJCH7KR4GIADESGIQJEPKC73BNW3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094079311 (31h44m11.795671763s) [noise=true , address=81.171.14.70:4040 , piece_id=Q4QVVAIAYAVEI5GFW6NECJONEGPKQUGLS5SJFZMSG3RTL53TUDDA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094800800 (31h44m11.796393252s) [noise=true , address=89.149.201.147:4023 , piece_id=XVYPIYOLHLXN6MF67SJ3MZGZFY6CULBZ6UZDHH6LNSJE4HBGDLQQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.098897378 (31h44m11.800489835s) [noise=true , address=185.167.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099395156 (31h44m11.800987608s) [noise=true , address=185.167.204.205:4022 , piece_id=4E2JGAHF23TWJWVYBLE56MGMTMRLWEH33RJYPEHQHAWK3J7CEVXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099863521 (31h44m11.801455977s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100294404 (31h44m11.801886858s) [noise=true , address=81.171.14.70:4028 , piece_id=ZIEOL6VSTZ4VTQT57WGM6WTX7QLUGYA72LOIPPFR6KTIVMJ7UYMA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100633412 (31h44m11.802225867s) [noise=true , address=185.167.204.206:4056 , piece_id=PJRD7FGPTEQYYUCT745F7ZI52SZUIFU5TFNEIKVJCN6TKS3TUEHA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.101434913 (31h44m11.803027366s) [noise=true , address=185.167.204.206:4058 , piece_id=MBRFSYBYMWH3SBBDW42YNWXYK37SYHFT2IOCKJS7BMFPMIBKHQFQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102148306 (31h44m11.80374076s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102516901 (31h44m11.804109353s) [noise=true , address=81.171.14.70:4027 , piece_id=ZZB75QQLI6JIPRALC3MJLK6LJ3X6GL3UDA24IGRV6UHUCO65GQBQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102894823 (31h44m11.804487275s) [noise=true , address=185.167.204.205:4006 , piece_id=K25XGQSKX3FDM2KHDNHTRWXNTLMCZDHIZBZSW7EHZSKDCXABFGCA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.106832421 (31h44m11.808424907s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.107129826 (31h44m11.808722281s) [noise=true , address=185.167.204.205:4021 , piece_id=SEBXV4JSZNQO7LOH3WSBXA2ECKFAI4S3VJRAVHTDPYKH3N62JAKA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.109066332 (31h44m11.810658789s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.112900829 (31h44m11.814493287s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.114375084 (31h44m11.815967584s) [noise=true , address=89.149.201.147:4020 , piece_id=LXTZSAAU3DIQMVSM2XCJSRJU535YFMU622XAYR2WMRHC6ZLNON4A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.117391042 (31h44m11.818983505s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.118935135 (31h44m11.820527591s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120275173 (31h44m11.821867629s) [noise=true , address=81.171.14.70:4026 , piece_id=MT5VEPQDGPEXUO3QT634PU2IQU47LM5ZRX4SJXVTPO2WBR5BL2CQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120987615 (31h44m11.822580075s) [noise=true , address=89.149.201.147:4012 , piece_id=3HKVP2MMAVJOJCNLMOTTDDSCPA4QMXIK4FJ24562LFUYTIR65A6A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.121669813 (31h44m11.823262255s) [noise=true , address=81.171.14.70:4046 , piece_id=PMQPN35FZBRAK7DDZHJBWR5BWB3VJRCCCZXUWATN6DG3XA72WGSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.122378445 (31h44m11.823970895s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.123052255 (31h44m11.824644705s) [noise=true , address=81.171.14.70:4029 , piece_id=XHWCZU2MD2YL6QW4O24T6F6UBZEIFWRL3YFYYZWQAO3LEUTUD4JA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126273483 (31h44m11.827865933s) [noise=true , address=89.149.201.147:4017 , piece_id=XV3VZFXYHIHHF4QLFVBJVW3RCEFAY7DJDYQ2B2LLK3V54LQMV77A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126589016 (31h44m11.828181478s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126653182 (31h44m11.828245644s) [seg_pos={0 0}, upload=27918]: Segment reached optimal threshold of 26 pieces.
Oct 31 19:25:09.127135459 (31h44m11.828727924s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127151429 (31h44m11.82874389s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127365200 (31h44m11.828957662s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127375134 (31h44m11.828967596s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127405694 (31h44m11.828998146s) [seg_pos={0 0}, upload=27918]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Oct 31 19:25:09.127517223 (31h44m11.829109692s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 31 19:25:09.127523946 (31h44m11.829116408s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 31 19:25:09.163266197 (31h44m11.864858653s) [upload=27918]: Done uploading segments...
Oct 31 19:25:09.163420243 (31h44m11.865012694s) [upload=27918]: Upload finished. err: <nil>
Duration: 670.425061ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
475.151098ms trace:
https://jaeger.dev.storj.io/trace/6f03109d869521d
FAIL (2025-10-31 20:08:19 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
67.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956053430 (31h44m11.657645883s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956513382 (31h44m11.658105833s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957203079 (31h44m11.658795537s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957810763 (31h44m11.65940323s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.958490731 (31h44m11.660083188s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.959102151 (31h44m11.660694608s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960053970 (31h44m11.661646453s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960748416 (31h44m11.66234087s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.961426224 (31h44m11.663018685s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.962221532 (31h44m11.663813994s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:09.089405055 (31h44m11.790997516s) [upload=27918]: Next returned nil segment
Oct 31 19:25:09.089426932 (31h44m11.791019394s) [upload=27918]: Waiting for error group managing segments...
Oct 31 19:25:09.094025091 (31h44m11.795617543s) [noise=true , address=89.149.201.147:4008 , piece_id=S7N4S3EQEKJDZGX6R4AIJTJFJCH7KR4GIADESGIQJEPKC73BNW3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094079311 (31h44m11.795671763s) [noise=true , address=81.171.14.70:4040 , piece_id=Q4QVVAIAYAVEI5GFW6NECJONEGPKQUGLS5SJFZMSG3RTL53TUDDA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094800800 (31h44m11.796393252s) [noise=true , address=89.149.201.147:4023 , piece_id=XVYPIYOLHLXN6MF67SJ3MZGZFY6CULBZ6UZDHH6LNSJE4HBGDLQQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.098897378 (31h44m11.800489835s) [noise=true , address=185.167.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099395156 (31h44m11.800987608s) [noise=true , address=185.167.204.205:4022 , piece_id=4E2JGAHF23TWJWVYBLE56MGMTMRLWEH33RJYPEHQHAWK3J7CEVXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099863521 (31h44m11.801455977s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100294404 (31h44m11.801886858s) [noise=true , address=81.171.14.70:4028 , piece_id=ZIEOL6VSTZ4VTQT57WGM6WTX7QLUGYA72LOIPPFR6KTIVMJ7UYMA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100633412 (31h44m11.802225867s) [noise=true , address=185.167.204.206:4056 , piece_id=PJRD7FGPTEQYYUCT745F7ZI52SZUIFU5TFNEIKVJCN6TKS3TUEHA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.101434913 (31h44m11.803027366s) [noise=true , address=185.167.204.206:4058 , piece_id=MBRFSYBYMWH3SBBDW42YNWXYK37SYHFT2IOCKJS7BMFPMIBKHQFQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102148306 (31h44m11.80374076s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102516901 (31h44m11.804109353s) [noise=true , address=81.171.14.70:4027 , piece_id=ZZB75QQLI6JIPRALC3MJLK6LJ3X6GL3UDA24IGRV6UHUCO65GQBQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102894823 (31h44m11.804487275s) [noise=true , address=185.167.204.205:4006 , piece_id=K25XGQSKX3FDM2KHDNHTRWXNTLMCZDHIZBZSW7EHZSKDCXABFGCA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.106832421 (31h44m11.808424907s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.107129826 (31h44m11.808722281s) [noise=true , address=185.167.204.205:4021 , piece_id=SEBXV4JSZNQO7LOH3WSBXA2ECKFAI4S3VJRAVHTDPYKH3N62JAKA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.109066332 (31h44m11.810658789s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.112900829 (31h44m11.814493287s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.114375084 (31h44m11.815967584s) [noise=true , address=89.149.201.147:4020 , piece_id=LXTZSAAU3DIQMVSM2XCJSRJU535YFMU622XAYR2WMRHC6ZLNON4A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.117391042 (31h44m11.818983505s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.118935135 (31h44m11.820527591s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120275173 (31h44m11.821867629s) [noise=true , address=81.171.14.70:4026 , piece_id=MT5VEPQDGPEXUO3QT634PU2IQU47LM5ZRX4SJXVTPO2WBR5BL2CQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120987615 (31h44m11.822580075s) [noise=true , address=89.149.201.147:4012 , piece_id=3HKVP2MMAVJOJCNLMOTTDDSCPA4QMXIK4FJ24562LFUYTIR65A6A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.121669813 (31h44m11.823262255s) [noise=true , address=81.171.14.70:4046 , piece_id=PMQPN35FZBRAK7DDZHJBWR5BWB3VJRCCCZXUWATN6DG3XA72WGSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.122378445 (31h44m11.823970895s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.123052255 (31h44m11.824644705s) [noise=true , address=81.171.14.70:4029 , piece_id=XHWCZU2MD2YL6QW4O24T6F6UBZEIFWRL3YFYYZWQAO3LEUTUD4JA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126273483 (31h44m11.827865933s) [noise=true , address=89.149.201.147:4017 , piece_id=XV3VZFXYHIHHF4QLFVBJVW3RCEFAY7DJDYQ2B2LLK3V54LQMV77A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126589016 (31h44m11.828181478s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126653182 (31h44m11.828245644s) [seg_pos={0 0}, upload=27918]: Segment reached optimal threshold of 26 pieces.
Oct 31 19:25:09.127135459 (31h44m11.828727924s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127151429 (31h44m11.82874389s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127365200 (31h44m11.828957662s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127375134 (31h44m11.828967596s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127405694 (31h44m11.828998146s) [seg_pos={0 0}, upload=27918]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Oct 31 19:25:09.127517223 (31h44m11.829109692s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 31 19:25:09.127523946 (31h44m11.829116408s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 31 19:25:09.163266197 (31h44m11.864858653s) [upload=27918]: Done uploading segments...
Oct 31 19:25:09.163420243 (31h44m11.865012694s) [upload=27918]: Upload finished. err: <nil>
Duration: 475.178948ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
428.998532ms trace:
https://jaeger.dev.storj.io/trace/6f03109d869521d
FAIL (2025-10-31 20:07:19 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
67.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956053430 (31h44m11.657645883s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956513382 (31h44m11.658105833s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957203079 (31h44m11.658795537s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957810763 (31h44m11.65940323s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.958490731 (31h44m11.660083188s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.959102151 (31h44m11.660694608s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960053970 (31h44m11.661646453s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960748416 (31h44m11.66234087s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.961426224 (31h44m11.663018685s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.962221532 (31h44m11.663813994s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:09.089405055 (31h44m11.790997516s) [upload=27918]: Next returned nil segment
Oct 31 19:25:09.089426932 (31h44m11.791019394s) [upload=27918]: Waiting for error group managing segments...
Oct 31 19:25:09.094025091 (31h44m11.795617543s) [noise=true , address=89.149.201.147:4008 , piece_id=S7N4S3EQEKJDZGX6R4AIJTJFJCH7KR4GIADESGIQJEPKC73BNW3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094079311 (31h44m11.795671763s) [noise=true , address=81.171.14.70:4040 , piece_id=Q4QVVAIAYAVEI5GFW6NECJONEGPKQUGLS5SJFZMSG3RTL53TUDDA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094800800 (31h44m11.796393252s) [noise=true , address=89.149.201.147:4023 , piece_id=XVYPIYOLHLXN6MF67SJ3MZGZFY6CULBZ6UZDHH6LNSJE4HBGDLQQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.098897378 (31h44m11.800489835s) [noise=true , address=185.167.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099395156 (31h44m11.800987608s) [noise=true , address=185.167.204.205:4022 , piece_id=4E2JGAHF23TWJWVYBLE56MGMTMRLWEH33RJYPEHQHAWK3J7CEVXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099863521 (31h44m11.801455977s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100294404 (31h44m11.801886858s) [noise=true , address=81.171.14.70:4028 , piece_id=ZIEOL6VSTZ4VTQT57WGM6WTX7QLUGYA72LOIPPFR6KTIVMJ7UYMA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100633412 (31h44m11.802225867s) [noise=true , address=185.167.204.206:4056 , piece_id=PJRD7FGPTEQYYUCT745F7ZI52SZUIFU5TFNEIKVJCN6TKS3TUEHA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.101434913 (31h44m11.803027366s) [noise=true , address=185.167.204.206:4058 , piece_id=MBRFSYBYMWH3SBBDW42YNWXYK37SYHFT2IOCKJS7BMFPMIBKHQFQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102148306 (31h44m11.80374076s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102516901 (31h44m11.804109353s) [noise=true , address=81.171.14.70:4027 , piece_id=ZZB75QQLI6JIPRALC3MJLK6LJ3X6GL3UDA24IGRV6UHUCO65GQBQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102894823 (31h44m11.804487275s) [noise=true , address=185.167.204.205:4006 , piece_id=K25XGQSKX3FDM2KHDNHTRWXNTLMCZDHIZBZSW7EHZSKDCXABFGCA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.106832421 (31h44m11.808424907s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.107129826 (31h44m11.808722281s) [noise=true , address=185.167.204.205:4021 , piece_id=SEBXV4JSZNQO7LOH3WSBXA2ECKFAI4S3VJRAVHTDPYKH3N62JAKA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.109066332 (31h44m11.810658789s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.112900829 (31h44m11.814493287s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.114375084 (31h44m11.815967584s) [noise=true , address=89.149.201.147:4020 , piece_id=LXTZSAAU3DIQMVSM2XCJSRJU535YFMU622XAYR2WMRHC6ZLNON4A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.117391042 (31h44m11.818983505s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.118935135 (31h44m11.820527591s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120275173 (31h44m11.821867629s) [noise=true , address=81.171.14.70:4026 , piece_id=MT5VEPQDGPEXUO3QT634PU2IQU47LM5ZRX4SJXVTPO2WBR5BL2CQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120987615 (31h44m11.822580075s) [noise=true , address=89.149.201.147:4012 , piece_id=3HKVP2MMAVJOJCNLMOTTDDSCPA4QMXIK4FJ24562LFUYTIR65A6A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.121669813 (31h44m11.823262255s) [noise=true , address=81.171.14.70:4046 , piece_id=PMQPN35FZBRAK7DDZHJBWR5BWB3VJRCCCZXUWATN6DG3XA72WGSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.122378445 (31h44m11.823970895s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.123052255 (31h44m11.824644705s) [noise=true , address=81.171.14.70:4029 , piece_id=XHWCZU2MD2YL6QW4O24T6F6UBZEIFWRL3YFYYZWQAO3LEUTUD4JA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126273483 (31h44m11.827865933s) [noise=true , address=89.149.201.147:4017 , piece_id=XV3VZFXYHIHHF4QLFVBJVW3RCEFAY7DJDYQ2B2LLK3V54LQMV77A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126589016 (31h44m11.828181478s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126653182 (31h44m11.828245644s) [seg_pos={0 0}, upload=27918]: Segment reached optimal threshold of 26 pieces.
Oct 31 19:25:09.127135459 (31h44m11.828727924s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127151429 (31h44m11.82874389s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127365200 (31h44m11.828957662s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127375134 (31h44m11.828967596s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127405694 (31h44m11.828998146s) [seg_pos={0 0}, upload=27918]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Oct 31 19:25:09.127517223 (31h44m11.829109692s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 31 19:25:09.127523946 (31h44m11.829116408s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 31 19:25:09.163266197 (31h44m11.864858653s) [upload=27918]: Done uploading segments...
Oct 31 19:25:09.163420243 (31h44m11.865012694s) [upload=27918]: Upload finished. err: <nil>
Duration: 429.02404ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
556.854844ms trace:
https://jaeger.dev.storj.io/trace/6f03109d869521d
FAIL (2025-10-31 20:06:52 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
67.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956053430 (31h44m11.657645883s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956513382 (31h44m11.658105833s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957203079 (31h44m11.658795537s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957810763 (31h44m11.65940323s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.958490731 (31h44m11.660083188s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.959102151 (31h44m11.660694608s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960053970 (31h44m11.661646453s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960748416 (31h44m11.66234087s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.961426224 (31h44m11.663018685s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.962221532 (31h44m11.663813994s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:09.089405055 (31h44m11.790997516s) [upload=27918]: Next returned nil segment
Oct 31 19:25:09.089426932 (31h44m11.791019394s) [upload=27918]: Waiting for error group managing segments...
Oct 31 19:25:09.094025091 (31h44m11.795617543s) [noise=true , address=89.149.201.147:4008 , piece_id=S7N4S3EQEKJDZGX6R4AIJTJFJCH7KR4GIADESGIQJEPKC73BNW3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094079311 (31h44m11.795671763s) [noise=true , address=81.171.14.70:4040 , piece_id=Q4QVVAIAYAVEI5GFW6NECJONEGPKQUGLS5SJFZMSG3RTL53TUDDA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094800800 (31h44m11.796393252s) [noise=true , address=89.149.201.147:4023 , piece_id=XVYPIYOLHLXN6MF67SJ3MZGZFY6CULBZ6UZDHH6LNSJE4HBGDLQQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.098897378 (31h44m11.800489835s) [noise=true , address=185.167.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099395156 (31h44m11.800987608s) [noise=true , address=185.167.204.205:4022 , piece_id=4E2JGAHF23TWJWVYBLE56MGMTMRLWEH33RJYPEHQHAWK3J7CEVXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099863521 (31h44m11.801455977s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100294404 (31h44m11.801886858s) [noise=true , address=81.171.14.70:4028 , piece_id=ZIEOL6VSTZ4VTQT57WGM6WTX7QLUGYA72LOIPPFR6KTIVMJ7UYMA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100633412 (31h44m11.802225867s) [noise=true , address=185.167.204.206:4056 , piece_id=PJRD7FGPTEQYYUCT745F7ZI52SZUIFU5TFNEIKVJCN6TKS3TUEHA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.101434913 (31h44m11.803027366s) [noise=true , address=185.167.204.206:4058 , piece_id=MBRFSYBYMWH3SBBDW42YNWXYK37SYHFT2IOCKJS7BMFPMIBKHQFQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102148306 (31h44m11.80374076s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102516901 (31h44m11.804109353s) [noise=true , address=81.171.14.70:4027 , piece_id=ZZB75QQLI6JIPRALC3MJLK6LJ3X6GL3UDA24IGRV6UHUCO65GQBQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102894823 (31h44m11.804487275s) [noise=true , address=185.167.204.205:4006 , piece_id=K25XGQSKX3FDM2KHDNHTRWXNTLMCZDHIZBZSW7EHZSKDCXABFGCA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.106832421 (31h44m11.808424907s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.107129826 (31h44m11.808722281s) [noise=true , address=185.167.204.205:4021 , piece_id=SEBXV4JSZNQO7LOH3WSBXA2ECKFAI4S3VJRAVHTDPYKH3N62JAKA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.109066332 (31h44m11.810658789s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.112900829 (31h44m11.814493287s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.114375084 (31h44m11.815967584s) [noise=true , address=89.149.201.147:4020 , piece_id=LXTZSAAU3DIQMVSM2XCJSRJU535YFMU622XAYR2WMRHC6ZLNON4A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.117391042 (31h44m11.818983505s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.118935135 (31h44m11.820527591s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120275173 (31h44m11.821867629s) [noise=true , address=81.171.14.70:4026 , piece_id=MT5VEPQDGPEXUO3QT634PU2IQU47LM5ZRX4SJXVTPO2WBR5BL2CQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120987615 (31h44m11.822580075s) [noise=true , address=89.149.201.147:4012 , piece_id=3HKVP2MMAVJOJCNLMOTTDDSCPA4QMXIK4FJ24562LFUYTIR65A6A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.121669813 (31h44m11.823262255s) [noise=true , address=81.171.14.70:4046 , piece_id=PMQPN35FZBRAK7DDZHJBWR5BWB3VJRCCCZXUWATN6DG3XA72WGSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.122378445 (31h44m11.823970895s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.123052255 (31h44m11.824644705s) [noise=true , address=81.171.14.70:4029 , piece_id=XHWCZU2MD2YL6QW4O24T6F6UBZEIFWRL3YFYYZWQAO3LEUTUD4JA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126273483 (31h44m11.827865933s) [noise=true , address=89.149.201.147:4017 , piece_id=XV3VZFXYHIHHF4QLFVBJVW3RCEFAY7DJDYQ2B2LLK3V54LQMV77A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126589016 (31h44m11.828181478s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126653182 (31h44m11.828245644s) [seg_pos={0 0}, upload=27918]: Segment reached optimal threshold of 26 pieces.
Oct 31 19:25:09.127135459 (31h44m11.828727924s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127151429 (31h44m11.82874389s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127365200 (31h44m11.828957662s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127375134 (31h44m11.828967596s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127405694 (31h44m11.828998146s) [seg_pos={0 0}, upload=27918]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Oct 31 19:25:09.127517223 (31h44m11.829109692s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 31 19:25:09.127523946 (31h44m11.829116408s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 31 19:25:09.163266197 (31h44m11.864858653s) [upload=27918]: Done uploading segments...
Oct 31 19:25:09.163420243 (31h44m11.865012694s) [upload=27918]: Upload finished. err: <nil>
Duration: 556.88328ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
548.175466ms trace:
https://jaeger.dev.storj.io/trace/6f03109d869521d
FAIL (2025-10-31 20:05:52 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
67.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956053430 (31h44m11.657645883s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956513382 (31h44m11.658105833s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957203079 (31h44m11.658795537s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957810763 (31h44m11.65940323s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.958490731 (31h44m11.660083188s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.959102151 (31h44m11.660694608s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960053970 (31h44m11.661646453s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960748416 (31h44m11.66234087s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.961426224 (31h44m11.663018685s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.962221532 (31h44m11.663813994s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:09.089405055 (31h44m11.790997516s) [upload=27918]: Next returned nil segment
Oct 31 19:25:09.089426932 (31h44m11.791019394s) [upload=27918]: Waiting for error group managing segments...
Oct 31 19:25:09.094025091 (31h44m11.795617543s) [noise=true , address=89.149.201.147:4008 , piece_id=S7N4S3EQEKJDZGX6R4AIJTJFJCH7KR4GIADESGIQJEPKC73BNW3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094079311 (31h44m11.795671763s) [noise=true , address=81.171.14.70:4040 , piece_id=Q4QVVAIAYAVEI5GFW6NECJONEGPKQUGLS5SJFZMSG3RTL53TUDDA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094800800 (31h44m11.796393252s) [noise=true , address=89.149.201.147:4023 , piece_id=XVYPIYOLHLXN6MF67SJ3MZGZFY6CULBZ6UZDHH6LNSJE4HBGDLQQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.098897378 (31h44m11.800489835s) [noise=true , address=185.167.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099395156 (31h44m11.800987608s) [noise=true , address=185.167.204.205:4022 , piece_id=4E2JGAHF23TWJWVYBLE56MGMTMRLWEH33RJYPEHQHAWK3J7CEVXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099863521 (31h44m11.801455977s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100294404 (31h44m11.801886858s) [noise=true , address=81.171.14.70:4028 , piece_id=ZIEOL6VSTZ4VTQT57WGM6WTX7QLUGYA72LOIPPFR6KTIVMJ7UYMA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100633412 (31h44m11.802225867s) [noise=true , address=185.167.204.206:4056 , piece_id=PJRD7FGPTEQYYUCT745F7ZI52SZUIFU5TFNEIKVJCN6TKS3TUEHA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.101434913 (31h44m11.803027366s) [noise=true , address=185.167.204.206:4058 , piece_id=MBRFSYBYMWH3SBBDW42YNWXYK37SYHFT2IOCKJS7BMFPMIBKHQFQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102148306 (31h44m11.80374076s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102516901 (31h44m11.804109353s) [noise=true , address=81.171.14.70:4027 , piece_id=ZZB75QQLI6JIPRALC3MJLK6LJ3X6GL3UDA24IGRV6UHUCO65GQBQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102894823 (31h44m11.804487275s) [noise=true , address=185.167.204.205:4006 , piece_id=K25XGQSKX3FDM2KHDNHTRWXNTLMCZDHIZBZSW7EHZSKDCXABFGCA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.106832421 (31h44m11.808424907s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.107129826 (31h44m11.808722281s) [noise=true , address=185.167.204.205:4021 , piece_id=SEBXV4JSZNQO7LOH3WSBXA2ECKFAI4S3VJRAVHTDPYKH3N62JAKA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.109066332 (31h44m11.810658789s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.112900829 (31h44m11.814493287s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.114375084 (31h44m11.815967584s) [noise=true , address=89.149.201.147:4020 , piece_id=LXTZSAAU3DIQMVSM2XCJSRJU535YFMU622XAYR2WMRHC6ZLNON4A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.117391042 (31h44m11.818983505s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.118935135 (31h44m11.820527591s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120275173 (31h44m11.821867629s) [noise=true , address=81.171.14.70:4026 , piece_id=MT5VEPQDGPEXUO3QT634PU2IQU47LM5ZRX4SJXVTPO2WBR5BL2CQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120987615 (31h44m11.822580075s) [noise=true , address=89.149.201.147:4012 , piece_id=3HKVP2MMAVJOJCNLMOTTDDSCPA4QMXIK4FJ24562LFUYTIR65A6A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.121669813 (31h44m11.823262255s) [noise=true , address=81.171.14.70:4046 , piece_id=PMQPN35FZBRAK7DDZHJBWR5BWB3VJRCCCZXUWATN6DG3XA72WGSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.122378445 (31h44m11.823970895s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.123052255 (31h44m11.824644705s) [noise=true , address=81.171.14.70:4029 , piece_id=XHWCZU2MD2YL6QW4O24T6F6UBZEIFWRL3YFYYZWQAO3LEUTUD4JA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126273483 (31h44m11.827865933s) [noise=true , address=89.149.201.147:4017 , piece_id=XV3VZFXYHIHHF4QLFVBJVW3RCEFAY7DJDYQ2B2LLK3V54LQMV77A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126589016 (31h44m11.828181478s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126653182 (31h44m11.828245644s) [seg_pos={0 0}, upload=27918]: Segment reached optimal threshold of 26 pieces.
Oct 31 19:25:09.127135459 (31h44m11.828727924s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127151429 (31h44m11.82874389s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127365200 (31h44m11.828957662s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127375134 (31h44m11.828967596s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127405694 (31h44m11.828998146s) [seg_pos={0 0}, upload=27918]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Oct 31 19:25:09.127517223 (31h44m11.829109692s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 31 19:25:09.127523946 (31h44m11.829116408s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 31 19:25:09.163266197 (31h44m11.864858653s) [upload=27918]: Done uploading segments...
Oct 31 19:25:09.163420243 (31h44m11.865012694s) [upload=27918]: Upload finished. err: <nil>
Duration: 548.204053ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
913.755473ms trace:
https://jaeger.dev.storj.io/trace/6f03109d869521d
FAIL (2025-10-31 20:05:17 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
67.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956053430 (31h44m11.657645883s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956513382 (31h44m11.658105833s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957203079 (31h44m11.658795537s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957810763 (31h44m11.65940323s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.958490731 (31h44m11.660083188s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.959102151 (31h44m11.660694608s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960053970 (31h44m11.661646453s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960748416 (31h44m11.66234087s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.961426224 (31h44m11.663018685s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.962221532 (31h44m11.663813994s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:09.089405055 (31h44m11.790997516s) [upload=27918]: Next returned nil segment
Oct 31 19:25:09.089426932 (31h44m11.791019394s) [upload=27918]: Waiting for error group managing segments...
Oct 31 19:25:09.094025091 (31h44m11.795617543s) [noise=true , address=89.149.201.147:4008 , piece_id=S7N4S3EQEKJDZGX6R4AIJTJFJCH7KR4GIADESGIQJEPKC73BNW3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094079311 (31h44m11.795671763s) [noise=true , address=81.171.14.70:4040 , piece_id=Q4QVVAIAYAVEI5GFW6NECJONEGPKQUGLS5SJFZMSG3RTL53TUDDA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094800800 (31h44m11.796393252s) [noise=true , address=89.149.201.147:4023 , piece_id=XVYPIYOLHLXN6MF67SJ3MZGZFY6CULBZ6UZDHH6LNSJE4HBGDLQQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.098897378 (31h44m11.800489835s) [noise=true , address=185.167.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099395156 (31h44m11.800987608s) [noise=true , address=185.167.204.205:4022 , piece_id=4E2JGAHF23TWJWVYBLE56MGMTMRLWEH33RJYPEHQHAWK3J7CEVXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099863521 (31h44m11.801455977s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100294404 (31h44m11.801886858s) [noise=true , address=81.171.14.70:4028 , piece_id=ZIEOL6VSTZ4VTQT57WGM6WTX7QLUGYA72LOIPPFR6KTIVMJ7UYMA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100633412 (31h44m11.802225867s) [noise=true , address=185.167.204.206:4056 , piece_id=PJRD7FGPTEQYYUCT745F7ZI52SZUIFU5TFNEIKVJCN6TKS3TUEHA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.101434913 (31h44m11.803027366s) [noise=true , address=185.167.204.206:4058 , piece_id=MBRFSYBYMWH3SBBDW42YNWXYK37SYHFT2IOCKJS7BMFPMIBKHQFQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102148306 (31h44m11.80374076s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102516901 (31h44m11.804109353s) [noise=true , address=81.171.14.70:4027 , piece_id=ZZB75QQLI6JIPRALC3MJLK6LJ3X6GL3UDA24IGRV6UHUCO65GQBQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102894823 (31h44m11.804487275s) [noise=true , address=185.167.204.205:4006 , piece_id=K25XGQSKX3FDM2KHDNHTRWXNTLMCZDHIZBZSW7EHZSKDCXABFGCA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.106832421 (31h44m11.808424907s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.107129826 (31h44m11.808722281s) [noise=true , address=185.167.204.205:4021 , piece_id=SEBXV4JSZNQO7LOH3WSBXA2ECKFAI4S3VJRAVHTDPYKH3N62JAKA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.109066332 (31h44m11.810658789s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.112900829 (31h44m11.814493287s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.114375084 (31h44m11.815967584s) [noise=true , address=89.149.201.147:4020 , piece_id=LXTZSAAU3DIQMVSM2XCJSRJU535YFMU622XAYR2WMRHC6ZLNON4A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.117391042 (31h44m11.818983505s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.118935135 (31h44m11.820527591s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120275173 (31h44m11.821867629s) [noise=true , address=81.171.14.70:4026 , piece_id=MT5VEPQDGPEXUO3QT634PU2IQU47LM5ZRX4SJXVTPO2WBR5BL2CQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120987615 (31h44m11.822580075s) [noise=true , address=89.149.201.147:4012 , piece_id=3HKVP2MMAVJOJCNLMOTTDDSCPA4QMXIK4FJ24562LFUYTIR65A6A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.121669813 (31h44m11.823262255s) [noise=true , address=81.171.14.70:4046 , piece_id=PMQPN35FZBRAK7DDZHJBWR5BWB3VJRCCCZXUWATN6DG3XA72WGSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.122378445 (31h44m11.823970895s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.123052255 (31h44m11.824644705s) [noise=true , address=81.171.14.70:4029 , piece_id=XHWCZU2MD2YL6QW4O24T6F6UBZEIFWRL3YFYYZWQAO3LEUTUD4JA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126273483 (31h44m11.827865933s) [noise=true , address=89.149.201.147:4017 , piece_id=XV3VZFXYHIHHF4QLFVBJVW3RCEFAY7DJDYQ2B2LLK3V54LQMV77A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126589016 (31h44m11.828181478s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126653182 (31h44m11.828245644s) [seg_pos={0 0}, upload=27918]: Segment reached optimal threshold of 26 pieces.
Oct 31 19:25:09.127135459 (31h44m11.828727924s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127151429 (31h44m11.82874389s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127365200 (31h44m11.828957662s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127375134 (31h44m11.828967596s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127405694 (31h44m11.828998146s) [seg_pos={0 0}, upload=27918]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Oct 31 19:25:09.127517223 (31h44m11.829109692s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 31 19:25:09.127523946 (31h44m11.829116408s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 31 19:25:09.163266197 (31h44m11.864858653s) [upload=27918]: Done uploading segments...
Oct 31 19:25:09.163420243 (31h44m11.865012694s) [upload=27918]: Upload finished. err: <nil>
Duration: 913.779136ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
857.483038ms trace:
https://jaeger.dev.storj.io/trace/6f03109d869521d
FAIL (2025-10-31 20:04:45 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
67.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956053430 (31h44m11.657645883s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956513382 (31h44m11.658105833s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957203079 (31h44m11.658795537s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957810763 (31h44m11.65940323s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.958490731 (31h44m11.660083188s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.959102151 (31h44m11.660694608s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960053970 (31h44m11.661646453s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960748416 (31h44m11.66234087s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.961426224 (31h44m11.663018685s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.962221532 (31h44m11.663813994s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:09.089405055 (31h44m11.790997516s) [upload=27918]: Next returned nil segment
Oct 31 19:25:09.089426932 (31h44m11.791019394s) [upload=27918]: Waiting for error group managing segments...
Oct 31 19:25:09.094025091 (31h44m11.795617543s) [noise=true , address=89.149.201.147:4008 , piece_id=S7N4S3EQEKJDZGX6R4AIJTJFJCH7KR4GIADESGIQJEPKC73BNW3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094079311 (31h44m11.795671763s) [noise=true , address=81.171.14.70:4040 , piece_id=Q4QVVAIAYAVEI5GFW6NECJONEGPKQUGLS5SJFZMSG3RTL53TUDDA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094800800 (31h44m11.796393252s) [noise=true , address=89.149.201.147:4023 , piece_id=XVYPIYOLHLXN6MF67SJ3MZGZFY6CULBZ6UZDHH6LNSJE4HBGDLQQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.098897378 (31h44m11.800489835s) [noise=true , address=185.167.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099395156 (31h44m11.800987608s) [noise=true , address=185.167.204.205:4022 , piece_id=4E2JGAHF23TWJWVYBLE56MGMTMRLWEH33RJYPEHQHAWK3J7CEVXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099863521 (31h44m11.801455977s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100294404 (31h44m11.801886858s) [noise=true , address=81.171.14.70:4028 , piece_id=ZIEOL6VSTZ4VTQT57WGM6WTX7QLUGYA72LOIPPFR6KTIVMJ7UYMA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100633412 (31h44m11.802225867s) [noise=true , address=185.167.204.206:4056 , piece_id=PJRD7FGPTEQYYUCT745F7ZI52SZUIFU5TFNEIKVJCN6TKS3TUEHA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.101434913 (31h44m11.803027366s) [noise=true , address=185.167.204.206:4058 , piece_id=MBRFSYBYMWH3SBBDW42YNWXYK37SYHFT2IOCKJS7BMFPMIBKHQFQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102148306 (31h44m11.80374076s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102516901 (31h44m11.804109353s) [noise=true , address=81.171.14.70:4027 , piece_id=ZZB75QQLI6JIPRALC3MJLK6LJ3X6GL3UDA24IGRV6UHUCO65GQBQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102894823 (31h44m11.804487275s) [noise=true , address=185.167.204.205:4006 , piece_id=K25XGQSKX3FDM2KHDNHTRWXNTLMCZDHIZBZSW7EHZSKDCXABFGCA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.106832421 (31h44m11.808424907s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.107129826 (31h44m11.808722281s) [noise=true , address=185.167.204.205:4021 , piece_id=SEBXV4JSZNQO7LOH3WSBXA2ECKFAI4S3VJRAVHTDPYKH3N62JAKA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.109066332 (31h44m11.810658789s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.112900829 (31h44m11.814493287s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.114375084 (31h44m11.815967584s) [noise=true , address=89.149.201.147:4020 , piece_id=LXTZSAAU3DIQMVSM2XCJSRJU535YFMU622XAYR2WMRHC6ZLNON4A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.117391042 (31h44m11.818983505s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.118935135 (31h44m11.820527591s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120275173 (31h44m11.821867629s) [noise=true , address=81.171.14.70:4026 , piece_id=MT5VEPQDGPEXUO3QT634PU2IQU47LM5ZRX4SJXVTPO2WBR5BL2CQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120987615 (31h44m11.822580075s) [noise=true , address=89.149.201.147:4012 , piece_id=3HKVP2MMAVJOJCNLMOTTDDSCPA4QMXIK4FJ24562LFUYTIR65A6A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.121669813 (31h44m11.823262255s) [noise=true , address=81.171.14.70:4046 , piece_id=PMQPN35FZBRAK7DDZHJBWR5BWB3VJRCCCZXUWATN6DG3XA72WGSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.122378445 (31h44m11.823970895s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.123052255 (31h44m11.824644705s) [noise=true , address=81.171.14.70:4029 , piece_id=XHWCZU2MD2YL6QW4O24T6F6UBZEIFWRL3YFYYZWQAO3LEUTUD4JA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126273483 (31h44m11.827865933s) [noise=true , address=89.149.201.147:4017 , piece_id=XV3VZFXYHIHHF4QLFVBJVW3RCEFAY7DJDYQ2B2LLK3V54LQMV77A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126589016 (31h44m11.828181478s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126653182 (31h44m11.828245644s) [seg_pos={0 0}, upload=27918]: Segment reached optimal threshold of 26 pieces.
Oct 31 19:25:09.127135459 (31h44m11.828727924s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127151429 (31h44m11.82874389s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127365200 (31h44m11.828957662s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127375134 (31h44m11.828967596s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127405694 (31h44m11.828998146s) [seg_pos={0 0}, upload=27918]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Oct 31 19:25:09.127517223 (31h44m11.829109692s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 31 19:25:09.127523946 (31h44m11.829116408s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 31 19:25:09.163266197 (31h44m11.864858653s) [upload=27918]: Done uploading segments...
Oct 31 19:25:09.163420243 (31h44m11.865012694s) [upload=27918]: Upload finished. err: <nil>
Duration: 857.507781ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
841.35418ms trace:
https://jaeger.dev.storj.io/trace/6f03109d869521d
FAIL (2025-10-31 20:03:55 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
67.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956053430 (31h44m11.657645883s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956513382 (31h44m11.658105833s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957203079 (31h44m11.658795537s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957810763 (31h44m11.65940323s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.958490731 (31h44m11.660083188s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.959102151 (31h44m11.660694608s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960053970 (31h44m11.661646453s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960748416 (31h44m11.66234087s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.961426224 (31h44m11.663018685s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.962221532 (31h44m11.663813994s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:09.089405055 (31h44m11.790997516s) [upload=27918]: Next returned nil segment
Oct 31 19:25:09.089426932 (31h44m11.791019394s) [upload=27918]: Waiting for error group managing segments...
Oct 31 19:25:09.094025091 (31h44m11.795617543s) [noise=true , address=89.149.201.147:4008 , piece_id=S7N4S3EQEKJDZGX6R4AIJTJFJCH7KR4GIADESGIQJEPKC73BNW3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094079311 (31h44m11.795671763s) [noise=true , address=81.171.14.70:4040 , piece_id=Q4QVVAIAYAVEI5GFW6NECJONEGPKQUGLS5SJFZMSG3RTL53TUDDA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094800800 (31h44m11.796393252s) [noise=true , address=89.149.201.147:4023 , piece_id=XVYPIYOLHLXN6MF67SJ3MZGZFY6CULBZ6UZDHH6LNSJE4HBGDLQQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.098897378 (31h44m11.800489835s) [noise=true , address=185.167.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099395156 (31h44m11.800987608s) [noise=true , address=185.167.204.205:4022 , piece_id=4E2JGAHF23TWJWVYBLE56MGMTMRLWEH33RJYPEHQHAWK3J7CEVXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099863521 (31h44m11.801455977s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100294404 (31h44m11.801886858s) [noise=true , address=81.171.14.70:4028 , piece_id=ZIEOL6VSTZ4VTQT57WGM6WTX7QLUGYA72LOIPPFR6KTIVMJ7UYMA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100633412 (31h44m11.802225867s) [noise=true , address=185.167.204.206:4056 , piece_id=PJRD7FGPTEQYYUCT745F7ZI52SZUIFU5TFNEIKVJCN6TKS3TUEHA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.101434913 (31h44m11.803027366s) [noise=true , address=185.167.204.206:4058 , piece_id=MBRFSYBYMWH3SBBDW42YNWXYK37SYHFT2IOCKJS7BMFPMIBKHQFQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102148306 (31h44m11.80374076s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102516901 (31h44m11.804109353s) [noise=true , address=81.171.14.70:4027 , piece_id=ZZB75QQLI6JIPRALC3MJLK6LJ3X6GL3UDA24IGRV6UHUCO65GQBQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102894823 (31h44m11.804487275s) [noise=true , address=185.167.204.205:4006 , piece_id=K25XGQSKX3FDM2KHDNHTRWXNTLMCZDHIZBZSW7EHZSKDCXABFGCA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.106832421 (31h44m11.808424907s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.107129826 (31h44m11.808722281s) [noise=true , address=185.167.204.205:4021 , piece_id=SEBXV4JSZNQO7LOH3WSBXA2ECKFAI4S3VJRAVHTDPYKH3N62JAKA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.109066332 (31h44m11.810658789s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.112900829 (31h44m11.814493287s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.114375084 (31h44m11.815967584s) [noise=true , address=89.149.201.147:4020 , piece_id=LXTZSAAU3DIQMVSM2XCJSRJU535YFMU622XAYR2WMRHC6ZLNON4A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.117391042 (31h44m11.818983505s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.118935135 (31h44m11.820527591s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120275173 (31h44m11.821867629s) [noise=true , address=81.171.14.70:4026 , piece_id=MT5VEPQDGPEXUO3QT634PU2IQU47LM5ZRX4SJXVTPO2WBR5BL2CQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120987615 (31h44m11.822580075s) [noise=true , address=89.149.201.147:4012 , piece_id=3HKVP2MMAVJOJCNLMOTTDDSCPA4QMXIK4FJ24562LFUYTIR65A6A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.121669813 (31h44m11.823262255s) [noise=true , address=81.171.14.70:4046 , piece_id=PMQPN35FZBRAK7DDZHJBWR5BWB3VJRCCCZXUWATN6DG3XA72WGSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.122378445 (31h44m11.823970895s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.123052255 (31h44m11.824644705s) [noise=true , address=81.171.14.70:4029 , piece_id=XHWCZU2MD2YL6QW4O24T6F6UBZEIFWRL3YFYYZWQAO3LEUTUD4JA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126273483 (31h44m11.827865933s) [noise=true , address=89.149.201.147:4017 , piece_id=XV3VZFXYHIHHF4QLFVBJVW3RCEFAY7DJDYQ2B2LLK3V54LQMV77A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126589016 (31h44m11.828181478s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126653182 (31h44m11.828245644s) [seg_pos={0 0}, upload=27918]: Segment reached optimal threshold of 26 pieces.
Oct 31 19:25:09.127135459 (31h44m11.828727924s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127151429 (31h44m11.82874389s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127365200 (31h44m11.828957662s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127375134 (31h44m11.828967596s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127405694 (31h44m11.828998146s) [seg_pos={0 0}, upload=27918]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Oct 31 19:25:09.127517223 (31h44m11.829109692s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 31 19:25:09.127523946 (31h44m11.829116408s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 31 19:25:09.163266197 (31h44m11.864858653s) [upload=27918]: Done uploading segments...
Oct 31 19:25:09.163420243 (31h44m11.865012694s) [upload=27918]: Upload finished. err: <nil>
Duration: 841.382996ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
952.85772ms trace:
https://jaeger.dev.storj.io/trace/6f03109d869521d
FAIL (2025-10-31 20:03:17 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
67.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956053430 (31h44m11.657645883s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956513382 (31h44m11.658105833s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957203079 (31h44m11.658795537s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957810763 (31h44m11.65940323s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.958490731 (31h44m11.660083188s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.959102151 (31h44m11.660694608s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960053970 (31h44m11.661646453s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960748416 (31h44m11.66234087s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.961426224 (31h44m11.663018685s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.962221532 (31h44m11.663813994s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:09.089405055 (31h44m11.790997516s) [upload=27918]: Next returned nil segment
Oct 31 19:25:09.089426932 (31h44m11.791019394s) [upload=27918]: Waiting for error group managing segments...
Oct 31 19:25:09.094025091 (31h44m11.795617543s) [noise=true , address=89.149.201.147:4008 , piece_id=S7N4S3EQEKJDZGX6R4AIJTJFJCH7KR4GIADESGIQJEPKC73BNW3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094079311 (31h44m11.795671763s) [noise=true , address=81.171.14.70:4040 , piece_id=Q4QVVAIAYAVEI5GFW6NECJONEGPKQUGLS5SJFZMSG3RTL53TUDDA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094800800 (31h44m11.796393252s) [noise=true , address=89.149.201.147:4023 , piece_id=XVYPIYOLHLXN6MF67SJ3MZGZFY6CULBZ6UZDHH6LNSJE4HBGDLQQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.098897378 (31h44m11.800489835s) [noise=true , address=185.167.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099395156 (31h44m11.800987608s) [noise=true , address=185.167.204.205:4022 , piece_id=4E2JGAHF23TWJWVYBLE56MGMTMRLWEH33RJYPEHQHAWK3J7CEVXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099863521 (31h44m11.801455977s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100294404 (31h44m11.801886858s) [noise=true , address=81.171.14.70:4028 , piece_id=ZIEOL6VSTZ4VTQT57WGM6WTX7QLUGYA72LOIPPFR6KTIVMJ7UYMA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100633412 (31h44m11.802225867s) [noise=true , address=185.167.204.206:4056 , piece_id=PJRD7FGPTEQYYUCT745F7ZI52SZUIFU5TFNEIKVJCN6TKS3TUEHA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.101434913 (31h44m11.803027366s) [noise=true , address=185.167.204.206:4058 , piece_id=MBRFSYBYMWH3SBBDW42YNWXYK37SYHFT2IOCKJS7BMFPMIBKHQFQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102148306 (31h44m11.80374076s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102516901 (31h44m11.804109353s) [noise=true , address=81.171.14.70:4027 , piece_id=ZZB75QQLI6JIPRALC3MJLK6LJ3X6GL3UDA24IGRV6UHUCO65GQBQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102894823 (31h44m11.804487275s) [noise=true , address=185.167.204.205:4006 , piece_id=K25XGQSKX3FDM2KHDNHTRWXNTLMCZDHIZBZSW7EHZSKDCXABFGCA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.106832421 (31h44m11.808424907s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.107129826 (31h44m11.808722281s) [noise=true , address=185.167.204.205:4021 , piece_id=SEBXV4JSZNQO7LOH3WSBXA2ECKFAI4S3VJRAVHTDPYKH3N62JAKA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.109066332 (31h44m11.810658789s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.112900829 (31h44m11.814493287s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.114375084 (31h44m11.815967584s) [noise=true , address=89.149.201.147:4020 , piece_id=LXTZSAAU3DIQMVSM2XCJSRJU535YFMU622XAYR2WMRHC6ZLNON4A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.117391042 (31h44m11.818983505s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.118935135 (31h44m11.820527591s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120275173 (31h44m11.821867629s) [noise=true , address=81.171.14.70:4026 , piece_id=MT5VEPQDGPEXUO3QT634PU2IQU47LM5ZRX4SJXVTPO2WBR5BL2CQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120987615 (31h44m11.822580075s) [noise=true , address=89.149.201.147:4012 , piece_id=3HKVP2MMAVJOJCNLMOTTDDSCPA4QMXIK4FJ24562LFUYTIR65A6A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.121669813 (31h44m11.823262255s) [noise=true , address=81.171.14.70:4046 , piece_id=PMQPN35FZBRAK7DDZHJBWR5BWB3VJRCCCZXUWATN6DG3XA72WGSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.122378445 (31h44m11.823970895s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.123052255 (31h44m11.824644705s) [noise=true , address=81.171.14.70:4029 , piece_id=XHWCZU2MD2YL6QW4O24T6F6UBZEIFWRL3YFYYZWQAO3LEUTUD4JA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126273483 (31h44m11.827865933s) [noise=true , address=89.149.201.147:4017 , piece_id=XV3VZFXYHIHHF4QLFVBJVW3RCEFAY7DJDYQ2B2LLK3V54LQMV77A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126589016 (31h44m11.828181478s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126653182 (31h44m11.828245644s) [seg_pos={0 0}, upload=27918]: Segment reached optimal threshold of 26 pieces.
Oct 31 19:25:09.127135459 (31h44m11.828727924s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127151429 (31h44m11.82874389s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127365200 (31h44m11.828957662s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127375134 (31h44m11.828967596s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127405694 (31h44m11.828998146s) [seg_pos={0 0}, upload=27918]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Oct 31 19:25:09.127517223 (31h44m11.829109692s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 31 19:25:09.127523946 (31h44m11.829116408s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 31 19:25:09.163266197 (31h44m11.864858653s) [upload=27918]: Done uploading segments...
Oct 31 19:25:09.163420243 (31h44m11.865012694s) [upload=27918]: Upload finished. err: <nil>
Duration: 952.871474ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
567.493703ms trace:
https://jaeger.dev.storj.io/trace/6f03109d869521d
FAIL (2025-10-31 20:02:07 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
67.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956053430 (31h44m11.657645883s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956513382 (31h44m11.658105833s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957203079 (31h44m11.658795537s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957810763 (31h44m11.65940323s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.958490731 (31h44m11.660083188s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.959102151 (31h44m11.660694608s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960053970 (31h44m11.661646453s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960748416 (31h44m11.66234087s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.961426224 (31h44m11.663018685s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.962221532 (31h44m11.663813994s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:09.089405055 (31h44m11.790997516s) [upload=27918]: Next returned nil segment
Oct 31 19:25:09.089426932 (31h44m11.791019394s) [upload=27918]: Waiting for error group managing segments...
Oct 31 19:25:09.094025091 (31h44m11.795617543s) [noise=true , address=89.149.201.147:4008 , piece_id=S7N4S3EQEKJDZGX6R4AIJTJFJCH7KR4GIADESGIQJEPKC73BNW3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094079311 (31h44m11.795671763s) [noise=true , address=81.171.14.70:4040 , piece_id=Q4QVVAIAYAVEI5GFW6NECJONEGPKQUGLS5SJFZMSG3RTL53TUDDA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094800800 (31h44m11.796393252s) [noise=true , address=89.149.201.147:4023 , piece_id=XVYPIYOLHLXN6MF67SJ3MZGZFY6CULBZ6UZDHH6LNSJE4HBGDLQQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.098897378 (31h44m11.800489835s) [noise=true , address=185.167.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099395156 (31h44m11.800987608s) [noise=true , address=185.167.204.205:4022 , piece_id=4E2JGAHF23TWJWVYBLE56MGMTMRLWEH33RJYPEHQHAWK3J7CEVXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099863521 (31h44m11.801455977s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100294404 (31h44m11.801886858s) [noise=true , address=81.171.14.70:4028 , piece_id=ZIEOL6VSTZ4VTQT57WGM6WTX7QLUGYA72LOIPPFR6KTIVMJ7UYMA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100633412 (31h44m11.802225867s) [noise=true , address=185.167.204.206:4056 , piece_id=PJRD7FGPTEQYYUCT745F7ZI52SZUIFU5TFNEIKVJCN6TKS3TUEHA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.101434913 (31h44m11.803027366s) [noise=true , address=185.167.204.206:4058 , piece_id=MBRFSYBYMWH3SBBDW42YNWXYK37SYHFT2IOCKJS7BMFPMIBKHQFQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102148306 (31h44m11.80374076s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102516901 (31h44m11.804109353s) [noise=true , address=81.171.14.70:4027 , piece_id=ZZB75QQLI6JIPRALC3MJLK6LJ3X6GL3UDA24IGRV6UHUCO65GQBQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102894823 (31h44m11.804487275s) [noise=true , address=185.167.204.205:4006 , piece_id=K25XGQSKX3FDM2KHDNHTRWXNTLMCZDHIZBZSW7EHZSKDCXABFGCA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.106832421 (31h44m11.808424907s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.107129826 (31h44m11.808722281s) [noise=true , address=185.167.204.205:4021 , piece_id=SEBXV4JSZNQO7LOH3WSBXA2ECKFAI4S3VJRAVHTDPYKH3N62JAKA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.109066332 (31h44m11.810658789s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.112900829 (31h44m11.814493287s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.114375084 (31h44m11.815967584s) [noise=true , address=89.149.201.147:4020 , piece_id=LXTZSAAU3DIQMVSM2XCJSRJU535YFMU622XAYR2WMRHC6ZLNON4A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.117391042 (31h44m11.818983505s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.118935135 (31h44m11.820527591s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120275173 (31h44m11.821867629s) [noise=true , address=81.171.14.70:4026 , piece_id=MT5VEPQDGPEXUO3QT634PU2IQU47LM5ZRX4SJXVTPO2WBR5BL2CQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120987615 (31h44m11.822580075s) [noise=true , address=89.149.201.147:4012 , piece_id=3HKVP2MMAVJOJCNLMOTTDDSCPA4QMXIK4FJ24562LFUYTIR65A6A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.121669813 (31h44m11.823262255s) [noise=true , address=81.171.14.70:4046 , piece_id=PMQPN35FZBRAK7DDZHJBWR5BWB3VJRCCCZXUWATN6DG3XA72WGSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.122378445 (31h44m11.823970895s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.123052255 (31h44m11.824644705s) [noise=true , address=81.171.14.70:4029 , piece_id=XHWCZU2MD2YL6QW4O24T6F6UBZEIFWRL3YFYYZWQAO3LEUTUD4JA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126273483 (31h44m11.827865933s) [noise=true , address=89.149.201.147:4017 , piece_id=XV3VZFXYHIHHF4QLFVBJVW3RCEFAY7DJDYQ2B2LLK3V54LQMV77A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126589016 (31h44m11.828181478s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126653182 (31h44m11.828245644s) [seg_pos={0 0}, upload=27918]: Segment reached optimal threshold of 26 pieces.
Oct 31 19:25:09.127135459 (31h44m11.828727924s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127151429 (31h44m11.82874389s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127365200 (31h44m11.828957662s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127375134 (31h44m11.828967596s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127405694 (31h44m11.828998146s) [seg_pos={0 0}, upload=27918]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Oct 31 19:25:09.127517223 (31h44m11.829109692s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 31 19:25:09.127523946 (31h44m11.829116408s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 31 19:25:09.163266197 (31h44m11.864858653s) [upload=27918]: Done uploading segments...
Oct 31 19:25:09.163420243 (31h44m11.865012694s) [upload=27918]: Upload finished. err: <nil>
Duration: 567.521231ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
450.888058ms trace:
https://jaeger.dev.storj.io/trace/6f03109d869521d
FAIL (2025-10-31 20:00:57 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
67.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956053430 (31h44m11.657645883s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956513382 (31h44m11.658105833s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957203079 (31h44m11.658795537s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957810763 (31h44m11.65940323s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.958490731 (31h44m11.660083188s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.959102151 (31h44m11.660694608s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960053970 (31h44m11.661646453s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960748416 (31h44m11.66234087s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.961426224 (31h44m11.663018685s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.962221532 (31h44m11.663813994s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:09.089405055 (31h44m11.790997516s) [upload=27918]: Next returned nil segment
Oct 31 19:25:09.089426932 (31h44m11.791019394s) [upload=27918]: Waiting for error group managing segments...
Oct 31 19:25:09.094025091 (31h44m11.795617543s) [noise=true , address=89.149.201.147:4008 , piece_id=S7N4S3EQEKJDZGX6R4AIJTJFJCH7KR4GIADESGIQJEPKC73BNW3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094079311 (31h44m11.795671763s) [noise=true , address=81.171.14.70:4040 , piece_id=Q4QVVAIAYAVEI5GFW6NECJONEGPKQUGLS5SJFZMSG3RTL53TUDDA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094800800 (31h44m11.796393252s) [noise=true , address=89.149.201.147:4023 , piece_id=XVYPIYOLHLXN6MF67SJ3MZGZFY6CULBZ6UZDHH6LNSJE4HBGDLQQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.098897378 (31h44m11.800489835s) [noise=true , address=185.167.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099395156 (31h44m11.800987608s) [noise=true , address=185.167.204.205:4022 , piece_id=4E2JGAHF23TWJWVYBLE56MGMTMRLWEH33RJYPEHQHAWK3J7CEVXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099863521 (31h44m11.801455977s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100294404 (31h44m11.801886858s) [noise=true , address=81.171.14.70:4028 , piece_id=ZIEOL6VSTZ4VTQT57WGM6WTX7QLUGYA72LOIPPFR6KTIVMJ7UYMA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100633412 (31h44m11.802225867s) [noise=true , address=185.167.204.206:4056 , piece_id=PJRD7FGPTEQYYUCT745F7ZI52SZUIFU5TFNEIKVJCN6TKS3TUEHA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.101434913 (31h44m11.803027366s) [noise=true , address=185.167.204.206:4058 , piece_id=MBRFSYBYMWH3SBBDW42YNWXYK37SYHFT2IOCKJS7BMFPMIBKHQFQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102148306 (31h44m11.80374076s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102516901 (31h44m11.804109353s) [noise=true , address=81.171.14.70:4027 , piece_id=ZZB75QQLI6JIPRALC3MJLK6LJ3X6GL3UDA24IGRV6UHUCO65GQBQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102894823 (31h44m11.804487275s) [noise=true , address=185.167.204.205:4006 , piece_id=K25XGQSKX3FDM2KHDNHTRWXNTLMCZDHIZBZSW7EHZSKDCXABFGCA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.106832421 (31h44m11.808424907s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.107129826 (31h44m11.808722281s) [noise=true , address=185.167.204.205:4021 , piece_id=SEBXV4JSZNQO7LOH3WSBXA2ECKFAI4S3VJRAVHTDPYKH3N62JAKA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.109066332 (31h44m11.810658789s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.112900829 (31h44m11.814493287s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.114375084 (31h44m11.815967584s) [noise=true , address=89.149.201.147:4020 , piece_id=LXTZSAAU3DIQMVSM2XCJSRJU535YFMU622XAYR2WMRHC6ZLNON4A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.117391042 (31h44m11.818983505s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.118935135 (31h44m11.820527591s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120275173 (31h44m11.821867629s) [noise=true , address=81.171.14.70:4026 , piece_id=MT5VEPQDGPEXUO3QT634PU2IQU47LM5ZRX4SJXVTPO2WBR5BL2CQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120987615 (31h44m11.822580075s) [noise=true , address=89.149.201.147:4012 , piece_id=3HKVP2MMAVJOJCNLMOTTDDSCPA4QMXIK4FJ24562LFUYTIR65A6A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.121669813 (31h44m11.823262255s) [noise=true , address=81.171.14.70:4046 , piece_id=PMQPN35FZBRAK7DDZHJBWR5BWB3VJRCCCZXUWATN6DG3XA72WGSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.122378445 (31h44m11.823970895s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.123052255 (31h44m11.824644705s) [noise=true , address=81.171.14.70:4029 , piece_id=XHWCZU2MD2YL6QW4O24T6F6UBZEIFWRL3YFYYZWQAO3LEUTUD4JA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126273483 (31h44m11.827865933s) [noise=true , address=89.149.201.147:4017 , piece_id=XV3VZFXYHIHHF4QLFVBJVW3RCEFAY7DJDYQ2B2LLK3V54LQMV77A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126589016 (31h44m11.828181478s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126653182 (31h44m11.828245644s) [seg_pos={0 0}, upload=27918]: Segment reached optimal threshold of 26 pieces.
Oct 31 19:25:09.127135459 (31h44m11.828727924s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127151429 (31h44m11.82874389s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127365200 (31h44m11.828957662s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127375134 (31h44m11.828967596s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127405694 (31h44m11.828998146s) [seg_pos={0 0}, upload=27918]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Oct 31 19:25:09.127517223 (31h44m11.829109692s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 31 19:25:09.127523946 (31h44m11.829116408s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 31 19:25:09.163266197 (31h44m11.864858653s) [upload=27918]: Done uploading segments...
Oct 31 19:25:09.163420243 (31h44m11.865012694s) [upload=27918]: Upload finished. err: <nil>
Duration: 450.977882ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
478.770735ms trace:
https://jaeger.dev.storj.io/trace/6f03109d869521d
FAIL (2025-10-31 20:00:17 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
67.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956053430 (31h44m11.657645883s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956513382 (31h44m11.658105833s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957203079 (31h44m11.658795537s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957810763 (31h44m11.65940323s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.958490731 (31h44m11.660083188s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.959102151 (31h44m11.660694608s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960053970 (31h44m11.661646453s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960748416 (31h44m11.66234087s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.961426224 (31h44m11.663018685s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.962221532 (31h44m11.663813994s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:09.089405055 (31h44m11.790997516s) [upload=27918]: Next returned nil segment
Oct 31 19:25:09.089426932 (31h44m11.791019394s) [upload=27918]: Waiting for error group managing segments...
Oct 31 19:25:09.094025091 (31h44m11.795617543s) [noise=true , address=89.149.201.147:4008 , piece_id=S7N4S3EQEKJDZGX6R4AIJTJFJCH7KR4GIADESGIQJEPKC73BNW3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094079311 (31h44m11.795671763s) [noise=true , address=81.171.14.70:4040 , piece_id=Q4QVVAIAYAVEI5GFW6NECJONEGPKQUGLS5SJFZMSG3RTL53TUDDA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094800800 (31h44m11.796393252s) [noise=true , address=89.149.201.147:4023 , piece_id=XVYPIYOLHLXN6MF67SJ3MZGZFY6CULBZ6UZDHH6LNSJE4HBGDLQQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.098897378 (31h44m11.800489835s) [noise=true , address=185.167.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099395156 (31h44m11.800987608s) [noise=true , address=185.167.204.205:4022 , piece_id=4E2JGAHF23TWJWVYBLE56MGMTMRLWEH33RJYPEHQHAWK3J7CEVXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099863521 (31h44m11.801455977s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100294404 (31h44m11.801886858s) [noise=true , address=81.171.14.70:4028 , piece_id=ZIEOL6VSTZ4VTQT57WGM6WTX7QLUGYA72LOIPPFR6KTIVMJ7UYMA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100633412 (31h44m11.802225867s) [noise=true , address=185.167.204.206:4056 , piece_id=PJRD7FGPTEQYYUCT745F7ZI52SZUIFU5TFNEIKVJCN6TKS3TUEHA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.101434913 (31h44m11.803027366s) [noise=true , address=185.167.204.206:4058 , piece_id=MBRFSYBYMWH3SBBDW42YNWXYK37SYHFT2IOCKJS7BMFPMIBKHQFQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102148306 (31h44m11.80374076s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102516901 (31h44m11.804109353s) [noise=true , address=81.171.14.70:4027 , piece_id=ZZB75QQLI6JIPRALC3MJLK6LJ3X6GL3UDA24IGRV6UHUCO65GQBQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102894823 (31h44m11.804487275s) [noise=true , address=185.167.204.205:4006 , piece_id=K25XGQSKX3FDM2KHDNHTRWXNTLMCZDHIZBZSW7EHZSKDCXABFGCA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.106832421 (31h44m11.808424907s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.107129826 (31h44m11.808722281s) [noise=true , address=185.167.204.205:4021 , piece_id=SEBXV4JSZNQO7LOH3WSBXA2ECKFAI4S3VJRAVHTDPYKH3N62JAKA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.109066332 (31h44m11.810658789s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.112900829 (31h44m11.814493287s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.114375084 (31h44m11.815967584s) [noise=true , address=89.149.201.147:4020 , piece_id=LXTZSAAU3DIQMVSM2XCJSRJU535YFMU622XAYR2WMRHC6ZLNON4A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.117391042 (31h44m11.818983505s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.118935135 (31h44m11.820527591s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120275173 (31h44m11.821867629s) [noise=true , address=81.171.14.70:4026 , piece_id=MT5VEPQDGPEXUO3QT634PU2IQU47LM5ZRX4SJXVTPO2WBR5BL2CQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120987615 (31h44m11.822580075s) [noise=true , address=89.149.201.147:4012 , piece_id=3HKVP2MMAVJOJCNLMOTTDDSCPA4QMXIK4FJ24562LFUYTIR65A6A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.121669813 (31h44m11.823262255s) [noise=true , address=81.171.14.70:4046 , piece_id=PMQPN35FZBRAK7DDZHJBWR5BWB3VJRCCCZXUWATN6DG3XA72WGSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.122378445 (31h44m11.823970895s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.123052255 (31h44m11.824644705s) [noise=true , address=81.171.14.70:4029 , piece_id=XHWCZU2MD2YL6QW4O24T6F6UBZEIFWRL3YFYYZWQAO3LEUTUD4JA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126273483 (31h44m11.827865933s) [noise=true , address=89.149.201.147:4017 , piece_id=XV3VZFXYHIHHF4QLFVBJVW3RCEFAY7DJDYQ2B2LLK3V54LQMV77A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126589016 (31h44m11.828181478s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126653182 (31h44m11.828245644s) [seg_pos={0 0}, upload=27918]: Segment reached optimal threshold of 26 pieces.
Oct 31 19:25:09.127135459 (31h44m11.828727924s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127151429 (31h44m11.82874389s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127365200 (31h44m11.828957662s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127375134 (31h44m11.828967596s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127405694 (31h44m11.828998146s) [seg_pos={0 0}, upload=27918]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Oct 31 19:25:09.127517223 (31h44m11.829109692s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 31 19:25:09.127523946 (31h44m11.829116408s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 31 19:25:09.163266197 (31h44m11.864858653s) [upload=27918]: Done uploading segments...
Oct 31 19:25:09.163420243 (31h44m11.865012694s) [upload=27918]: Upload finished. err: <nil>
Duration: 478.798449ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
624.408682ms trace:
https://jaeger.dev.storj.io/trace/6f03109d869521d
FAIL (2025-10-31 19:59:13 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
67.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956053430 (31h44m11.657645883s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956513382 (31h44m11.658105833s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957203079 (31h44m11.658795537s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957810763 (31h44m11.65940323s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.958490731 (31h44m11.660083188s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.959102151 (31h44m11.660694608s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960053970 (31h44m11.661646453s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960748416 (31h44m11.66234087s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.961426224 (31h44m11.663018685s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.962221532 (31h44m11.663813994s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:09.089405055 (31h44m11.790997516s) [upload=27918]: Next returned nil segment
Oct 31 19:25:09.089426932 (31h44m11.791019394s) [upload=27918]: Waiting for error group managing segments...
Oct 31 19:25:09.094025091 (31h44m11.795617543s) [noise=true , address=89.149.201.147:4008 , piece_id=S7N4S3EQEKJDZGX6R4AIJTJFJCH7KR4GIADESGIQJEPKC73BNW3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094079311 (31h44m11.795671763s) [noise=true , address=81.171.14.70:4040 , piece_id=Q4QVVAIAYAVEI5GFW6NECJONEGPKQUGLS5SJFZMSG3RTL53TUDDA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094800800 (31h44m11.796393252s) [noise=true , address=89.149.201.147:4023 , piece_id=XVYPIYOLHLXN6MF67SJ3MZGZFY6CULBZ6UZDHH6LNSJE4HBGDLQQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.098897378 (31h44m11.800489835s) [noise=true , address=185.167.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099395156 (31h44m11.800987608s) [noise=true , address=185.167.204.205:4022 , piece_id=4E2JGAHF23TWJWVYBLE56MGMTMRLWEH33RJYPEHQHAWK3J7CEVXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099863521 (31h44m11.801455977s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100294404 (31h44m11.801886858s) [noise=true , address=81.171.14.70:4028 , piece_id=ZIEOL6VSTZ4VTQT57WGM6WTX7QLUGYA72LOIPPFR6KTIVMJ7UYMA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100633412 (31h44m11.802225867s) [noise=true , address=185.167.204.206:4056 , piece_id=PJRD7FGPTEQYYUCT745F7ZI52SZUIFU5TFNEIKVJCN6TKS3TUEHA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.101434913 (31h44m11.803027366s) [noise=true , address=185.167.204.206:4058 , piece_id=MBRFSYBYMWH3SBBDW42YNWXYK37SYHFT2IOCKJS7BMFPMIBKHQFQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102148306 (31h44m11.80374076s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102516901 (31h44m11.804109353s) [noise=true , address=81.171.14.70:4027 , piece_id=ZZB75QQLI6JIPRALC3MJLK6LJ3X6GL3UDA24IGRV6UHUCO65GQBQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102894823 (31h44m11.804487275s) [noise=true , address=185.167.204.205:4006 , piece_id=K25XGQSKX3FDM2KHDNHTRWXNTLMCZDHIZBZSW7EHZSKDCXABFGCA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.106832421 (31h44m11.808424907s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.107129826 (31h44m11.808722281s) [noise=true , address=185.167.204.205:4021 , piece_id=SEBXV4JSZNQO7LOH3WSBXA2ECKFAI4S3VJRAVHTDPYKH3N62JAKA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.109066332 (31h44m11.810658789s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.112900829 (31h44m11.814493287s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.114375084 (31h44m11.815967584s) [noise=true , address=89.149.201.147:4020 , piece_id=LXTZSAAU3DIQMVSM2XCJSRJU535YFMU622XAYR2WMRHC6ZLNON4A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.117391042 (31h44m11.818983505s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.118935135 (31h44m11.820527591s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120275173 (31h44m11.821867629s) [noise=true , address=81.171.14.70:4026 , piece_id=MT5VEPQDGPEXUO3QT634PU2IQU47LM5ZRX4SJXVTPO2WBR5BL2CQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120987615 (31h44m11.822580075s) [noise=true , address=89.149.201.147:4012 , piece_id=3HKVP2MMAVJOJCNLMOTTDDSCPA4QMXIK4FJ24562LFUYTIR65A6A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.121669813 (31h44m11.823262255s) [noise=true , address=81.171.14.70:4046 , piece_id=PMQPN35FZBRAK7DDZHJBWR5BWB3VJRCCCZXUWATN6DG3XA72WGSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.122378445 (31h44m11.823970895s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.123052255 (31h44m11.824644705s) [noise=true , address=81.171.14.70:4029 , piece_id=XHWCZU2MD2YL6QW4O24T6F6UBZEIFWRL3YFYYZWQAO3LEUTUD4JA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126273483 (31h44m11.827865933s) [noise=true , address=89.149.201.147:4017 , piece_id=XV3VZFXYHIHHF4QLFVBJVW3RCEFAY7DJDYQ2B2LLK3V54LQMV77A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126589016 (31h44m11.828181478s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126653182 (31h44m11.828245644s) [seg_pos={0 0}, upload=27918]: Segment reached optimal threshold of 26 pieces.
Oct 31 19:25:09.127135459 (31h44m11.828727924s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127151429 (31h44m11.82874389s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127365200 (31h44m11.828957662s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127375134 (31h44m11.828967596s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127405694 (31h44m11.828998146s) [seg_pos={0 0}, upload=27918]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Oct 31 19:25:09.127517223 (31h44m11.829109692s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 31 19:25:09.127523946 (31h44m11.829116408s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 31 19:25:09.163266197 (31h44m11.864858653s) [upload=27918]: Done uploading segments...
Oct 31 19:25:09.163420243 (31h44m11.865012694s) [upload=27918]: Upload finished. err: <nil>
Duration: 624.437885ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
507.433636ms trace:
https://jaeger.dev.storj.io/trace/6f03109d869521d
FAIL (2025-10-31 19:58:24 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
67.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956053430 (31h44m11.657645883s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956513382 (31h44m11.658105833s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957203079 (31h44m11.658795537s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957810763 (31h44m11.65940323s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.958490731 (31h44m11.660083188s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.959102151 (31h44m11.660694608s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960053970 (31h44m11.661646453s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960748416 (31h44m11.66234087s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.961426224 (31h44m11.663018685s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.962221532 (31h44m11.663813994s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:09.089405055 (31h44m11.790997516s) [upload=27918]: Next returned nil segment
Oct 31 19:25:09.089426932 (31h44m11.791019394s) [upload=27918]: Waiting for error group managing segments...
Oct 31 19:25:09.094025091 (31h44m11.795617543s) [noise=true , address=89.149.201.147:4008 , piece_id=S7N4S3EQEKJDZGX6R4AIJTJFJCH7KR4GIADESGIQJEPKC73BNW3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094079311 (31h44m11.795671763s) [noise=true , address=81.171.14.70:4040 , piece_id=Q4QVVAIAYAVEI5GFW6NECJONEGPKQUGLS5SJFZMSG3RTL53TUDDA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094800800 (31h44m11.796393252s) [noise=true , address=89.149.201.147:4023 , piece_id=XVYPIYOLHLXN6MF67SJ3MZGZFY6CULBZ6UZDHH6LNSJE4HBGDLQQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.098897378 (31h44m11.800489835s) [noise=true , address=185.167.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099395156 (31h44m11.800987608s) [noise=true , address=185.167.204.205:4022 , piece_id=4E2JGAHF23TWJWVYBLE56MGMTMRLWEH33RJYPEHQHAWK3J7CEVXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099863521 (31h44m11.801455977s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100294404 (31h44m11.801886858s) [noise=true , address=81.171.14.70:4028 , piece_id=ZIEOL6VSTZ4VTQT57WGM6WTX7QLUGYA72LOIPPFR6KTIVMJ7UYMA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100633412 (31h44m11.802225867s) [noise=true , address=185.167.204.206:4056 , piece_id=PJRD7FGPTEQYYUCT745F7ZI52SZUIFU5TFNEIKVJCN6TKS3TUEHA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.101434913 (31h44m11.803027366s) [noise=true , address=185.167.204.206:4058 , piece_id=MBRFSYBYMWH3SBBDW42YNWXYK37SYHFT2IOCKJS7BMFPMIBKHQFQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102148306 (31h44m11.80374076s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102516901 (31h44m11.804109353s) [noise=true , address=81.171.14.70:4027 , piece_id=ZZB75QQLI6JIPRALC3MJLK6LJ3X6GL3UDA24IGRV6UHUCO65GQBQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102894823 (31h44m11.804487275s) [noise=true , address=185.167.204.205:4006 , piece_id=K25XGQSKX3FDM2KHDNHTRWXNTLMCZDHIZBZSW7EHZSKDCXABFGCA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.106832421 (31h44m11.808424907s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.107129826 (31h44m11.808722281s) [noise=true , address=185.167.204.205:4021 , piece_id=SEBXV4JSZNQO7LOH3WSBXA2ECKFAI4S3VJRAVHTDPYKH3N62JAKA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.109066332 (31h44m11.810658789s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.112900829 (31h44m11.814493287s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.114375084 (31h44m11.815967584s) [noise=true , address=89.149.201.147:4020 , piece_id=LXTZSAAU3DIQMVSM2XCJSRJU535YFMU622XAYR2WMRHC6ZLNON4A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.117391042 (31h44m11.818983505s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.118935135 (31h44m11.820527591s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120275173 (31h44m11.821867629s) [noise=true , address=81.171.14.70:4026 , piece_id=MT5VEPQDGPEXUO3QT634PU2IQU47LM5ZRX4SJXVTPO2WBR5BL2CQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120987615 (31h44m11.822580075s) [noise=true , address=89.149.201.147:4012 , piece_id=3HKVP2MMAVJOJCNLMOTTDDSCPA4QMXIK4FJ24562LFUYTIR65A6A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.121669813 (31h44m11.823262255s) [noise=true , address=81.171.14.70:4046 , piece_id=PMQPN35FZBRAK7DDZHJBWR5BWB3VJRCCCZXUWATN6DG3XA72WGSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.122378445 (31h44m11.823970895s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.123052255 (31h44m11.824644705s) [noise=true , address=81.171.14.70:4029 , piece_id=XHWCZU2MD2YL6QW4O24T6F6UBZEIFWRL3YFYYZWQAO3LEUTUD4JA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126273483 (31h44m11.827865933s) [noise=true , address=89.149.201.147:4017 , piece_id=XV3VZFXYHIHHF4QLFVBJVW3RCEFAY7DJDYQ2B2LLK3V54LQMV77A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126589016 (31h44m11.828181478s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126653182 (31h44m11.828245644s) [seg_pos={0 0}, upload=27918]: Segment reached optimal threshold of 26 pieces.
Oct 31 19:25:09.127135459 (31h44m11.828727924s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127151429 (31h44m11.82874389s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127365200 (31h44m11.828957662s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127375134 (31h44m11.828967596s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127405694 (31h44m11.828998146s) [seg_pos={0 0}, upload=27918]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Oct 31 19:25:09.127517223 (31h44m11.829109692s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 31 19:25:09.127523946 (31h44m11.829116408s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 31 19:25:09.163266197 (31h44m11.864858653s) [upload=27918]: Done uploading segments...
Oct 31 19:25:09.163420243 (31h44m11.865012694s) [upload=27918]: Upload finished. err: <nil>
Duration: 507.46247ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
492.621414ms trace:
https://jaeger.dev.storj.io/trace/6f03109d869521d
FAIL (2025-10-31 19:57:33 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
67.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956053430 (31h44m11.657645883s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956513382 (31h44m11.658105833s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957203079 (31h44m11.658795537s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957810763 (31h44m11.65940323s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.958490731 (31h44m11.660083188s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.959102151 (31h44m11.660694608s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960053970 (31h44m11.661646453s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960748416 (31h44m11.66234087s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.961426224 (31h44m11.663018685s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.962221532 (31h44m11.663813994s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:09.089405055 (31h44m11.790997516s) [upload=27918]: Next returned nil segment
Oct 31 19:25:09.089426932 (31h44m11.791019394s) [upload=27918]: Waiting for error group managing segments...
Oct 31 19:25:09.094025091 (31h44m11.795617543s) [noise=true , address=89.149.201.147:4008 , piece_id=S7N4S3EQEKJDZGX6R4AIJTJFJCH7KR4GIADESGIQJEPKC73BNW3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094079311 (31h44m11.795671763s) [noise=true , address=81.171.14.70:4040 , piece_id=Q4QVVAIAYAVEI5GFW6NECJONEGPKQUGLS5SJFZMSG3RTL53TUDDA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094800800 (31h44m11.796393252s) [noise=true , address=89.149.201.147:4023 , piece_id=XVYPIYOLHLXN6MF67SJ3MZGZFY6CULBZ6UZDHH6LNSJE4HBGDLQQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.098897378 (31h44m11.800489835s) [noise=true , address=185.167.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099395156 (31h44m11.800987608s) [noise=true , address=185.167.204.205:4022 , piece_id=4E2JGAHF23TWJWVYBLE56MGMTMRLWEH33RJYPEHQHAWK3J7CEVXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099863521 (31h44m11.801455977s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100294404 (31h44m11.801886858s) [noise=true , address=81.171.14.70:4028 , piece_id=ZIEOL6VSTZ4VTQT57WGM6WTX7QLUGYA72LOIPPFR6KTIVMJ7UYMA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100633412 (31h44m11.802225867s) [noise=true , address=185.167.204.206:4056 , piece_id=PJRD7FGPTEQYYUCT745F7ZI52SZUIFU5TFNEIKVJCN6TKS3TUEHA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.101434913 (31h44m11.803027366s) [noise=true , address=185.167.204.206:4058 , piece_id=MBRFSYBYMWH3SBBDW42YNWXYK37SYHFT2IOCKJS7BMFPMIBKHQFQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102148306 (31h44m11.80374076s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102516901 (31h44m11.804109353s) [noise=true , address=81.171.14.70:4027 , piece_id=ZZB75QQLI6JIPRALC3MJLK6LJ3X6GL3UDA24IGRV6UHUCO65GQBQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102894823 (31h44m11.804487275s) [noise=true , address=185.167.204.205:4006 , piece_id=K25XGQSKX3FDM2KHDNHTRWXNTLMCZDHIZBZSW7EHZSKDCXABFGCA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.106832421 (31h44m11.808424907s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.107129826 (31h44m11.808722281s) [noise=true , address=185.167.204.205:4021 , piece_id=SEBXV4JSZNQO7LOH3WSBXA2ECKFAI4S3VJRAVHTDPYKH3N62JAKA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.109066332 (31h44m11.810658789s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.112900829 (31h44m11.814493287s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.114375084 (31h44m11.815967584s) [noise=true , address=89.149.201.147:4020 , piece_id=LXTZSAAU3DIQMVSM2XCJSRJU535YFMU622XAYR2WMRHC6ZLNON4A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.117391042 (31h44m11.818983505s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.118935135 (31h44m11.820527591s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120275173 (31h44m11.821867629s) [noise=true , address=81.171.14.70:4026 , piece_id=MT5VEPQDGPEXUO3QT634PU2IQU47LM5ZRX4SJXVTPO2WBR5BL2CQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120987615 (31h44m11.822580075s) [noise=true , address=89.149.201.147:4012 , piece_id=3HKVP2MMAVJOJCNLMOTTDDSCPA4QMXIK4FJ24562LFUYTIR65A6A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.121669813 (31h44m11.823262255s) [noise=true , address=81.171.14.70:4046 , piece_id=PMQPN35FZBRAK7DDZHJBWR5BWB3VJRCCCZXUWATN6DG3XA72WGSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.122378445 (31h44m11.823970895s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.123052255 (31h44m11.824644705s) [noise=true , address=81.171.14.70:4029 , piece_id=XHWCZU2MD2YL6QW4O24T6F6UBZEIFWRL3YFYYZWQAO3LEUTUD4JA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126273483 (31h44m11.827865933s) [noise=true , address=89.149.201.147:4017 , piece_id=XV3VZFXYHIHHF4QLFVBJVW3RCEFAY7DJDYQ2B2LLK3V54LQMV77A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126589016 (31h44m11.828181478s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126653182 (31h44m11.828245644s) [seg_pos={0 0}, upload=27918]: Segment reached optimal threshold of 26 pieces.
Oct 31 19:25:09.127135459 (31h44m11.828727924s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127151429 (31h44m11.82874389s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127365200 (31h44m11.828957662s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127375134 (31h44m11.828967596s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127405694 (31h44m11.828998146s) [seg_pos={0 0}, upload=27918]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Oct 31 19:25:09.127517223 (31h44m11.829109692s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 31 19:25:09.127523946 (31h44m11.829116408s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 31 19:25:09.163266197 (31h44m11.864858653s) [upload=27918]: Done uploading segments...
Oct 31 19:25:09.163420243 (31h44m11.865012694s) [upload=27918]: Upload finished. err: <nil>
Duration: 492.651458ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
495.160932ms trace:
https://jaeger.dev.storj.io/trace/6f03109d869521d
FAIL (2025-10-31 19:56:53 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
67.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956053430 (31h44m11.657645883s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956513382 (31h44m11.658105833s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957203079 (31h44m11.658795537s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957810763 (31h44m11.65940323s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.958490731 (31h44m11.660083188s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.959102151 (31h44m11.660694608s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960053970 (31h44m11.661646453s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960748416 (31h44m11.66234087s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.961426224 (31h44m11.663018685s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.962221532 (31h44m11.663813994s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:09.089405055 (31h44m11.790997516s) [upload=27918]: Next returned nil segment
Oct 31 19:25:09.089426932 (31h44m11.791019394s) [upload=27918]: Waiting for error group managing segments...
Oct 31 19:25:09.094025091 (31h44m11.795617543s) [noise=true , address=89.149.201.147:4008 , piece_id=S7N4S3EQEKJDZGX6R4AIJTJFJCH7KR4GIADESGIQJEPKC73BNW3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094079311 (31h44m11.795671763s) [noise=true , address=81.171.14.70:4040 , piece_id=Q4QVVAIAYAVEI5GFW6NECJONEGPKQUGLS5SJFZMSG3RTL53TUDDA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094800800 (31h44m11.796393252s) [noise=true , address=89.149.201.147:4023 , piece_id=XVYPIYOLHLXN6MF67SJ3MZGZFY6CULBZ6UZDHH6LNSJE4HBGDLQQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.098897378 (31h44m11.800489835s) [noise=true , address=185.167.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099395156 (31h44m11.800987608s) [noise=true , address=185.167.204.205:4022 , piece_id=4E2JGAHF23TWJWVYBLE56MGMTMRLWEH33RJYPEHQHAWK3J7CEVXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099863521 (31h44m11.801455977s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100294404 (31h44m11.801886858s) [noise=true , address=81.171.14.70:4028 , piece_id=ZIEOL6VSTZ4VTQT57WGM6WTX7QLUGYA72LOIPPFR6KTIVMJ7UYMA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100633412 (31h44m11.802225867s) [noise=true , address=185.167.204.206:4056 , piece_id=PJRD7FGPTEQYYUCT745F7ZI52SZUIFU5TFNEIKVJCN6TKS3TUEHA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.101434913 (31h44m11.803027366s) [noise=true , address=185.167.204.206:4058 , piece_id=MBRFSYBYMWH3SBBDW42YNWXYK37SYHFT2IOCKJS7BMFPMIBKHQFQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102148306 (31h44m11.80374076s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102516901 (31h44m11.804109353s) [noise=true , address=81.171.14.70:4027 , piece_id=ZZB75QQLI6JIPRALC3MJLK6LJ3X6GL3UDA24IGRV6UHUCO65GQBQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102894823 (31h44m11.804487275s) [noise=true , address=185.167.204.205:4006 , piece_id=K25XGQSKX3FDM2KHDNHTRWXNTLMCZDHIZBZSW7EHZSKDCXABFGCA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.106832421 (31h44m11.808424907s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.107129826 (31h44m11.808722281s) [noise=true , address=185.167.204.205:4021 , piece_id=SEBXV4JSZNQO7LOH3WSBXA2ECKFAI4S3VJRAVHTDPYKH3N62JAKA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.109066332 (31h44m11.810658789s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.112900829 (31h44m11.814493287s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.114375084 (31h44m11.815967584s) [noise=true , address=89.149.201.147:4020 , piece_id=LXTZSAAU3DIQMVSM2XCJSRJU535YFMU622XAYR2WMRHC6ZLNON4A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.117391042 (31h44m11.818983505s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.118935135 (31h44m11.820527591s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120275173 (31h44m11.821867629s) [noise=true , address=81.171.14.70:4026 , piece_id=MT5VEPQDGPEXUO3QT634PU2IQU47LM5ZRX4SJXVTPO2WBR5BL2CQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120987615 (31h44m11.822580075s) [noise=true , address=89.149.201.147:4012 , piece_id=3HKVP2MMAVJOJCNLMOTTDDSCPA4QMXIK4FJ24562LFUYTIR65A6A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.121669813 (31h44m11.823262255s) [noise=true , address=81.171.14.70:4046 , piece_id=PMQPN35FZBRAK7DDZHJBWR5BWB3VJRCCCZXUWATN6DG3XA72WGSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.122378445 (31h44m11.823970895s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.123052255 (31h44m11.824644705s) [noise=true , address=81.171.14.70:4029 , piece_id=XHWCZU2MD2YL6QW4O24T6F6UBZEIFWRL3YFYYZWQAO3LEUTUD4JA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126273483 (31h44m11.827865933s) [noise=true , address=89.149.201.147:4017 , piece_id=XV3VZFXYHIHHF4QLFVBJVW3RCEFAY7DJDYQ2B2LLK3V54LQMV77A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126589016 (31h44m11.828181478s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126653182 (31h44m11.828245644s) [seg_pos={0 0}, upload=27918]: Segment reached optimal threshold of 26 pieces.
Oct 31 19:25:09.127135459 (31h44m11.828727924s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127151429 (31h44m11.82874389s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127365200 (31h44m11.828957662s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127375134 (31h44m11.828967596s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127405694 (31h44m11.828998146s) [seg_pos={0 0}, upload=27918]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Oct 31 19:25:09.127517223 (31h44m11.829109692s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 31 19:25:09.127523946 (31h44m11.829116408s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 31 19:25:09.163266197 (31h44m11.864858653s) [upload=27918]: Done uploading segments...
Oct 31 19:25:09.163420243 (31h44m11.865012694s) [upload=27918]: Upload finished. err: <nil>
Duration: 495.18686ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
876.841518ms trace:
https://jaeger.dev.storj.io/trace/6f03109d869521d
FAIL (2025-10-31 19:56:05 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
67.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956053430 (31h44m11.657645883s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956513382 (31h44m11.658105833s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957203079 (31h44m11.658795537s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957810763 (31h44m11.65940323s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.958490731 (31h44m11.660083188s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.959102151 (31h44m11.660694608s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960053970 (31h44m11.661646453s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960748416 (31h44m11.66234087s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.961426224 (31h44m11.663018685s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.962221532 (31h44m11.663813994s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:09.089405055 (31h44m11.790997516s) [upload=27918]: Next returned nil segment
Oct 31 19:25:09.089426932 (31h44m11.791019394s) [upload=27918]: Waiting for error group managing segments...
Oct 31 19:25:09.094025091 (31h44m11.795617543s) [noise=true , address=89.149.201.147:4008 , piece_id=S7N4S3EQEKJDZGX6R4AIJTJFJCH7KR4GIADESGIQJEPKC73BNW3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094079311 (31h44m11.795671763s) [noise=true , address=81.171.14.70:4040 , piece_id=Q4QVVAIAYAVEI5GFW6NECJONEGPKQUGLS5SJFZMSG3RTL53TUDDA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094800800 (31h44m11.796393252s) [noise=true , address=89.149.201.147:4023 , piece_id=XVYPIYOLHLXN6MF67SJ3MZGZFY6CULBZ6UZDHH6LNSJE4HBGDLQQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.098897378 (31h44m11.800489835s) [noise=true , address=185.167.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099395156 (31h44m11.800987608s) [noise=true , address=185.167.204.205:4022 , piece_id=4E2JGAHF23TWJWVYBLE56MGMTMRLWEH33RJYPEHQHAWK3J7CEVXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099863521 (31h44m11.801455977s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100294404 (31h44m11.801886858s) [noise=true , address=81.171.14.70:4028 , piece_id=ZIEOL6VSTZ4VTQT57WGM6WTX7QLUGYA72LOIPPFR6KTIVMJ7UYMA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100633412 (31h44m11.802225867s) [noise=true , address=185.167.204.206:4056 , piece_id=PJRD7FGPTEQYYUCT745F7ZI52SZUIFU5TFNEIKVJCN6TKS3TUEHA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.101434913 (31h44m11.803027366s) [noise=true , address=185.167.204.206:4058 , piece_id=MBRFSYBYMWH3SBBDW42YNWXYK37SYHFT2IOCKJS7BMFPMIBKHQFQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102148306 (31h44m11.80374076s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102516901 (31h44m11.804109353s) [noise=true , address=81.171.14.70:4027 , piece_id=ZZB75QQLI6JIPRALC3MJLK6LJ3X6GL3UDA24IGRV6UHUCO65GQBQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102894823 (31h44m11.804487275s) [noise=true , address=185.167.204.205:4006 , piece_id=K25XGQSKX3FDM2KHDNHTRWXNTLMCZDHIZBZSW7EHZSKDCXABFGCA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.106832421 (31h44m11.808424907s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.107129826 (31h44m11.808722281s) [noise=true , address=185.167.204.205:4021 , piece_id=SEBXV4JSZNQO7LOH3WSBXA2ECKFAI4S3VJRAVHTDPYKH3N62JAKA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.109066332 (31h44m11.810658789s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.112900829 (31h44m11.814493287s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.114375084 (31h44m11.815967584s) [noise=true , address=89.149.201.147:4020 , piece_id=LXTZSAAU3DIQMVSM2XCJSRJU535YFMU622XAYR2WMRHC6ZLNON4A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.117391042 (31h44m11.818983505s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.118935135 (31h44m11.820527591s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120275173 (31h44m11.821867629s) [noise=true , address=81.171.14.70:4026 , piece_id=MT5VEPQDGPEXUO3QT634PU2IQU47LM5ZRX4SJXVTPO2WBR5BL2CQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120987615 (31h44m11.822580075s) [noise=true , address=89.149.201.147:4012 , piece_id=3HKVP2MMAVJOJCNLMOTTDDSCPA4QMXIK4FJ24562LFUYTIR65A6A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.121669813 (31h44m11.823262255s) [noise=true , address=81.171.14.70:4046 , piece_id=PMQPN35FZBRAK7DDZHJBWR5BWB3VJRCCCZXUWATN6DG3XA72WGSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.122378445 (31h44m11.823970895s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.123052255 (31h44m11.824644705s) [noise=true , address=81.171.14.70:4029 , piece_id=XHWCZU2MD2YL6QW4O24T6F6UBZEIFWRL3YFYYZWQAO3LEUTUD4JA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126273483 (31h44m11.827865933s) [noise=true , address=89.149.201.147:4017 , piece_id=XV3VZFXYHIHHF4QLFVBJVW3RCEFAY7DJDYQ2B2LLK3V54LQMV77A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126589016 (31h44m11.828181478s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126653182 (31h44m11.828245644s) [seg_pos={0 0}, upload=27918]: Segment reached optimal threshold of 26 pieces.
Oct 31 19:25:09.127135459 (31h44m11.828727924s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127151429 (31h44m11.82874389s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127365200 (31h44m11.828957662s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127375134 (31h44m11.828967596s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127405694 (31h44m11.828998146s) [seg_pos={0 0}, upload=27918]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Oct 31 19:25:09.127517223 (31h44m11.829109692s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 31 19:25:09.127523946 (31h44m11.829116408s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 31 19:25:09.163266197 (31h44m11.864858653s) [upload=27918]: Done uploading segments...
Oct 31 19:25:09.163420243 (31h44m11.865012694s) [upload=27918]: Upload finished. err: <nil>
Duration: 876.935658ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
528.924914ms trace:
https://jaeger.dev.storj.io/trace/6f03109d869521d
FAIL (2025-10-31 19:55:11 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
67.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956053430 (31h44m11.657645883s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.956513382 (31h44m11.658105833s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957203079 (31h44m11.658795537s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.957810763 (31h44m11.65940323s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.958490731 (31h44m11.660083188s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.959102151 (31h44m11.660694608s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960053970 (31h44m11.661646453s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.960748416 (31h44m11.66234087s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.961426224 (31h44m11.663018685s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:08.962221532 (31h44m11.663813994s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Uploading piece...
Oct 31 19:25:09.089405055 (31h44m11.790997516s) [upload=27918]: Next returned nil segment
Oct 31 19:25:09.089426932 (31h44m11.791019394s) [upload=27918]: Waiting for error group managing segments...
Oct 31 19:25:09.094025091 (31h44m11.795617543s) [noise=true , address=89.149.201.147:4008 , piece_id=S7N4S3EQEKJDZGX6R4AIJTJFJCH7KR4GIADESGIQJEPKC73BNW3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094079311 (31h44m11.795671763s) [noise=true , address=81.171.14.70:4040 , piece_id=Q4QVVAIAYAVEI5GFW6NECJONEGPKQUGLS5SJFZMSG3RTL53TUDDA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.094800800 (31h44m11.796393252s) [noise=true , address=89.149.201.147:4023 , piece_id=XVYPIYOLHLXN6MF67SJ3MZGZFY6CULBZ6UZDHH6LNSJE4HBGDLQQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.098897378 (31h44m11.800489835s) [noise=true , address=185.167.204.205:4024 , piece_id=MYBXNEJNPW5R2WCZJWYVEUBCLRSSXXNBJWNMOWATL3YYWZF742XQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099395156 (31h44m11.800987608s) [noise=true , address=185.167.204.205:4022 , piece_id=4E2JGAHF23TWJWVYBLE56MGMTMRLWEH33RJYPEHQHAWK3J7CEVXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.099863521 (31h44m11.801455977s) [noise=true , address=185.167.204.206:4067 , piece_id=QUYEKUSPGTKCRIHFXUCY4X3L6SAODNN6BADXL2EXWFY66Z5AX7PA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100294404 (31h44m11.801886858s) [noise=true , address=81.171.14.70:4028 , piece_id=ZIEOL6VSTZ4VTQT57WGM6WTX7QLUGYA72LOIPPFR6KTIVMJ7UYMA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.100633412 (31h44m11.802225867s) [noise=true , address=185.167.204.206:4056 , piece_id=PJRD7FGPTEQYYUCT745F7ZI52SZUIFU5TFNEIKVJCN6TKS3TUEHA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.101434913 (31h44m11.803027366s) [noise=true , address=185.167.204.206:4058 , piece_id=MBRFSYBYMWH3SBBDW42YNWXYK37SYHFT2IOCKJS7BMFPMIBKHQFQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102148306 (31h44m11.80374076s) [noise=true , address=81.171.14.70:4032 , piece_id=ESLRC2JVPYSPZQVBYCFVVLRYJZVPTVM5GJJQXACR2CWWHMNA5B5A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102516901 (31h44m11.804109353s) [noise=true , address=81.171.14.70:4027 , piece_id=ZZB75QQLI6JIPRALC3MJLK6LJ3X6GL3UDA24IGRV6UHUCO65GQBQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.102894823 (31h44m11.804487275s) [noise=true , address=185.167.204.205:4006 , piece_id=K25XGQSKX3FDM2KHDNHTRWXNTLMCZDHIZBZSW7EHZSKDCXABFGCA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.106832421 (31h44m11.808424907s) [noise=true , address=185.167.204.206:4047 , piece_id=5QFDMPGTEVZNDII23JQ33TY6SOCJO5ZHRE7TWQWV5G22DZNLDZUQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.107129826 (31h44m11.808722281s) [noise=true , address=185.167.204.205:4021 , piece_id=SEBXV4JSZNQO7LOH3WSBXA2ECKFAI4S3VJRAVHTDPYKH3N62JAKA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.109066332 (31h44m11.810658789s) [noise=true , address=81.171.14.70:4047 , piece_id=LO3PBEFIPOWIRLUTA2X5HNGDFUEVS7NKDVNWH2CSJGHZBDNZYX7A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.112900829 (31h44m11.814493287s) [noise=true , address=185.167.204.206:4057 , piece_id=BAJK6JMS3TDIMHOT6NF2PBIFYHJC34M3VU4E2EJ6G4XJGUGU6OTA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.114375084 (31h44m11.815967584s) [noise=true , address=89.149.201.147:4020 , piece_id=LXTZSAAU3DIQMVSM2XCJSRJU535YFMU622XAYR2WMRHC6ZLNON4A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.117391042 (31h44m11.818983505s) [noise=true , address=81.171.14.70:4043 , piece_id=E7H7DCWJ4GRRXNVGEJOY55QKZKGFE3CXDSBGO2FMPXEPMBY6AWSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.118935135 (31h44m11.820527591s) [noise=true , address=89.149.201.147:4007 , piece_id=47PWRIA24G4AGRTKTPLQ6PLCLZJQFVZJ4HRSATC3YHVWTJADMB3A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120275173 (31h44m11.821867629s) [noise=true , address=81.171.14.70:4026 , piece_id=MT5VEPQDGPEXUO3QT634PU2IQU47LM5ZRX4SJXVTPO2WBR5BL2CQ, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.120987615 (31h44m11.822580075s) [noise=true , address=89.149.201.147:4012 , piece_id=3HKVP2MMAVJOJCNLMOTTDDSCPA4QMXIK4FJ24562LFUYTIR65A6A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.121669813 (31h44m11.823262255s) [noise=true , address=81.171.14.70:4046 , piece_id=PMQPN35FZBRAK7DDZHJBWR5BWB3VJRCCCZXUWATN6DG3XA72WGSA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.122378445 (31h44m11.823970895s) [noise=true , address=185.167.204.206:4050 , piece_id=5OKBYIXVWQWKXQXCQYFY74BA7FI3Z46QOTSJRZOERC63A3NNOHXA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.123052255 (31h44m11.824644705s) [noise=true , address=81.171.14.70:4029 , piece_id=XHWCZU2MD2YL6QW4O24T6F6UBZEIFWRL3YFYYZWQAO3LEUTUD4JA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126273483 (31h44m11.827865933s) [noise=true , address=89.149.201.147:4017 , piece_id=XV3VZFXYHIHHF4QLFVBJVW3RCEFAY7DJDYQ2B2LLK3V54LQMV77A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126589016 (31h44m11.828181478s) [noise=true , address=89.149.201.147:4003 , piece_id=IVZNQRKCAT4G7KPBSFURS6H43VSGOTPMSYEAQ42YX5QVLH7TBMUA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: <nil>
Oct 31 19:25:09.126653182 (31h44m11.828245644s) [seg_pos={0 0}, upload=27918]: Segment reached optimal threshold of 26 pieces.
Oct 31 19:25:09.127135459 (31h44m11.828727924s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127151429 (31h44m11.82874389s) [noise=true , address=89.149.201.147:4021 , piece_id=NQ3UH23HT5V34KM5RNMMYVJCMQNESWNI5W2T2COR26U3DJVP64GA, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127365200 (31h44m11.828957662s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF
Oct 31 19:25:09.127375134 (31h44m11.828967596s) [noise=true , address=89.149.201.147:4002 , piece_id=RQXIWZCSEJIH4CS6NAUHNQ6MC2TMGJFE4RB5EZIREZDRA4Q7R54A, seg_pos={0 0}, upload=27918]: Long tail cancellation due to optimal threshold
Oct 31 19:25:09.127405694 (31h44m11.828998146s) [seg_pos={0 0}, upload=27918]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Oct 31 19:25:09.127517223 (31h44m11.829109692s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 31 19:25:09.127523946 (31h44m11.829116408s) [upload=27918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 31 19:25:09.163266197 (31h44m11.864858653s) [upload=27918]: Done uploading segments...
Oct 31 19:25:09.163420243 (31h44m11.865012694s) [upload=27918]: Upload finished. err: <nil>
Duration: 528.957064ms
core
uplink
eu-select-1
eu1-placement-15
|