Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 1.064918654s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:59:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.065006916s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 1.081344111s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:58:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.081364136s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 1.066956107s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:58:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.067005132s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 1.053470547s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:58:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.053498139s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 1.057581236s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:57:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.057631529s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 1.090636372s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:55:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.090677504s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 1.066966451s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:54:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.066988373s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 1.13722597s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:54:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.13725465s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 1.063564261s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:53:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.063636753s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 1.018638059s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:52:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.018662872s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 1.076922244s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:51:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.076944637s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 998.562279ms trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:50:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 998.623877ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 1.016979302s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:49:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.017004813s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 1.132584838s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:48:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.132611272s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 1.060261133s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:47:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.060293949s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 1.053842159s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:47:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.053868768s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 1.032929821s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:46:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.033017114s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 991.045337ms trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:45:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 991.149676ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 1.031774846s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:44:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.031833041s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 1.043369899s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:44:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.043424364s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 1.052659554s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:43:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.052688802s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 1.017702395s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:42:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.017797312s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 1.020175654s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:41:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.020201642s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 1.046703817s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:40:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.046766319s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 1.06366222s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:39:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.063688182s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 1.039860855s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:38:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.039892381s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 1.04483905s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:37:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.044867133s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 1.004611875s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:36:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.004641879s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 1.097335012s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:36:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.09737465s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 1.062518491s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:35:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.062543548s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 1.086141603s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:35:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.086168562s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 1.087526405s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:34:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.087548813s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 1.029329885s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:34:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.029352007s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 1.063011178s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:33:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.063040766s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 1.035389504s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:32:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.035421648s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 1.095289154s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:32:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.095319633s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 1.062278826s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:31:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.06232264s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 1.05881308s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:31:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.059017355s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 1.013193904s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:30:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.013221167s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 998.831948ms trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:29:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 998.86063ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 1.141131281s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:29:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.14115228s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 1.021755787s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:29:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.021770845s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001519639s trace: https://jaeger.dev.storj.io/trace/77936a980b205250 FAIL (2025-11-11 15:29:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001543976s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.383182062s trace: https://jaeger.dev.storj.io/trace/2af447c1cc32e3fe FAIL (2025-11-11 10:38:24 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Nov 11 09:56:38.891694755 (12m24.250353408s) [upload=174]: Starting upload Nov 11 09:56:38.891756957 (12m24.250415616s) [upload=174]: Done starting upload Nov 11 09:56:38.891883474 (12m24.250542118s) [upload=174]: Uploading segments... Nov 11 09:56:38.892161824 (12m24.250820469s) [upload=174]: Got next segment. Inline: false Nov 11 09:56:38.892646331 (12m24.251304991s) [upload=174]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 11 09:56:38.892657501 (12m24.251316155s) [upload=174]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 11 09:56:39.005052720 (12m24.363711398s) [seg_pos={0 0}, upload=174]: Begin upload segment... Nov 11 09:56:39.005125494 (12m24.363784134s) [seg_pos={0 0}, upload=174]: Done begin upload segment. Nov 11 09:56:39.005216129 (12m24.363874823s) [noise=true , address=145.79.227.13:4804 , piece_id=4YRWKCCB2UUB3TETJTW3DQLQACW33F3YIOOL4QCUHXCW4RFKRHHQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.005230740 (12m24.363889419s) [noise=true , address=145.79.227.25:4619 , piece_id=FRKZ7ISY3ZD5TDIUXGFD6SUKNP6NQH6W2DP7ABT6AYWSCZGJUN7Q, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.005999056 (12m24.364657738s) [noise=true , address=145.79.227.32:4836 , piece_id=W5TK45TG3EV6AZTZN2UA5QHLQK6IXA46LVD2K5L6M6OXWQPRFN5Q, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.006601206 (12m24.365259871s) [noise=true , address=77.90.31.10:4519 , piece_id=U7FQQL65MZHQTWUOY5SKFL4VKT4QAFDVZ44EUOBKMNOLAADSSIPA, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.007145644 (12m24.365804308s) [noise=true , address=77.90.31.17:4771 , piece_id=QEH6D7XZFBLANBZTAENBVN4LT6FPGTF6QC4XZ7T3BFD3BHIWQEOQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.007818316 (12m24.366476979s) [noise=true , address=145.79.227.27:4689 , piece_id=GF3HUNJX2JNDFNJMU643UNYV2NT7NRPRQ2CQNR3I6RZ2RLYCASJA, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.008466282 (12m24.367124946s) [noise=true , address=145.79.227.9:4366 , piece_id=C4CZIP32EQME6H2GUZNJXQK4NM5GNOG7LIIGOKLOWWAQ2BKVHTVQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.009115289 (12m24.367773953s) [noise=true , address=145.79.227.6:4258 , piece_id=ALGZJPRFE5ZKYDHSNSYWM437BF5SBGAQLV57FCSGFNRPDIO2XFTQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.011091547 (12m24.36975021s) [noise=true , address=145.79.227.28:4726 , piece_id=VQJAIUUVCF5UQTQI2I3S4JZWAABTNLRHHHVZ3YE6EZTTIZBCZ57A, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.011726540 (12m24.370385204s) [noise=true , address=145.79.227.11:4732 , piece_id=EAJQZUVBQDPB456TYONLDGEXU2T72DZIBCQQ3JX5BGHUTDGQD2IA, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.013122380 (12m24.371781047s) [noise=true , address=145.79.227.20:4438 , piece_id=RRWIZE2Y2XM3BX4KU5FH2HQYCJL3HAPBTJXBBCCD2FUQT5DHVKPQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.015282432 (12m24.373941079s) [noise=true , address=45.91.116.6:4975 , piece_id=Z26AFA2WT4PQXOHPXC2LTHD6HGQW7KGNVFXYKAMLHCPIKVCQ7CWQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.016746279 (12m24.375404942s) [noise=true , address=45.91.116.9:4263 , piece_id=HQKC6IELCZFPVCWI36TR63KYHI3Y35BLU3SMVWCR37ETJWZBAA3A, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.019161006 (12m24.37781977s) [noise=true , address=145.79.227.22:4511 , piece_id=KI5VRUSEKKHQ2HPTZW3MSOZZSSVITYTG4GPUZMLFJ4ZXI7UOC4CQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.020917020 (12m24.379575685s) [noise=true , address=145.79.227.18:4006 , piece_id=ENXJAZBBU6PGPX56NFZQRLUGWKQ5CNP3LUMXIAMFKN5LBA3JO5PQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.023350963 (12m24.382009629s) [noise=true , address=145.79.227.21:4473 , piece_id=6JE3OOHCMUJ3HSR5BORCDCOXI7SFMIVKSMYOS3OLANHP6NIM6BVQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.635609835 (12m24.994268492s) [upload=174]: Next returned nil segment Nov 11 09:56:39.635628781 (12m24.99428746s) [upload=174]: Waiting for error group managing segments... Nov 11 09:56:39.759546252 (12m25.118204907s) [noise=true , address=145.79.227.6:4258 , piece_id=ALGZJPRFE5ZKYDHSNSYWM437BF5SBGAQLV57FCSGFNRPDIO2XFTQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.760153701 (12m25.118812356s) [noise=true , address=77.90.31.10:4519 , piece_id=U7FQQL65MZHQTWUOY5SKFL4VKT4QAFDVZ44EUOBKMNOLAADSSIPA, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.760787126 (12m25.119445795s) [noise=true , address=145.79.227.13:4804 , piece_id=4YRWKCCB2UUB3TETJTW3DQLQACW33F3YIOOL4QCUHXCW4RFKRHHQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.761593519 (12m25.120252172s) [noise=true , address=145.79.227.27:4689 , piece_id=GF3HUNJX2JNDFNJMU643UNYV2NT7NRPRQ2CQNR3I6RZ2RLYCASJA, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.762295832 (12m25.120954498s) [noise=true , address=145.79.227.11:4732 , piece_id=EAJQZUVBQDPB456TYONLDGEXU2T72DZIBCQQ3JX5BGHUTDGQD2IA, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.766441496 (12m25.12510015s) [noise=true , address=145.79.227.28:4726 , piece_id=VQJAIUUVCF5UQTQI2I3S4JZWAABTNLRHHHVZ3YE6EZTTIZBCZ57A, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.766631748 (12m25.125290412s) [noise=true , address=145.79.227.32:4836 , piece_id=W5TK45TG3EV6AZTZN2UA5QHLQK6IXA46LVD2K5L6M6OXWQPRFN5Q, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.767329514 (12m25.125988177s) [noise=true , address=77.90.31.17:4771 , piece_id=QEH6D7XZFBLANBZTAENBVN4LT6FPGTF6QC4XZ7T3BFD3BHIWQEOQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.767886254 (12m25.126544908s) [noise=true , address=145.79.227.9:4366 , piece_id=C4CZIP32EQME6H2GUZNJXQK4NM5GNOG7LIIGOKLOWWAQ2BKVHTVQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.768539301 (12m25.12719796s) [noise=true , address=145.79.227.25:4619 , piece_id=FRKZ7ISY3ZD5TDIUXGFD6SUKNP6NQH6W2DP7ABT6AYWSCZGJUN7Q, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.787492893 (12m25.146151557s) [noise=true , address=45.91.116.6:4975 , piece_id=Z26AFA2WT4PQXOHPXC2LTHD6HGQW7KGNVFXYKAMLHCPIKVCQ7CWQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.789897656 (12m25.148556321s) [noise=true , address=145.79.227.21:4473 , piece_id=6JE3OOHCMUJ3HSR5BORCDCOXI7SFMIVKSMYOS3OLANHP6NIM6BVQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.791424933 (12m25.150083592s) [noise=true , address=145.79.227.18:4006 , piece_id=ENXJAZBBU6PGPX56NFZQRLUGWKQ5CNP3LUMXIAMFKN5LBA3JO5PQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.791445282 (12m25.150103946s) [seg_pos={0 0}, upload=174]: Segment reached optimal threshold of 13 pieces. Nov 11 09:56:39.791713518 (12m25.150372181s) [noise=true , address=145.79.227.20:4438 , piece_id=RRWIZE2Y2XM3BX4KU5FH2HQYCJL3HAPBTJXBBCCD2FUQT5DHVKPQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT): protocol: expected piece hash; context canceled; EOF Nov 11 09:56:39.791725086 (12m25.150383768s) [noise=true , address=145.79.227.20:4438 , piece_id=RRWIZE2Y2XM3BX4KU5FH2HQYCJL3HAPBTJXBBCCD2FUQT5DHVKPQ, seg_pos={0 0}, upload=174]: Long tail cancellation due to optimal threshold Nov 11 09:56:39.791778521 (12m25.150437247s) [noise=true , address=45.91.116.9:4263 , piece_id=HQKC6IELCZFPVCWI36TR63KYHI3Y35BLU3SMVWCR37ETJWZBAA3A, seg_pos={0 0}, upload=174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF Nov 11 09:56:39.791793004 (12m25.150451669s) [noise=true , address=45.91.116.9:4263 , piece_id=HQKC6IELCZFPVCWI36TR63KYHI3Y35BLU3SMVWCR37ETJWZBAA3A, seg_pos={0 0}, upload=174]: Long tail cancellation due to optimal threshold Nov 11 09:56:39.792081601 (12m25.150740263s) [noise=true , address=145.79.227.22:4511 , piece_id=KI5VRUSEKKHQ2HPTZW3MSOZZSSVITYTG4GPUZMLFJ4ZXI7UOC4CQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG): protocol: expected piece hash; context canceled; EOF Nov 11 09:56:39.792090492 (12m25.150749206s) [noise=true , address=145.79.227.22:4511 , piece_id=KI5VRUSEKKHQ2HPTZW3MSOZZSSVITYTG4GPUZMLFJ4ZXI7UOC4CQ, seg_pos={0 0}, upload=174]: Long tail cancellation due to optimal threshold Nov 11 09:56:39.792110632 (12m25.150769284s) [seg_pos={0 0}, upload=174]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 11 09:56:39.792218914 (12m25.150877558s) [upload=174]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 11 09:56:39.792224633 (12m25.150883277s) [upload=174]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 11 09:56:39.931652725 (12m25.29031138s) [upload=174]: Done uploading segments... Nov 11 09:56:39.931673903 (12m25.290332558s) [upload=174]: Upload finished. err: <nil> Duration: 2.383227211s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.421626025s trace: https://jaeger.dev.storj.io/trace/2af447c1cc32e3fe FAIL (2025-11-11 10:37:43 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Nov 11 09:56:38.891694755 (12m24.250353408s) [upload=174]: Starting upload Nov 11 09:56:38.891756957 (12m24.250415616s) [upload=174]: Done starting upload Nov 11 09:56:38.891883474 (12m24.250542118s) [upload=174]: Uploading segments... Nov 11 09:56:38.892161824 (12m24.250820469s) [upload=174]: Got next segment. Inline: false Nov 11 09:56:38.892646331 (12m24.251304991s) [upload=174]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 11 09:56:38.892657501 (12m24.251316155s) [upload=174]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 11 09:56:39.005052720 (12m24.363711398s) [seg_pos={0 0}, upload=174]: Begin upload segment... Nov 11 09:56:39.005125494 (12m24.363784134s) [seg_pos={0 0}, upload=174]: Done begin upload segment. Nov 11 09:56:39.005216129 (12m24.363874823s) [noise=true , address=145.79.227.13:4804 , piece_id=4YRWKCCB2UUB3TETJTW3DQLQACW33F3YIOOL4QCUHXCW4RFKRHHQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.005230740 (12m24.363889419s) [noise=true , address=145.79.227.25:4619 , piece_id=FRKZ7ISY3ZD5TDIUXGFD6SUKNP6NQH6W2DP7ABT6AYWSCZGJUN7Q, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.005999056 (12m24.364657738s) [noise=true , address=145.79.227.32:4836 , piece_id=W5TK45TG3EV6AZTZN2UA5QHLQK6IXA46LVD2K5L6M6OXWQPRFN5Q, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.006601206 (12m24.365259871s) [noise=true , address=77.90.31.10:4519 , piece_id=U7FQQL65MZHQTWUOY5SKFL4VKT4QAFDVZ44EUOBKMNOLAADSSIPA, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.007145644 (12m24.365804308s) [noise=true , address=77.90.31.17:4771 , piece_id=QEH6D7XZFBLANBZTAENBVN4LT6FPGTF6QC4XZ7T3BFD3BHIWQEOQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.007818316 (12m24.366476979s) [noise=true , address=145.79.227.27:4689 , piece_id=GF3HUNJX2JNDFNJMU643UNYV2NT7NRPRQ2CQNR3I6RZ2RLYCASJA, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.008466282 (12m24.367124946s) [noise=true , address=145.79.227.9:4366 , piece_id=C4CZIP32EQME6H2GUZNJXQK4NM5GNOG7LIIGOKLOWWAQ2BKVHTVQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.009115289 (12m24.367773953s) [noise=true , address=145.79.227.6:4258 , piece_id=ALGZJPRFE5ZKYDHSNSYWM437BF5SBGAQLV57FCSGFNRPDIO2XFTQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.011091547 (12m24.36975021s) [noise=true , address=145.79.227.28:4726 , piece_id=VQJAIUUVCF5UQTQI2I3S4JZWAABTNLRHHHVZ3YE6EZTTIZBCZ57A, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.011726540 (12m24.370385204s) [noise=true , address=145.79.227.11:4732 , piece_id=EAJQZUVBQDPB456TYONLDGEXU2T72DZIBCQQ3JX5BGHUTDGQD2IA, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.013122380 (12m24.371781047s) [noise=true , address=145.79.227.20:4438 , piece_id=RRWIZE2Y2XM3BX4KU5FH2HQYCJL3HAPBTJXBBCCD2FUQT5DHVKPQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.015282432 (12m24.373941079s) [noise=true , address=45.91.116.6:4975 , piece_id=Z26AFA2WT4PQXOHPXC2LTHD6HGQW7KGNVFXYKAMLHCPIKVCQ7CWQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.016746279 (12m24.375404942s) [noise=true , address=45.91.116.9:4263 , piece_id=HQKC6IELCZFPVCWI36TR63KYHI3Y35BLU3SMVWCR37ETJWZBAA3A, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.019161006 (12m24.37781977s) [noise=true , address=145.79.227.22:4511 , piece_id=KI5VRUSEKKHQ2HPTZW3MSOZZSSVITYTG4GPUZMLFJ4ZXI7UOC4CQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.020917020 (12m24.379575685s) [noise=true , address=145.79.227.18:4006 , piece_id=ENXJAZBBU6PGPX56NFZQRLUGWKQ5CNP3LUMXIAMFKN5LBA3JO5PQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.023350963 (12m24.382009629s) [noise=true , address=145.79.227.21:4473 , piece_id=6JE3OOHCMUJ3HSR5BORCDCOXI7SFMIVKSMYOS3OLANHP6NIM6BVQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.635609835 (12m24.994268492s) [upload=174]: Next returned nil segment Nov 11 09:56:39.635628781 (12m24.99428746s) [upload=174]: Waiting for error group managing segments... Nov 11 09:56:39.759546252 (12m25.118204907s) [noise=true , address=145.79.227.6:4258 , piece_id=ALGZJPRFE5ZKYDHSNSYWM437BF5SBGAQLV57FCSGFNRPDIO2XFTQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.760153701 (12m25.118812356s) [noise=true , address=77.90.31.10:4519 , piece_id=U7FQQL65MZHQTWUOY5SKFL4VKT4QAFDVZ44EUOBKMNOLAADSSIPA, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.760787126 (12m25.119445795s) [noise=true , address=145.79.227.13:4804 , piece_id=4YRWKCCB2UUB3TETJTW3DQLQACW33F3YIOOL4QCUHXCW4RFKRHHQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.761593519 (12m25.120252172s) [noise=true , address=145.79.227.27:4689 , piece_id=GF3HUNJX2JNDFNJMU643UNYV2NT7NRPRQ2CQNR3I6RZ2RLYCASJA, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.762295832 (12m25.120954498s) [noise=true , address=145.79.227.11:4732 , piece_id=EAJQZUVBQDPB456TYONLDGEXU2T72DZIBCQQ3JX5BGHUTDGQD2IA, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.766441496 (12m25.12510015s) [noise=true , address=145.79.227.28:4726 , piece_id=VQJAIUUVCF5UQTQI2I3S4JZWAABTNLRHHHVZ3YE6EZTTIZBCZ57A, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.766631748 (12m25.125290412s) [noise=true , address=145.79.227.32:4836 , piece_id=W5TK45TG3EV6AZTZN2UA5QHLQK6IXA46LVD2K5L6M6OXWQPRFN5Q, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.767329514 (12m25.125988177s) [noise=true , address=77.90.31.17:4771 , piece_id=QEH6D7XZFBLANBZTAENBVN4LT6FPGTF6QC4XZ7T3BFD3BHIWQEOQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.767886254 (12m25.126544908s) [noise=true , address=145.79.227.9:4366 , piece_id=C4CZIP32EQME6H2GUZNJXQK4NM5GNOG7LIIGOKLOWWAQ2BKVHTVQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.768539301 (12m25.12719796s) [noise=true , address=145.79.227.25:4619 , piece_id=FRKZ7ISY3ZD5TDIUXGFD6SUKNP6NQH6W2DP7ABT6AYWSCZGJUN7Q, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.787492893 (12m25.146151557s) [noise=true , address=45.91.116.6:4975 , piece_id=Z26AFA2WT4PQXOHPXC2LTHD6HGQW7KGNVFXYKAMLHCPIKVCQ7CWQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.789897656 (12m25.148556321s) [noise=true , address=145.79.227.21:4473 , piece_id=6JE3OOHCMUJ3HSR5BORCDCOXI7SFMIVKSMYOS3OLANHP6NIM6BVQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.791424933 (12m25.150083592s) [noise=true , address=145.79.227.18:4006 , piece_id=ENXJAZBBU6PGPX56NFZQRLUGWKQ5CNP3LUMXIAMFKN5LBA3JO5PQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.791445282 (12m25.150103946s) [seg_pos={0 0}, upload=174]: Segment reached optimal threshold of 13 pieces. Nov 11 09:56:39.791713518 (12m25.150372181s) [noise=true , address=145.79.227.20:4438 , piece_id=RRWIZE2Y2XM3BX4KU5FH2HQYCJL3HAPBTJXBBCCD2FUQT5DHVKPQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT): protocol: expected piece hash; context canceled; EOF Nov 11 09:56:39.791725086 (12m25.150383768s) [noise=true , address=145.79.227.20:4438 , piece_id=RRWIZE2Y2XM3BX4KU5FH2HQYCJL3HAPBTJXBBCCD2FUQT5DHVKPQ, seg_pos={0 0}, upload=174]: Long tail cancellation due to optimal threshold Nov 11 09:56:39.791778521 (12m25.150437247s) [noise=true , address=45.91.116.9:4263 , piece_id=HQKC6IELCZFPVCWI36TR63KYHI3Y35BLU3SMVWCR37ETJWZBAA3A, seg_pos={0 0}, upload=174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF Nov 11 09:56:39.791793004 (12m25.150451669s) [noise=true , address=45.91.116.9:4263 , piece_id=HQKC6IELCZFPVCWI36TR63KYHI3Y35BLU3SMVWCR37ETJWZBAA3A, seg_pos={0 0}, upload=174]: Long tail cancellation due to optimal threshold Nov 11 09:56:39.792081601 (12m25.150740263s) [noise=true , address=145.79.227.22:4511 , piece_id=KI5VRUSEKKHQ2HPTZW3MSOZZSSVITYTG4GPUZMLFJ4ZXI7UOC4CQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG): protocol: expected piece hash; context canceled; EOF Nov 11 09:56:39.792090492 (12m25.150749206s) [noise=true , address=145.79.227.22:4511 , piece_id=KI5VRUSEKKHQ2HPTZW3MSOZZSSVITYTG4GPUZMLFJ4ZXI7UOC4CQ, seg_pos={0 0}, upload=174]: Long tail cancellation due to optimal threshold Nov 11 09:56:39.792110632 (12m25.150769284s) [seg_pos={0 0}, upload=174]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 11 09:56:39.792218914 (12m25.150877558s) [upload=174]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 11 09:56:39.792224633 (12m25.150883277s) [upload=174]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 11 09:56:39.931652725 (12m25.29031138s) [upload=174]: Done uploading segments... Nov 11 09:56:39.931673903 (12m25.290332558s) [upload=174]: Upload finished. err: <nil> Duration: 2.421682129s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.364156135s trace: https://jaeger.dev.storj.io/trace/2af447c1cc32e3fe FAIL (2025-11-11 10:37:22 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Nov 11 09:56:38.891694755 (12m24.250353408s) [upload=174]: Starting upload Nov 11 09:56:38.891756957 (12m24.250415616s) [upload=174]: Done starting upload Nov 11 09:56:38.891883474 (12m24.250542118s) [upload=174]: Uploading segments... Nov 11 09:56:38.892161824 (12m24.250820469s) [upload=174]: Got next segment. Inline: false Nov 11 09:56:38.892646331 (12m24.251304991s) [upload=174]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 11 09:56:38.892657501 (12m24.251316155s) [upload=174]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 11 09:56:39.005052720 (12m24.363711398s) [seg_pos={0 0}, upload=174]: Begin upload segment... Nov 11 09:56:39.005125494 (12m24.363784134s) [seg_pos={0 0}, upload=174]: Done begin upload segment. Nov 11 09:56:39.005216129 (12m24.363874823s) [noise=true , address=145.79.227.13:4804 , piece_id=4YRWKCCB2UUB3TETJTW3DQLQACW33F3YIOOL4QCUHXCW4RFKRHHQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.005230740 (12m24.363889419s) [noise=true , address=145.79.227.25:4619 , piece_id=FRKZ7ISY3ZD5TDIUXGFD6SUKNP6NQH6W2DP7ABT6AYWSCZGJUN7Q, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.005999056 (12m24.364657738s) [noise=true , address=145.79.227.32:4836 , piece_id=W5TK45TG3EV6AZTZN2UA5QHLQK6IXA46LVD2K5L6M6OXWQPRFN5Q, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.006601206 (12m24.365259871s) [noise=true , address=77.90.31.10:4519 , piece_id=U7FQQL65MZHQTWUOY5SKFL4VKT4QAFDVZ44EUOBKMNOLAADSSIPA, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.007145644 (12m24.365804308s) [noise=true , address=77.90.31.17:4771 , piece_id=QEH6D7XZFBLANBZTAENBVN4LT6FPGTF6QC4XZ7T3BFD3BHIWQEOQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.007818316 (12m24.366476979s) [noise=true , address=145.79.227.27:4689 , piece_id=GF3HUNJX2JNDFNJMU643UNYV2NT7NRPRQ2CQNR3I6RZ2RLYCASJA, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.008466282 (12m24.367124946s) [noise=true , address=145.79.227.9:4366 , piece_id=C4CZIP32EQME6H2GUZNJXQK4NM5GNOG7LIIGOKLOWWAQ2BKVHTVQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.009115289 (12m24.367773953s) [noise=true , address=145.79.227.6:4258 , piece_id=ALGZJPRFE5ZKYDHSNSYWM437BF5SBGAQLV57FCSGFNRPDIO2XFTQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.011091547 (12m24.36975021s) [noise=true , address=145.79.227.28:4726 , piece_id=VQJAIUUVCF5UQTQI2I3S4JZWAABTNLRHHHVZ3YE6EZTTIZBCZ57A, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.011726540 (12m24.370385204s) [noise=true , address=145.79.227.11:4732 , piece_id=EAJQZUVBQDPB456TYONLDGEXU2T72DZIBCQQ3JX5BGHUTDGQD2IA, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.013122380 (12m24.371781047s) [noise=true , address=145.79.227.20:4438 , piece_id=RRWIZE2Y2XM3BX4KU5FH2HQYCJL3HAPBTJXBBCCD2FUQT5DHVKPQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.015282432 (12m24.373941079s) [noise=true , address=45.91.116.6:4975 , piece_id=Z26AFA2WT4PQXOHPXC2LTHD6HGQW7KGNVFXYKAMLHCPIKVCQ7CWQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.016746279 (12m24.375404942s) [noise=true , address=45.91.116.9:4263 , piece_id=HQKC6IELCZFPVCWI36TR63KYHI3Y35BLU3SMVWCR37ETJWZBAA3A, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.019161006 (12m24.37781977s) [noise=true , address=145.79.227.22:4511 , piece_id=KI5VRUSEKKHQ2HPTZW3MSOZZSSVITYTG4GPUZMLFJ4ZXI7UOC4CQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.020917020 (12m24.379575685s) [noise=true , address=145.79.227.18:4006 , piece_id=ENXJAZBBU6PGPX56NFZQRLUGWKQ5CNP3LUMXIAMFKN5LBA3JO5PQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.023350963 (12m24.382009629s) [noise=true , address=145.79.227.21:4473 , piece_id=6JE3OOHCMUJ3HSR5BORCDCOXI7SFMIVKSMYOS3OLANHP6NIM6BVQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.635609835 (12m24.994268492s) [upload=174]: Next returned nil segment Nov 11 09:56:39.635628781 (12m24.99428746s) [upload=174]: Waiting for error group managing segments... Nov 11 09:56:39.759546252 (12m25.118204907s) [noise=true , address=145.79.227.6:4258 , piece_id=ALGZJPRFE5ZKYDHSNSYWM437BF5SBGAQLV57FCSGFNRPDIO2XFTQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.760153701 (12m25.118812356s) [noise=true , address=77.90.31.10:4519 , piece_id=U7FQQL65MZHQTWUOY5SKFL4VKT4QAFDVZ44EUOBKMNOLAADSSIPA, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.760787126 (12m25.119445795s) [noise=true , address=145.79.227.13:4804 , piece_id=4YRWKCCB2UUB3TETJTW3DQLQACW33F3YIOOL4QCUHXCW4RFKRHHQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.761593519 (12m25.120252172s) [noise=true , address=145.79.227.27:4689 , piece_id=GF3HUNJX2JNDFNJMU643UNYV2NT7NRPRQ2CQNR3I6RZ2RLYCASJA, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.762295832 (12m25.120954498s) [noise=true , address=145.79.227.11:4732 , piece_id=EAJQZUVBQDPB456TYONLDGEXU2T72DZIBCQQ3JX5BGHUTDGQD2IA, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.766441496 (12m25.12510015s) [noise=true , address=145.79.227.28:4726 , piece_id=VQJAIUUVCF5UQTQI2I3S4JZWAABTNLRHHHVZ3YE6EZTTIZBCZ57A, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.766631748 (12m25.125290412s) [noise=true , address=145.79.227.32:4836 , piece_id=W5TK45TG3EV6AZTZN2UA5QHLQK6IXA46LVD2K5L6M6OXWQPRFN5Q, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.767329514 (12m25.125988177s) [noise=true , address=77.90.31.17:4771 , piece_id=QEH6D7XZFBLANBZTAENBVN4LT6FPGTF6QC4XZ7T3BFD3BHIWQEOQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.767886254 (12m25.126544908s) [noise=true , address=145.79.227.9:4366 , piece_id=C4CZIP32EQME6H2GUZNJXQK4NM5GNOG7LIIGOKLOWWAQ2BKVHTVQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.768539301 (12m25.12719796s) [noise=true , address=145.79.227.25:4619 , piece_id=FRKZ7ISY3ZD5TDIUXGFD6SUKNP6NQH6W2DP7ABT6AYWSCZGJUN7Q, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.787492893 (12m25.146151557s) [noise=true , address=45.91.116.6:4975 , piece_id=Z26AFA2WT4PQXOHPXC2LTHD6HGQW7KGNVFXYKAMLHCPIKVCQ7CWQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.789897656 (12m25.148556321s) [noise=true , address=145.79.227.21:4473 , piece_id=6JE3OOHCMUJ3HSR5BORCDCOXI7SFMIVKSMYOS3OLANHP6NIM6BVQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.791424933 (12m25.150083592s) [noise=true , address=145.79.227.18:4006 , piece_id=ENXJAZBBU6PGPX56NFZQRLUGWKQ5CNP3LUMXIAMFKN5LBA3JO5PQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.791445282 (12m25.150103946s) [seg_pos={0 0}, upload=174]: Segment reached optimal threshold of 13 pieces. Nov 11 09:56:39.791713518 (12m25.150372181s) [noise=true , address=145.79.227.20:4438 , piece_id=RRWIZE2Y2XM3BX4KU5FH2HQYCJL3HAPBTJXBBCCD2FUQT5DHVKPQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT): protocol: expected piece hash; context canceled; EOF Nov 11 09:56:39.791725086 (12m25.150383768s) [noise=true , address=145.79.227.20:4438 , piece_id=RRWIZE2Y2XM3BX4KU5FH2HQYCJL3HAPBTJXBBCCD2FUQT5DHVKPQ, seg_pos={0 0}, upload=174]: Long tail cancellation due to optimal threshold Nov 11 09:56:39.791778521 (12m25.150437247s) [noise=true , address=45.91.116.9:4263 , piece_id=HQKC6IELCZFPVCWI36TR63KYHI3Y35BLU3SMVWCR37ETJWZBAA3A, seg_pos={0 0}, upload=174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF Nov 11 09:56:39.791793004 (12m25.150451669s) [noise=true , address=45.91.116.9:4263 , piece_id=HQKC6IELCZFPVCWI36TR63KYHI3Y35BLU3SMVWCR37ETJWZBAA3A, seg_pos={0 0}, upload=174]: Long tail cancellation due to optimal threshold Nov 11 09:56:39.792081601 (12m25.150740263s) [noise=true , address=145.79.227.22:4511 , piece_id=KI5VRUSEKKHQ2HPTZW3MSOZZSSVITYTG4GPUZMLFJ4ZXI7UOC4CQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG): protocol: expected piece hash; context canceled; EOF Nov 11 09:56:39.792090492 (12m25.150749206s) [noise=true , address=145.79.227.22:4511 , piece_id=KI5VRUSEKKHQ2HPTZW3MSOZZSSVITYTG4GPUZMLFJ4ZXI7UOC4CQ, seg_pos={0 0}, upload=174]: Long tail cancellation due to optimal threshold Nov 11 09:56:39.792110632 (12m25.150769284s) [seg_pos={0 0}, upload=174]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 11 09:56:39.792218914 (12m25.150877558s) [upload=174]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 11 09:56:39.792224633 (12m25.150883277s) [upload=174]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 11 09:56:39.931652725 (12m25.29031138s) [upload=174]: Done uploading segments... Nov 11 09:56:39.931673903 (12m25.290332558s) [upload=174]: Upload finished. err: <nil> Duration: 2.364177894s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.382367475s trace: https://jaeger.dev.storj.io/trace/2af447c1cc32e3fe FAIL (2025-11-11 10:37:04 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Nov 11 09:56:38.891694755 (12m24.250353408s) [upload=174]: Starting upload Nov 11 09:56:38.891756957 (12m24.250415616s) [upload=174]: Done starting upload Nov 11 09:56:38.891883474 (12m24.250542118s) [upload=174]: Uploading segments... Nov 11 09:56:38.892161824 (12m24.250820469s) [upload=174]: Got next segment. Inline: false Nov 11 09:56:38.892646331 (12m24.251304991s) [upload=174]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 11 09:56:38.892657501 (12m24.251316155s) [upload=174]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 11 09:56:39.005052720 (12m24.363711398s) [seg_pos={0 0}, upload=174]: Begin upload segment... Nov 11 09:56:39.005125494 (12m24.363784134s) [seg_pos={0 0}, upload=174]: Done begin upload segment. Nov 11 09:56:39.005216129 (12m24.363874823s) [noise=true , address=145.79.227.13:4804 , piece_id=4YRWKCCB2UUB3TETJTW3DQLQACW33F3YIOOL4QCUHXCW4RFKRHHQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.005230740 (12m24.363889419s) [noise=true , address=145.79.227.25:4619 , piece_id=FRKZ7ISY3ZD5TDIUXGFD6SUKNP6NQH6W2DP7ABT6AYWSCZGJUN7Q, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.005999056 (12m24.364657738s) [noise=true , address=145.79.227.32:4836 , piece_id=W5TK45TG3EV6AZTZN2UA5QHLQK6IXA46LVD2K5L6M6OXWQPRFN5Q, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.006601206 (12m24.365259871s) [noise=true , address=77.90.31.10:4519 , piece_id=U7FQQL65MZHQTWUOY5SKFL4VKT4QAFDVZ44EUOBKMNOLAADSSIPA, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.007145644 (12m24.365804308s) [noise=true , address=77.90.31.17:4771 , piece_id=QEH6D7XZFBLANBZTAENBVN4LT6FPGTF6QC4XZ7T3BFD3BHIWQEOQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.007818316 (12m24.366476979s) [noise=true , address=145.79.227.27:4689 , piece_id=GF3HUNJX2JNDFNJMU643UNYV2NT7NRPRQ2CQNR3I6RZ2RLYCASJA, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.008466282 (12m24.367124946s) [noise=true , address=145.79.227.9:4366 , piece_id=C4CZIP32EQME6H2GUZNJXQK4NM5GNOG7LIIGOKLOWWAQ2BKVHTVQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.009115289 (12m24.367773953s) [noise=true , address=145.79.227.6:4258 , piece_id=ALGZJPRFE5ZKYDHSNSYWM437BF5SBGAQLV57FCSGFNRPDIO2XFTQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.011091547 (12m24.36975021s) [noise=true , address=145.79.227.28:4726 , piece_id=VQJAIUUVCF5UQTQI2I3S4JZWAABTNLRHHHVZ3YE6EZTTIZBCZ57A, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.011726540 (12m24.370385204s) [noise=true , address=145.79.227.11:4732 , piece_id=EAJQZUVBQDPB456TYONLDGEXU2T72DZIBCQQ3JX5BGHUTDGQD2IA, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.013122380 (12m24.371781047s) [noise=true , address=145.79.227.20:4438 , piece_id=RRWIZE2Y2XM3BX4KU5FH2HQYCJL3HAPBTJXBBCCD2FUQT5DHVKPQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.015282432 (12m24.373941079s) [noise=true , address=45.91.116.6:4975 , piece_id=Z26AFA2WT4PQXOHPXC2LTHD6HGQW7KGNVFXYKAMLHCPIKVCQ7CWQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.016746279 (12m24.375404942s) [noise=true , address=45.91.116.9:4263 , piece_id=HQKC6IELCZFPVCWI36TR63KYHI3Y35BLU3SMVWCR37ETJWZBAA3A, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.019161006 (12m24.37781977s) [noise=true , address=145.79.227.22:4511 , piece_id=KI5VRUSEKKHQ2HPTZW3MSOZZSSVITYTG4GPUZMLFJ4ZXI7UOC4CQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.020917020 (12m24.379575685s) [noise=true , address=145.79.227.18:4006 , piece_id=ENXJAZBBU6PGPX56NFZQRLUGWKQ5CNP3LUMXIAMFKN5LBA3JO5PQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.023350963 (12m24.382009629s) [noise=true , address=145.79.227.21:4473 , piece_id=6JE3OOHCMUJ3HSR5BORCDCOXI7SFMIVKSMYOS3OLANHP6NIM6BVQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.635609835 (12m24.994268492s) [upload=174]: Next returned nil segment Nov 11 09:56:39.635628781 (12m24.99428746s) [upload=174]: Waiting for error group managing segments... Nov 11 09:56:39.759546252 (12m25.118204907s) [noise=true , address=145.79.227.6:4258 , piece_id=ALGZJPRFE5ZKYDHSNSYWM437BF5SBGAQLV57FCSGFNRPDIO2XFTQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.760153701 (12m25.118812356s) [noise=true , address=77.90.31.10:4519 , piece_id=U7FQQL65MZHQTWUOY5SKFL4VKT4QAFDVZ44EUOBKMNOLAADSSIPA, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.760787126 (12m25.119445795s) [noise=true , address=145.79.227.13:4804 , piece_id=4YRWKCCB2UUB3TETJTW3DQLQACW33F3YIOOL4QCUHXCW4RFKRHHQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.761593519 (12m25.120252172s) [noise=true , address=145.79.227.27:4689 , piece_id=GF3HUNJX2JNDFNJMU643UNYV2NT7NRPRQ2CQNR3I6RZ2RLYCASJA, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.762295832 (12m25.120954498s) [noise=true , address=145.79.227.11:4732 , piece_id=EAJQZUVBQDPB456TYONLDGEXU2T72DZIBCQQ3JX5BGHUTDGQD2IA, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.766441496 (12m25.12510015s) [noise=true , address=145.79.227.28:4726 , piece_id=VQJAIUUVCF5UQTQI2I3S4JZWAABTNLRHHHVZ3YE6EZTTIZBCZ57A, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.766631748 (12m25.125290412s) [noise=true , address=145.79.227.32:4836 , piece_id=W5TK45TG3EV6AZTZN2UA5QHLQK6IXA46LVD2K5L6M6OXWQPRFN5Q, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.767329514 (12m25.125988177s) [noise=true , address=77.90.31.17:4771 , piece_id=QEH6D7XZFBLANBZTAENBVN4LT6FPGTF6QC4XZ7T3BFD3BHIWQEOQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.767886254 (12m25.126544908s) [noise=true , address=145.79.227.9:4366 , piece_id=C4CZIP32EQME6H2GUZNJXQK4NM5GNOG7LIIGOKLOWWAQ2BKVHTVQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.768539301 (12m25.12719796s) [noise=true , address=145.79.227.25:4619 , piece_id=FRKZ7ISY3ZD5TDIUXGFD6SUKNP6NQH6W2DP7ABT6AYWSCZGJUN7Q, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.787492893 (12m25.146151557s) [noise=true , address=45.91.116.6:4975 , piece_id=Z26AFA2WT4PQXOHPXC2LTHD6HGQW7KGNVFXYKAMLHCPIKVCQ7CWQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.789897656 (12m25.148556321s) [noise=true , address=145.79.227.21:4473 , piece_id=6JE3OOHCMUJ3HSR5BORCDCOXI7SFMIVKSMYOS3OLANHP6NIM6BVQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.791424933 (12m25.150083592s) [noise=true , address=145.79.227.18:4006 , piece_id=ENXJAZBBU6PGPX56NFZQRLUGWKQ5CNP3LUMXIAMFKN5LBA3JO5PQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.791445282 (12m25.150103946s) [seg_pos={0 0}, upload=174]: Segment reached optimal threshold of 13 pieces. Nov 11 09:56:39.791713518 (12m25.150372181s) [noise=true , address=145.79.227.20:4438 , piece_id=RRWIZE2Y2XM3BX4KU5FH2HQYCJL3HAPBTJXBBCCD2FUQT5DHVKPQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT): protocol: expected piece hash; context canceled; EOF Nov 11 09:56:39.791725086 (12m25.150383768s) [noise=true , address=145.79.227.20:4438 , piece_id=RRWIZE2Y2XM3BX4KU5FH2HQYCJL3HAPBTJXBBCCD2FUQT5DHVKPQ, seg_pos={0 0}, upload=174]: Long tail cancellation due to optimal threshold Nov 11 09:56:39.791778521 (12m25.150437247s) [noise=true , address=45.91.116.9:4263 , piece_id=HQKC6IELCZFPVCWI36TR63KYHI3Y35BLU3SMVWCR37ETJWZBAA3A, seg_pos={0 0}, upload=174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF Nov 11 09:56:39.791793004 (12m25.150451669s) [noise=true , address=45.91.116.9:4263 , piece_id=HQKC6IELCZFPVCWI36TR63KYHI3Y35BLU3SMVWCR37ETJWZBAA3A, seg_pos={0 0}, upload=174]: Long tail cancellation due to optimal threshold Nov 11 09:56:39.792081601 (12m25.150740263s) [noise=true , address=145.79.227.22:4511 , piece_id=KI5VRUSEKKHQ2HPTZW3MSOZZSSVITYTG4GPUZMLFJ4ZXI7UOC4CQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG): protocol: expected piece hash; context canceled; EOF Nov 11 09:56:39.792090492 (12m25.150749206s) [noise=true , address=145.79.227.22:4511 , piece_id=KI5VRUSEKKHQ2HPTZW3MSOZZSSVITYTG4GPUZMLFJ4ZXI7UOC4CQ, seg_pos={0 0}, upload=174]: Long tail cancellation due to optimal threshold Nov 11 09:56:39.792110632 (12m25.150769284s) [seg_pos={0 0}, upload=174]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 11 09:56:39.792218914 (12m25.150877558s) [upload=174]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 11 09:56:39.792224633 (12m25.150883277s) [upload=174]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 11 09:56:39.931652725 (12m25.29031138s) [upload=174]: Done uploading segments... Nov 11 09:56:39.931673903 (12m25.290332558s) [upload=174]: Upload finished. err: <nil> Duration: 2.382415032s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.453984257s trace: https://jaeger.dev.storj.io/trace/2af447c1cc32e3fe FAIL (2025-11-11 10:36:20 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Nov 11 09:56:38.891694755 (12m24.250353408s) [upload=174]: Starting upload Nov 11 09:56:38.891756957 (12m24.250415616s) [upload=174]: Done starting upload Nov 11 09:56:38.891883474 (12m24.250542118s) [upload=174]: Uploading segments... Nov 11 09:56:38.892161824 (12m24.250820469s) [upload=174]: Got next segment. Inline: false Nov 11 09:56:38.892646331 (12m24.251304991s) [upload=174]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 11 09:56:38.892657501 (12m24.251316155s) [upload=174]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 11 09:56:39.005052720 (12m24.363711398s) [seg_pos={0 0}, upload=174]: Begin upload segment... Nov 11 09:56:39.005125494 (12m24.363784134s) [seg_pos={0 0}, upload=174]: Done begin upload segment. Nov 11 09:56:39.005216129 (12m24.363874823s) [noise=true , address=145.79.227.13:4804 , piece_id=4YRWKCCB2UUB3TETJTW3DQLQACW33F3YIOOL4QCUHXCW4RFKRHHQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.005230740 (12m24.363889419s) [noise=true , address=145.79.227.25:4619 , piece_id=FRKZ7ISY3ZD5TDIUXGFD6SUKNP6NQH6W2DP7ABT6AYWSCZGJUN7Q, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.005999056 (12m24.364657738s) [noise=true , address=145.79.227.32:4836 , piece_id=W5TK45TG3EV6AZTZN2UA5QHLQK6IXA46LVD2K5L6M6OXWQPRFN5Q, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.006601206 (12m24.365259871s) [noise=true , address=77.90.31.10:4519 , piece_id=U7FQQL65MZHQTWUOY5SKFL4VKT4QAFDVZ44EUOBKMNOLAADSSIPA, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.007145644 (12m24.365804308s) [noise=true , address=77.90.31.17:4771 , piece_id=QEH6D7XZFBLANBZTAENBVN4LT6FPGTF6QC4XZ7T3BFD3BHIWQEOQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.007818316 (12m24.366476979s) [noise=true , address=145.79.227.27:4689 , piece_id=GF3HUNJX2JNDFNJMU643UNYV2NT7NRPRQ2CQNR3I6RZ2RLYCASJA, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.008466282 (12m24.367124946s) [noise=true , address=145.79.227.9:4366 , piece_id=C4CZIP32EQME6H2GUZNJXQK4NM5GNOG7LIIGOKLOWWAQ2BKVHTVQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.009115289 (12m24.367773953s) [noise=true , address=145.79.227.6:4258 , piece_id=ALGZJPRFE5ZKYDHSNSYWM437BF5SBGAQLV57FCSGFNRPDIO2XFTQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.011091547 (12m24.36975021s) [noise=true , address=145.79.227.28:4726 , piece_id=VQJAIUUVCF5UQTQI2I3S4JZWAABTNLRHHHVZ3YE6EZTTIZBCZ57A, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.011726540 (12m24.370385204s) [noise=true , address=145.79.227.11:4732 , piece_id=EAJQZUVBQDPB456TYONLDGEXU2T72DZIBCQQ3JX5BGHUTDGQD2IA, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.013122380 (12m24.371781047s) [noise=true , address=145.79.227.20:4438 , piece_id=RRWIZE2Y2XM3BX4KU5FH2HQYCJL3HAPBTJXBBCCD2FUQT5DHVKPQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.015282432 (12m24.373941079s) [noise=true , address=45.91.116.6:4975 , piece_id=Z26AFA2WT4PQXOHPXC2LTHD6HGQW7KGNVFXYKAMLHCPIKVCQ7CWQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.016746279 (12m24.375404942s) [noise=true , address=45.91.116.9:4263 , piece_id=HQKC6IELCZFPVCWI36TR63KYHI3Y35BLU3SMVWCR37ETJWZBAA3A, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.019161006 (12m24.37781977s) [noise=true , address=145.79.227.22:4511 , piece_id=KI5VRUSEKKHQ2HPTZW3MSOZZSSVITYTG4GPUZMLFJ4ZXI7UOC4CQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.020917020 (12m24.379575685s) [noise=true , address=145.79.227.18:4006 , piece_id=ENXJAZBBU6PGPX56NFZQRLUGWKQ5CNP3LUMXIAMFKN5LBA3JO5PQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.023350963 (12m24.382009629s) [noise=true , address=145.79.227.21:4473 , piece_id=6JE3OOHCMUJ3HSR5BORCDCOXI7SFMIVKSMYOS3OLANHP6NIM6BVQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.635609835 (12m24.994268492s) [upload=174]: Next returned nil segment Nov 11 09:56:39.635628781 (12m24.99428746s) [upload=174]: Waiting for error group managing segments... Nov 11 09:56:39.759546252 (12m25.118204907s) [noise=true , address=145.79.227.6:4258 , piece_id=ALGZJPRFE5ZKYDHSNSYWM437BF5SBGAQLV57FCSGFNRPDIO2XFTQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.760153701 (12m25.118812356s) [noise=true , address=77.90.31.10:4519 , piece_id=U7FQQL65MZHQTWUOY5SKFL4VKT4QAFDVZ44EUOBKMNOLAADSSIPA, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.760787126 (12m25.119445795s) [noise=true , address=145.79.227.13:4804 , piece_id=4YRWKCCB2UUB3TETJTW3DQLQACW33F3YIOOL4QCUHXCW4RFKRHHQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.761593519 (12m25.120252172s) [noise=true , address=145.79.227.27:4689 , piece_id=GF3HUNJX2JNDFNJMU643UNYV2NT7NRPRQ2CQNR3I6RZ2RLYCASJA, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.762295832 (12m25.120954498s) [noise=true , address=145.79.227.11:4732 , piece_id=EAJQZUVBQDPB456TYONLDGEXU2T72DZIBCQQ3JX5BGHUTDGQD2IA, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.766441496 (12m25.12510015s) [noise=true , address=145.79.227.28:4726 , piece_id=VQJAIUUVCF5UQTQI2I3S4JZWAABTNLRHHHVZ3YE6EZTTIZBCZ57A, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.766631748 (12m25.125290412s) [noise=true , address=145.79.227.32:4836 , piece_id=W5TK45TG3EV6AZTZN2UA5QHLQK6IXA46LVD2K5L6M6OXWQPRFN5Q, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.767329514 (12m25.125988177s) [noise=true , address=77.90.31.17:4771 , piece_id=QEH6D7XZFBLANBZTAENBVN4LT6FPGTF6QC4XZ7T3BFD3BHIWQEOQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.767886254 (12m25.126544908s) [noise=true , address=145.79.227.9:4366 , piece_id=C4CZIP32EQME6H2GUZNJXQK4NM5GNOG7LIIGOKLOWWAQ2BKVHTVQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.768539301 (12m25.12719796s) [noise=true , address=145.79.227.25:4619 , piece_id=FRKZ7ISY3ZD5TDIUXGFD6SUKNP6NQH6W2DP7ABT6AYWSCZGJUN7Q, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.787492893 (12m25.146151557s) [noise=true , address=45.91.116.6:4975 , piece_id=Z26AFA2WT4PQXOHPXC2LTHD6HGQW7KGNVFXYKAMLHCPIKVCQ7CWQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.789897656 (12m25.148556321s) [noise=true , address=145.79.227.21:4473 , piece_id=6JE3OOHCMUJ3HSR5BORCDCOXI7SFMIVKSMYOS3OLANHP6NIM6BVQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.791424933 (12m25.150083592s) [noise=true , address=145.79.227.18:4006 , piece_id=ENXJAZBBU6PGPX56NFZQRLUGWKQ5CNP3LUMXIAMFKN5LBA3JO5PQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.791445282 (12m25.150103946s) [seg_pos={0 0}, upload=174]: Segment reached optimal threshold of 13 pieces. Nov 11 09:56:39.791713518 (12m25.150372181s) [noise=true , address=145.79.227.20:4438 , piece_id=RRWIZE2Y2XM3BX4KU5FH2HQYCJL3HAPBTJXBBCCD2FUQT5DHVKPQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT): protocol: expected piece hash; context canceled; EOF Nov 11 09:56:39.791725086 (12m25.150383768s) [noise=true , address=145.79.227.20:4438 , piece_id=RRWIZE2Y2XM3BX4KU5FH2HQYCJL3HAPBTJXBBCCD2FUQT5DHVKPQ, seg_pos={0 0}, upload=174]: Long tail cancellation due to optimal threshold Nov 11 09:56:39.791778521 (12m25.150437247s) [noise=true , address=45.91.116.9:4263 , piece_id=HQKC6IELCZFPVCWI36TR63KYHI3Y35BLU3SMVWCR37ETJWZBAA3A, seg_pos={0 0}, upload=174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF Nov 11 09:56:39.791793004 (12m25.150451669s) [noise=true , address=45.91.116.9:4263 , piece_id=HQKC6IELCZFPVCWI36TR63KYHI3Y35BLU3SMVWCR37ETJWZBAA3A, seg_pos={0 0}, upload=174]: Long tail cancellation due to optimal threshold Nov 11 09:56:39.792081601 (12m25.150740263s) [noise=true , address=145.79.227.22:4511 , piece_id=KI5VRUSEKKHQ2HPTZW3MSOZZSSVITYTG4GPUZMLFJ4ZXI7UOC4CQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG): protocol: expected piece hash; context canceled; EOF Nov 11 09:56:39.792090492 (12m25.150749206s) [noise=true , address=145.79.227.22:4511 , piece_id=KI5VRUSEKKHQ2HPTZW3MSOZZSSVITYTG4GPUZMLFJ4ZXI7UOC4CQ, seg_pos={0 0}, upload=174]: Long tail cancellation due to optimal threshold Nov 11 09:56:39.792110632 (12m25.150769284s) [seg_pos={0 0}, upload=174]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 11 09:56:39.792218914 (12m25.150877558s) [upload=174]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 11 09:56:39.792224633 (12m25.150883277s) [upload=174]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 11 09:56:39.931652725 (12m25.29031138s) [upload=174]: Done uploading segments... Nov 11 09:56:39.931673903 (12m25.290332558s) [upload=174]: Upload finished. err: <nil> Duration: 2.454012896s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.326714463s trace: https://jaeger.dev.storj.io/trace/2af447c1cc32e3fe FAIL (2025-11-11 10:35:33 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Nov 11 09:56:38.891694755 (12m24.250353408s) [upload=174]: Starting upload Nov 11 09:56:38.891756957 (12m24.250415616s) [upload=174]: Done starting upload Nov 11 09:56:38.891883474 (12m24.250542118s) [upload=174]: Uploading segments... Nov 11 09:56:38.892161824 (12m24.250820469s) [upload=174]: Got next segment. Inline: false Nov 11 09:56:38.892646331 (12m24.251304991s) [upload=174]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 11 09:56:38.892657501 (12m24.251316155s) [upload=174]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 11 09:56:39.005052720 (12m24.363711398s) [seg_pos={0 0}, upload=174]: Begin upload segment... Nov 11 09:56:39.005125494 (12m24.363784134s) [seg_pos={0 0}, upload=174]: Done begin upload segment. Nov 11 09:56:39.005216129 (12m24.363874823s) [noise=true , address=145.79.227.13:4804 , piece_id=4YRWKCCB2UUB3TETJTW3DQLQACW33F3YIOOL4QCUHXCW4RFKRHHQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.005230740 (12m24.363889419s) [noise=true , address=145.79.227.25:4619 , piece_id=FRKZ7ISY3ZD5TDIUXGFD6SUKNP6NQH6W2DP7ABT6AYWSCZGJUN7Q, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.005999056 (12m24.364657738s) [noise=true , address=145.79.227.32:4836 , piece_id=W5TK45TG3EV6AZTZN2UA5QHLQK6IXA46LVD2K5L6M6OXWQPRFN5Q, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.006601206 (12m24.365259871s) [noise=true , address=77.90.31.10:4519 , piece_id=U7FQQL65MZHQTWUOY5SKFL4VKT4QAFDVZ44EUOBKMNOLAADSSIPA, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.007145644 (12m24.365804308s) [noise=true , address=77.90.31.17:4771 , piece_id=QEH6D7XZFBLANBZTAENBVN4LT6FPGTF6QC4XZ7T3BFD3BHIWQEOQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.007818316 (12m24.366476979s) [noise=true , address=145.79.227.27:4689 , piece_id=GF3HUNJX2JNDFNJMU643UNYV2NT7NRPRQ2CQNR3I6RZ2RLYCASJA, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.008466282 (12m24.367124946s) [noise=true , address=145.79.227.9:4366 , piece_id=C4CZIP32EQME6H2GUZNJXQK4NM5GNOG7LIIGOKLOWWAQ2BKVHTVQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.009115289 (12m24.367773953s) [noise=true , address=145.79.227.6:4258 , piece_id=ALGZJPRFE5ZKYDHSNSYWM437BF5SBGAQLV57FCSGFNRPDIO2XFTQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.011091547 (12m24.36975021s) [noise=true , address=145.79.227.28:4726 , piece_id=VQJAIUUVCF5UQTQI2I3S4JZWAABTNLRHHHVZ3YE6EZTTIZBCZ57A, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.011726540 (12m24.370385204s) [noise=true , address=145.79.227.11:4732 , piece_id=EAJQZUVBQDPB456TYONLDGEXU2T72DZIBCQQ3JX5BGHUTDGQD2IA, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.013122380 (12m24.371781047s) [noise=true , address=145.79.227.20:4438 , piece_id=RRWIZE2Y2XM3BX4KU5FH2HQYCJL3HAPBTJXBBCCD2FUQT5DHVKPQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.015282432 (12m24.373941079s) [noise=true , address=45.91.116.6:4975 , piece_id=Z26AFA2WT4PQXOHPXC2LTHD6HGQW7KGNVFXYKAMLHCPIKVCQ7CWQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.016746279 (12m24.375404942s) [noise=true , address=45.91.116.9:4263 , piece_id=HQKC6IELCZFPVCWI36TR63KYHI3Y35BLU3SMVWCR37ETJWZBAA3A, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.019161006 (12m24.37781977s) [noise=true , address=145.79.227.22:4511 , piece_id=KI5VRUSEKKHQ2HPTZW3MSOZZSSVITYTG4GPUZMLFJ4ZXI7UOC4CQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.020917020 (12m24.379575685s) [noise=true , address=145.79.227.18:4006 , piece_id=ENXJAZBBU6PGPX56NFZQRLUGWKQ5CNP3LUMXIAMFKN5LBA3JO5PQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.023350963 (12m24.382009629s) [noise=true , address=145.79.227.21:4473 , piece_id=6JE3OOHCMUJ3HSR5BORCDCOXI7SFMIVKSMYOS3OLANHP6NIM6BVQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.635609835 (12m24.994268492s) [upload=174]: Next returned nil segment Nov 11 09:56:39.635628781 (12m24.99428746s) [upload=174]: Waiting for error group managing segments... Nov 11 09:56:39.759546252 (12m25.118204907s) [noise=true , address=145.79.227.6:4258 , piece_id=ALGZJPRFE5ZKYDHSNSYWM437BF5SBGAQLV57FCSGFNRPDIO2XFTQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.760153701 (12m25.118812356s) [noise=true , address=77.90.31.10:4519 , piece_id=U7FQQL65MZHQTWUOY5SKFL4VKT4QAFDVZ44EUOBKMNOLAADSSIPA, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.760787126 (12m25.119445795s) [noise=true , address=145.79.227.13:4804 , piece_id=4YRWKCCB2UUB3TETJTW3DQLQACW33F3YIOOL4QCUHXCW4RFKRHHQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.761593519 (12m25.120252172s) [noise=true , address=145.79.227.27:4689 , piece_id=GF3HUNJX2JNDFNJMU643UNYV2NT7NRPRQ2CQNR3I6RZ2RLYCASJA, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.762295832 (12m25.120954498s) [noise=true , address=145.79.227.11:4732 , piece_id=EAJQZUVBQDPB456TYONLDGEXU2T72DZIBCQQ3JX5BGHUTDGQD2IA, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.766441496 (12m25.12510015s) [noise=true , address=145.79.227.28:4726 , piece_id=VQJAIUUVCF5UQTQI2I3S4JZWAABTNLRHHHVZ3YE6EZTTIZBCZ57A, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.766631748 (12m25.125290412s) [noise=true , address=145.79.227.32:4836 , piece_id=W5TK45TG3EV6AZTZN2UA5QHLQK6IXA46LVD2K5L6M6OXWQPRFN5Q, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.767329514 (12m25.125988177s) [noise=true , address=77.90.31.17:4771 , piece_id=QEH6D7XZFBLANBZTAENBVN4LT6FPGTF6QC4XZ7T3BFD3BHIWQEOQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.767886254 (12m25.126544908s) [noise=true , address=145.79.227.9:4366 , piece_id=C4CZIP32EQME6H2GUZNJXQK4NM5GNOG7LIIGOKLOWWAQ2BKVHTVQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.768539301 (12m25.12719796s) [noise=true , address=145.79.227.25:4619 , piece_id=FRKZ7ISY3ZD5TDIUXGFD6SUKNP6NQH6W2DP7ABT6AYWSCZGJUN7Q, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.787492893 (12m25.146151557s) [noise=true , address=45.91.116.6:4975 , piece_id=Z26AFA2WT4PQXOHPXC2LTHD6HGQW7KGNVFXYKAMLHCPIKVCQ7CWQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.789897656 (12m25.148556321s) [noise=true , address=145.79.227.21:4473 , piece_id=6JE3OOHCMUJ3HSR5BORCDCOXI7SFMIVKSMYOS3OLANHP6NIM6BVQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.791424933 (12m25.150083592s) [noise=true , address=145.79.227.18:4006 , piece_id=ENXJAZBBU6PGPX56NFZQRLUGWKQ5CNP3LUMXIAMFKN5LBA3JO5PQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.791445282 (12m25.150103946s) [seg_pos={0 0}, upload=174]: Segment reached optimal threshold of 13 pieces. Nov 11 09:56:39.791713518 (12m25.150372181s) [noise=true , address=145.79.227.20:4438 , piece_id=RRWIZE2Y2XM3BX4KU5FH2HQYCJL3HAPBTJXBBCCD2FUQT5DHVKPQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT): protocol: expected piece hash; context canceled; EOF Nov 11 09:56:39.791725086 (12m25.150383768s) [noise=true , address=145.79.227.20:4438 , piece_id=RRWIZE2Y2XM3BX4KU5FH2HQYCJL3HAPBTJXBBCCD2FUQT5DHVKPQ, seg_pos={0 0}, upload=174]: Long tail cancellation due to optimal threshold Nov 11 09:56:39.791778521 (12m25.150437247s) [noise=true , address=45.91.116.9:4263 , piece_id=HQKC6IELCZFPVCWI36TR63KYHI3Y35BLU3SMVWCR37ETJWZBAA3A, seg_pos={0 0}, upload=174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF Nov 11 09:56:39.791793004 (12m25.150451669s) [noise=true , address=45.91.116.9:4263 , piece_id=HQKC6IELCZFPVCWI36TR63KYHI3Y35BLU3SMVWCR37ETJWZBAA3A, seg_pos={0 0}, upload=174]: Long tail cancellation due to optimal threshold Nov 11 09:56:39.792081601 (12m25.150740263s) [noise=true , address=145.79.227.22:4511 , piece_id=KI5VRUSEKKHQ2HPTZW3MSOZZSSVITYTG4GPUZMLFJ4ZXI7UOC4CQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG): protocol: expected piece hash; context canceled; EOF Nov 11 09:56:39.792090492 (12m25.150749206s) [noise=true , address=145.79.227.22:4511 , piece_id=KI5VRUSEKKHQ2HPTZW3MSOZZSSVITYTG4GPUZMLFJ4ZXI7UOC4CQ, seg_pos={0 0}, upload=174]: Long tail cancellation due to optimal threshold Nov 11 09:56:39.792110632 (12m25.150769284s) [seg_pos={0 0}, upload=174]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 11 09:56:39.792218914 (12m25.150877558s) [upload=174]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 11 09:56:39.792224633 (12m25.150883277s) [upload=174]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 11 09:56:39.931652725 (12m25.29031138s) [upload=174]: Done uploading segments... Nov 11 09:56:39.931673903 (12m25.290332558s) [upload=174]: Upload finished. err: <nil> Duration: 2.32680256s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.378616169s trace: https://jaeger.dev.storj.io/trace/2af447c1cc32e3fe FAIL (2025-11-11 10:34:38 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Nov 11 09:56:38.891694755 (12m24.250353408s) [upload=174]: Starting upload Nov 11 09:56:38.891756957 (12m24.250415616s) [upload=174]: Done starting upload Nov 11 09:56:38.891883474 (12m24.250542118s) [upload=174]: Uploading segments... Nov 11 09:56:38.892161824 (12m24.250820469s) [upload=174]: Got next segment. Inline: false Nov 11 09:56:38.892646331 (12m24.251304991s) [upload=174]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 11 09:56:38.892657501 (12m24.251316155s) [upload=174]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 11 09:56:39.005052720 (12m24.363711398s) [seg_pos={0 0}, upload=174]: Begin upload segment... Nov 11 09:56:39.005125494 (12m24.363784134s) [seg_pos={0 0}, upload=174]: Done begin upload segment. Nov 11 09:56:39.005216129 (12m24.363874823s) [noise=true , address=145.79.227.13:4804 , piece_id=4YRWKCCB2UUB3TETJTW3DQLQACW33F3YIOOL4QCUHXCW4RFKRHHQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.005230740 (12m24.363889419s) [noise=true , address=145.79.227.25:4619 , piece_id=FRKZ7ISY3ZD5TDIUXGFD6SUKNP6NQH6W2DP7ABT6AYWSCZGJUN7Q, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.005999056 (12m24.364657738s) [noise=true , address=145.79.227.32:4836 , piece_id=W5TK45TG3EV6AZTZN2UA5QHLQK6IXA46LVD2K5L6M6OXWQPRFN5Q, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.006601206 (12m24.365259871s) [noise=true , address=77.90.31.10:4519 , piece_id=U7FQQL65MZHQTWUOY5SKFL4VKT4QAFDVZ44EUOBKMNOLAADSSIPA, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.007145644 (12m24.365804308s) [noise=true , address=77.90.31.17:4771 , piece_id=QEH6D7XZFBLANBZTAENBVN4LT6FPGTF6QC4XZ7T3BFD3BHIWQEOQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.007818316 (12m24.366476979s) [noise=true , address=145.79.227.27:4689 , piece_id=GF3HUNJX2JNDFNJMU643UNYV2NT7NRPRQ2CQNR3I6RZ2RLYCASJA, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.008466282 (12m24.367124946s) [noise=true , address=145.79.227.9:4366 , piece_id=C4CZIP32EQME6H2GUZNJXQK4NM5GNOG7LIIGOKLOWWAQ2BKVHTVQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.009115289 (12m24.367773953s) [noise=true , address=145.79.227.6:4258 , piece_id=ALGZJPRFE5ZKYDHSNSYWM437BF5SBGAQLV57FCSGFNRPDIO2XFTQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.011091547 (12m24.36975021s) [noise=true , address=145.79.227.28:4726 , piece_id=VQJAIUUVCF5UQTQI2I3S4JZWAABTNLRHHHVZ3YE6EZTTIZBCZ57A, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.011726540 (12m24.370385204s) [noise=true , address=145.79.227.11:4732 , piece_id=EAJQZUVBQDPB456TYONLDGEXU2T72DZIBCQQ3JX5BGHUTDGQD2IA, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.013122380 (12m24.371781047s) [noise=true , address=145.79.227.20:4438 , piece_id=RRWIZE2Y2XM3BX4KU5FH2HQYCJL3HAPBTJXBBCCD2FUQT5DHVKPQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.015282432 (12m24.373941079s) [noise=true , address=45.91.116.6:4975 , piece_id=Z26AFA2WT4PQXOHPXC2LTHD6HGQW7KGNVFXYKAMLHCPIKVCQ7CWQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.016746279 (12m24.375404942s) [noise=true , address=45.91.116.9:4263 , piece_id=HQKC6IELCZFPVCWI36TR63KYHI3Y35BLU3SMVWCR37ETJWZBAA3A, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.019161006 (12m24.37781977s) [noise=true , address=145.79.227.22:4511 , piece_id=KI5VRUSEKKHQ2HPTZW3MSOZZSSVITYTG4GPUZMLFJ4ZXI7UOC4CQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.020917020 (12m24.379575685s) [noise=true , address=145.79.227.18:4006 , piece_id=ENXJAZBBU6PGPX56NFZQRLUGWKQ5CNP3LUMXIAMFKN5LBA3JO5PQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.023350963 (12m24.382009629s) [noise=true , address=145.79.227.21:4473 , piece_id=6JE3OOHCMUJ3HSR5BORCDCOXI7SFMIVKSMYOS3OLANHP6NIM6BVQ, seg_pos={0 0}, upload=174]: Uploading piece... Nov 11 09:56:39.635609835 (12m24.994268492s) [upload=174]: Next returned nil segment Nov 11 09:56:39.635628781 (12m24.99428746s) [upload=174]: Waiting for error group managing segments... Nov 11 09:56:39.759546252 (12m25.118204907s) [noise=true , address=145.79.227.6:4258 , piece_id=ALGZJPRFE5ZKYDHSNSYWM437BF5SBGAQLV57FCSGFNRPDIO2XFTQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.760153701 (12m25.118812356s) [noise=true , address=77.90.31.10:4519 , piece_id=U7FQQL65MZHQTWUOY5SKFL4VKT4QAFDVZ44EUOBKMNOLAADSSIPA, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.760787126 (12m25.119445795s) [noise=true , address=145.79.227.13:4804 , piece_id=4YRWKCCB2UUB3TETJTW3DQLQACW33F3YIOOL4QCUHXCW4RFKRHHQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.761593519 (12m25.120252172s) [noise=true , address=145.79.227.27:4689 , piece_id=GF3HUNJX2JNDFNJMU643UNYV2NT7NRPRQ2CQNR3I6RZ2RLYCASJA, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.762295832 (12m25.120954498s) [noise=true , address=145.79.227.11:4732 , piece_id=EAJQZUVBQDPB456TYONLDGEXU2T72DZIBCQQ3JX5BGHUTDGQD2IA, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.766441496 (12m25.12510015s) [noise=true , address=145.79.227.28:4726 , piece_id=VQJAIUUVCF5UQTQI2I3S4JZWAABTNLRHHHVZ3YE6EZTTIZBCZ57A, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.766631748 (12m25.125290412s) [noise=true , address=145.79.227.32:4836 , piece_id=W5TK45TG3EV6AZTZN2UA5QHLQK6IXA46LVD2K5L6M6OXWQPRFN5Q, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.767329514 (12m25.125988177s) [noise=true , address=77.90.31.17:4771 , piece_id=QEH6D7XZFBLANBZTAENBVN4LT6FPGTF6QC4XZ7T3BFD3BHIWQEOQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.767886254 (12m25.126544908s) [noise=true , address=145.79.227.9:4366 , piece_id=C4CZIP32EQME6H2GUZNJXQK4NM5GNOG7LIIGOKLOWWAQ2BKVHTVQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.768539301 (12m25.12719796s) [noise=true , address=145.79.227.25:4619 , piece_id=FRKZ7ISY3ZD5TDIUXGFD6SUKNP6NQH6W2DP7ABT6AYWSCZGJUN7Q, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.787492893 (12m25.146151557s) [noise=true , address=45.91.116.6:4975 , piece_id=Z26AFA2WT4PQXOHPXC2LTHD6HGQW7KGNVFXYKAMLHCPIKVCQ7CWQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.789897656 (12m25.148556321s) [noise=true , address=145.79.227.21:4473 , piece_id=6JE3OOHCMUJ3HSR5BORCDCOXI7SFMIVKSMYOS3OLANHP6NIM6BVQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.791424933 (12m25.150083592s) [noise=true , address=145.79.227.18:4006 , piece_id=ENXJAZBBU6PGPX56NFZQRLUGWKQ5CNP3LUMXIAMFKN5LBA3JO5PQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: <nil> Nov 11 09:56:39.791445282 (12m25.150103946s) [seg_pos={0 0}, upload=174]: Segment reached optimal threshold of 13 pieces. Nov 11 09:56:39.791713518 (12m25.150372181s) [noise=true , address=145.79.227.20:4438 , piece_id=RRWIZE2Y2XM3BX4KU5FH2HQYCJL3HAPBTJXBBCCD2FUQT5DHVKPQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT): protocol: expected piece hash; context canceled; EOF Nov 11 09:56:39.791725086 (12m25.150383768s) [noise=true , address=145.79.227.20:4438 , piece_id=RRWIZE2Y2XM3BX4KU5FH2HQYCJL3HAPBTJXBBCCD2FUQT5DHVKPQ, seg_pos={0 0}, upload=174]: Long tail cancellation due to optimal threshold Nov 11 09:56:39.791778521 (12m25.150437247s) [noise=true , address=45.91.116.9:4263 , piece_id=HQKC6IELCZFPVCWI36TR63KYHI3Y35BLU3SMVWCR37ETJWZBAA3A, seg_pos={0 0}, upload=174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF Nov 11 09:56:39.791793004 (12m25.150451669s) [noise=true , address=45.91.116.9:4263 , piece_id=HQKC6IELCZFPVCWI36TR63KYHI3Y35BLU3SMVWCR37ETJWZBAA3A, seg_pos={0 0}, upload=174]: Long tail cancellation due to optimal threshold Nov 11 09:56:39.792081601 (12m25.150740263s) [noise=true , address=145.79.227.22:4511 , piece_id=KI5VRUSEKKHQ2HPTZW3MSOZZSSVITYTG4GPUZMLFJ4ZXI7UOC4CQ, seg_pos={0 0}, upload=174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG): protocol: expected piece hash; context canceled; EOF Nov 11 09:56:39.792090492 (12m25.150749206s) [noise=true , address=145.79.227.22:4511 , piece_id=KI5VRUSEKKHQ2HPTZW3MSOZZSSVITYTG4GPUZMLFJ4ZXI7UOC4CQ, seg_pos={0 0}, upload=174]: Long tail cancellation due to optimal threshold Nov 11 09:56:39.792110632 (12m25.150769284s) [seg_pos={0 0}, upload=174]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 11 09:56:39.792218914 (12m25.150877558s) [upload=174]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 11 09:56:39.792224633 (12m25.150883277s) [upload=174]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 11 09:56:39.931652725 (12m25.29031138s) [upload=174]: Done uploading segments... Nov 11 09:56:39.931673903 (12m25.290332558s) [upload=174]: Upload finished. err: <nil> Duration: 2.378645203s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)