Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...X........................................................] duration:
1.621082386s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:39:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.621111582s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....X.......................................................] duration:
2.170554319s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:38:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.170583632s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....X......................................................] duration:
1.705496755s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:38:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.705524526s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......X.....................................................] duration:
1.569358237s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:37:00 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.569387744s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......X....................................................] duration:
1.639387479s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:36:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.639417887s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........X...................................................] duration:
2.133250804s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:36:08 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.133290226s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........X..................................................] duration:
1.598498051s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:34:57 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.598528158s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........X.................................................] duration:
1.693529319s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:34:18 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.693568225s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........X................................................] duration:
1.844798325s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:33:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.844831218s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [............X...............................................] duration:
1.721317092s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:32:34 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.721346397s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.............X..............................................] duration:
1.646191132s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:31:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.646234415s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..............X.............................................] duration:
2.644115087s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:30:54 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.644146353s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...............X............................................] duration:
1.897823087s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:29:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.897914594s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [................X...........................................] duration:
2.219942058s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:28:53 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.219990532s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.................X..........................................] duration:
2.026864546s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:27:54 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.026896365s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..................X.........................................] duration:
2.171201725s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:27:18 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.171256524s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...................X........................................] duration:
2.633836979s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:26:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.633866395s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....................X.......................................] duration:
1.701580251s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:26:01 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.701612106s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....................X......................................] duration:
2.222968451s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:24:55 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.22306082s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......................X.....................................] duration:
2.063990595s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:24:00 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.064018307s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......................X....................................] duration:
1.637970748s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:23:01 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.638058341s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........................X...................................] duration:
2.325201076s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:22:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.325235502s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........................X..................................] duration:
1.589856128s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:21:18 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.58988266s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........................X.................................] duration:
1.66433163s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:20:46 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.664443533s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........................X................................] duration:
1.57852478s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:20:12 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.578582678s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [............................X...............................] duration:
1.746713914s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:19:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.746739841s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.............................X..............................] duration:
1.846237037s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:18:25 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.846265044s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..............................X.............................] duration:
2.209111981s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:17:55 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.209140747s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...............................X............................] duration:
1.630556156s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:16:52 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.630585804s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [................................X...........................] duration:
1.669650999s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:16:37 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.669681734s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.................................X..........................] duration:
1.583010916s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:15:23 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.58303912s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..................................X.........................] duration:
1.539279901s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:14:26 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.539307449s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...................................X........................] duration:
2.207442896s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:13:42 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.207516107s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....................................X.......................] duration:
1.628931272s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:12:42 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.628975917s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....................................X......................] duration:
1.681643797s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:11:54 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.681702071s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......................................X.....................] duration:
2.212899056s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:11:12 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.21294699s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......................................X....................] duration:
2.207305145s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:10:10 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.207334728s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........................................X...................] duration:
1.60752157s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:08:56 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.607550865s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [X........................................X..................] duration:
1.606977612s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:07:44 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.607009648s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
3.058194911s trace:
https://jaeger.dev.storj.io/trace/c036a4f2d71a778
FAIL (2026-04-03 16:07:03 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
24:14.098265938 (575h13m17.113935551s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.098831891 (575h13m17.114501506s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.099058352 (575h13m17.114727971s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.099461616 (575h13m17.11513122s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.099500194 (575h13m17.115169795s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.099989808 (575h13m17.11565942s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.100032457 (575h13m17.115702071s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.100377681 (575h13m17.116047288s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.100513196 (575h13m17.116182799s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.100984246 (575h13m17.116653902s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.101216587 (575h13m17.116886189s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.101442365 (575h13m17.117111966s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.101701277 (575h13m17.117370881s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.101844572 (575h13m17.117514184s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.102128723 (575h13m17.117798352s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.102543800 (575h13m17.118213402s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.102912469 (575h13m17.118582073s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.654255388 (575h13m17.66992499s) [upload=552424]: Next returned nil segment
Apr 3 15:24:14.654276756 (575h13m17.669946361s) [upload=552424]: Waiting for error group managing segments...
Apr 3 15:24:14.804527655 (575h13m17.820197259s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:14.838399330 (575h13m17.854068932s) [noise=true , address=77.90.31.21:4903 , piece_id=36XTH3NLLEUBWFFQKVNHMUFK625M27I2SMS6Z2XG6IJIZMCY4DFQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:15.955952569 (575h13m18.971622182s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:17.252252820 (575h13m20.267922421s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:19.171247616 (575h13m22.186917217s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:19.217203345 (575h13m22.232872952s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:19.612521688 (575h13m22.628191289s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:22.414814811 (575h13m25.430484415s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:23.372257597 (575h13m26.387927189s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:26.665681955 (575h13m29.681351555s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:29.460066298 (575h13m32.475735909s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:30.385795001 (575h13m33.401464603s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:30.927622980 (575h13m33.943292592s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:33.534990842 (575h13m36.550660448s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:33.535026340 (575h13m36.550695943s) [seg_pos={0 0}, upload=552424]: Satisfied cohort requirements after 14 pieces
Apr 3 15:24:33.535257561 (575h13m36.550927173s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gsNGvM8oKL9Fw1KLTrtpANYVozX2KGDDtL5BUmDhL9GDeFGof): protocol: expected piece hash; context canceled; EOF
Apr 3 15:24:33.535265871 (575h13m36.550935474s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold
Apr 3 15:24:33.535403914 (575h13m36.551073528s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Apr 3 15:24:33.535421314 (575h13m36.551090929s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold
Apr 3 15:24:33.535725819 (575h13m36.55139543s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ziK1cLtCwq29Ep2kNhnuy7vSwr5Qk3tdgtERxnz2WRVS4XFvx): protocol: expected piece hash; context canceled; EOF
Apr 3 15:24:33.535735892 (575h13m36.551405504s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold
Apr 3 15:24:33.535945878 (575h13m36.551615492s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSW1FsGdLjuXrE6eBo5suP7RHKv9uTUUenQWbCMFWWRcqoP9T): protocol: expected piece hash; context canceled; EOF
Apr 3 15:24:33.535961214 (575h13m36.551630824s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold
Apr 3 15:24:33.536141603 (575h13m36.551811196s) [seg_pos={0 0}, upload=552424]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 3 15:24:33.536421191 (575h13m36.552090785s) [upload=552424]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 3 15:24:33.536463199 (575h13m36.552132807s) [upload=552424]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 3 15:24:33.683231351 (575h13m36.698900952s) [upload=552424]: Done uploading segments...
Apr 3 15:24:33.683270427 (575h13m36.698940027s) [upload=552424]: Upload finished. err: <nil>
Duration: 3.058320291s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [.X........................................X.................] duration:
1.732459916s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:06:44 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.732492645s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
3.038976539s trace:
https://jaeger.dev.storj.io/trace/c036a4f2d71a778
FAIL (2026-04-03 16:06:30 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
24:14.098265938 (575h13m17.113935551s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.098831891 (575h13m17.114501506s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.099058352 (575h13m17.114727971s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.099461616 (575h13m17.11513122s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.099500194 (575h13m17.115169795s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.099989808 (575h13m17.11565942s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.100032457 (575h13m17.115702071s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.100377681 (575h13m17.116047288s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.100513196 (575h13m17.116182799s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.100984246 (575h13m17.116653902s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.101216587 (575h13m17.116886189s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.101442365 (575h13m17.117111966s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.101701277 (575h13m17.117370881s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.101844572 (575h13m17.117514184s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.102128723 (575h13m17.117798352s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.102543800 (575h13m17.118213402s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.102912469 (575h13m17.118582073s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.654255388 (575h13m17.66992499s) [upload=552424]: Next returned nil segment
Apr 3 15:24:14.654276756 (575h13m17.669946361s) [upload=552424]: Waiting for error group managing segments...
Apr 3 15:24:14.804527655 (575h13m17.820197259s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:14.838399330 (575h13m17.854068932s) [noise=true , address=77.90.31.21:4903 , piece_id=36XTH3NLLEUBWFFQKVNHMUFK625M27I2SMS6Z2XG6IJIZMCY4DFQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:15.955952569 (575h13m18.971622182s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:17.252252820 (575h13m20.267922421s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:19.171247616 (575h13m22.186917217s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:19.217203345 (575h13m22.232872952s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:19.612521688 (575h13m22.628191289s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:22.414814811 (575h13m25.430484415s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:23.372257597 (575h13m26.387927189s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:26.665681955 (575h13m29.681351555s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:29.460066298 (575h13m32.475735909s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:30.385795001 (575h13m33.401464603s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:30.927622980 (575h13m33.943292592s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:33.534990842 (575h13m36.550660448s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:33.535026340 (575h13m36.550695943s) [seg_pos={0 0}, upload=552424]: Satisfied cohort requirements after 14 pieces
Apr 3 15:24:33.535257561 (575h13m36.550927173s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gsNGvM8oKL9Fw1KLTrtpANYVozX2KGDDtL5BUmDhL9GDeFGof): protocol: expected piece hash; context canceled; EOF
Apr 3 15:24:33.535265871 (575h13m36.550935474s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold
Apr 3 15:24:33.535403914 (575h13m36.551073528s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Apr 3 15:24:33.535421314 (575h13m36.551090929s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold
Apr 3 15:24:33.535725819 (575h13m36.55139543s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ziK1cLtCwq29Ep2kNhnuy7vSwr5Qk3tdgtERxnz2WRVS4XFvx): protocol: expected piece hash; context canceled; EOF
Apr 3 15:24:33.535735892 (575h13m36.551405504s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold
Apr 3 15:24:33.535945878 (575h13m36.551615492s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSW1FsGdLjuXrE6eBo5suP7RHKv9uTUUenQWbCMFWWRcqoP9T): protocol: expected piece hash; context canceled; EOF
Apr 3 15:24:33.535961214 (575h13m36.551630824s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold
Apr 3 15:24:33.536141603 (575h13m36.551811196s) [seg_pos={0 0}, upload=552424]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 3 15:24:33.536421191 (575h13m36.552090785s) [upload=552424]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 3 15:24:33.536463199 (575h13m36.552132807s) [upload=552424]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 3 15:24:33.683231351 (575h13m36.698900952s) [upload=552424]: Done uploading segments...
Apr 3 15:24:33.683270427 (575h13m36.698940027s) [upload=552424]: Upload finished. err: <nil>
Duration: 3.039007911s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [..X........................................X................] duration:
1.668471068s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:05:52 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.668484898s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
3.102772731s trace:
https://jaeger.dev.storj.io/trace/c036a4f2d71a778
FAIL (2026-04-03 16:05:47 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
24:14.098265938 (575h13m17.113935551s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.098831891 (575h13m17.114501506s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.099058352 (575h13m17.114727971s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.099461616 (575h13m17.11513122s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.099500194 (575h13m17.115169795s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.099989808 (575h13m17.11565942s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.100032457 (575h13m17.115702071s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.100377681 (575h13m17.116047288s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.100513196 (575h13m17.116182799s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.100984246 (575h13m17.116653902s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.101216587 (575h13m17.116886189s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.101442365 (575h13m17.117111966s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.101701277 (575h13m17.117370881s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.101844572 (575h13m17.117514184s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.102128723 (575h13m17.117798352s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.102543800 (575h13m17.118213402s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.102912469 (575h13m17.118582073s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.654255388 (575h13m17.66992499s) [upload=552424]: Next returned nil segment
Apr 3 15:24:14.654276756 (575h13m17.669946361s) [upload=552424]: Waiting for error group managing segments...
Apr 3 15:24:14.804527655 (575h13m17.820197259s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:14.838399330 (575h13m17.854068932s) [noise=true , address=77.90.31.21:4903 , piece_id=36XTH3NLLEUBWFFQKVNHMUFK625M27I2SMS6Z2XG6IJIZMCY4DFQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:15.955952569 (575h13m18.971622182s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:17.252252820 (575h13m20.267922421s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:19.171247616 (575h13m22.186917217s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:19.217203345 (575h13m22.232872952s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:19.612521688 (575h13m22.628191289s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:22.414814811 (575h13m25.430484415s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:23.372257597 (575h13m26.387927189s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:26.665681955 (575h13m29.681351555s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:29.460066298 (575h13m32.475735909s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:30.385795001 (575h13m33.401464603s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:30.927622980 (575h13m33.943292592s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:33.534990842 (575h13m36.550660448s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:33.535026340 (575h13m36.550695943s) [seg_pos={0 0}, upload=552424]: Satisfied cohort requirements after 14 pieces
Apr 3 15:24:33.535257561 (575h13m36.550927173s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gsNGvM8oKL9Fw1KLTrtpANYVozX2KGDDtL5BUmDhL9GDeFGof): protocol: expected piece hash; context canceled; EOF
Apr 3 15:24:33.535265871 (575h13m36.550935474s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold
Apr 3 15:24:33.535403914 (575h13m36.551073528s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Apr 3 15:24:33.535421314 (575h13m36.551090929s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold
Apr 3 15:24:33.535725819 (575h13m36.55139543s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ziK1cLtCwq29Ep2kNhnuy7vSwr5Qk3tdgtERxnz2WRVS4XFvx): protocol: expected piece hash; context canceled; EOF
Apr 3 15:24:33.535735892 (575h13m36.551405504s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold
Apr 3 15:24:33.535945878 (575h13m36.551615492s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSW1FsGdLjuXrE6eBo5suP7RHKv9uTUUenQWbCMFWWRcqoP9T): protocol: expected piece hash; context canceled; EOF
Apr 3 15:24:33.535961214 (575h13m36.551630824s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold
Apr 3 15:24:33.536141603 (575h13m36.551811196s) [seg_pos={0 0}, upload=552424]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 3 15:24:33.536421191 (575h13m36.552090785s) [upload=552424]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 3 15:24:33.536463199 (575h13m36.552132807s) [upload=552424]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 3 15:24:33.683231351 (575h13m36.698900952s) [upload=552424]: Done uploading segments...
Apr 3 15:24:33.683270427 (575h13m36.698940027s) [upload=552424]: Upload finished. err: <nil>
Duration: 3.10280275s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [...X........................................X...............] duration:
1.583779908s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:04:55 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.583810287s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
3.025721263s trace:
https://jaeger.dev.storj.io/trace/c036a4f2d71a778
FAIL (2026-04-03 16:04:36 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
24:14.098265938 (575h13m17.113935551s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.098831891 (575h13m17.114501506s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.099058352 (575h13m17.114727971s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.099461616 (575h13m17.11513122s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.099500194 (575h13m17.115169795s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.099989808 (575h13m17.11565942s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.100032457 (575h13m17.115702071s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.100377681 (575h13m17.116047288s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.100513196 (575h13m17.116182799s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.100984246 (575h13m17.116653902s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.101216587 (575h13m17.116886189s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.101442365 (575h13m17.117111966s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.101701277 (575h13m17.117370881s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.101844572 (575h13m17.117514184s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.102128723 (575h13m17.117798352s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.102543800 (575h13m17.118213402s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.102912469 (575h13m17.118582073s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.654255388 (575h13m17.66992499s) [upload=552424]: Next returned nil segment
Apr 3 15:24:14.654276756 (575h13m17.669946361s) [upload=552424]: Waiting for error group managing segments...
Apr 3 15:24:14.804527655 (575h13m17.820197259s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:14.838399330 (575h13m17.854068932s) [noise=true , address=77.90.31.21:4903 , piece_id=36XTH3NLLEUBWFFQKVNHMUFK625M27I2SMS6Z2XG6IJIZMCY4DFQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:15.955952569 (575h13m18.971622182s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:17.252252820 (575h13m20.267922421s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:19.171247616 (575h13m22.186917217s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:19.217203345 (575h13m22.232872952s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:19.612521688 (575h13m22.628191289s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:22.414814811 (575h13m25.430484415s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:23.372257597 (575h13m26.387927189s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:26.665681955 (575h13m29.681351555s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:29.460066298 (575h13m32.475735909s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:30.385795001 (575h13m33.401464603s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:30.927622980 (575h13m33.943292592s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:33.534990842 (575h13m36.550660448s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:33.535026340 (575h13m36.550695943s) [seg_pos={0 0}, upload=552424]: Satisfied cohort requirements after 14 pieces
Apr 3 15:24:33.535257561 (575h13m36.550927173s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gsNGvM8oKL9Fw1KLTrtpANYVozX2KGDDtL5BUmDhL9GDeFGof): protocol: expected piece hash; context canceled; EOF
Apr 3 15:24:33.535265871 (575h13m36.550935474s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold
Apr 3 15:24:33.535403914 (575h13m36.551073528s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Apr 3 15:24:33.535421314 (575h13m36.551090929s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold
Apr 3 15:24:33.535725819 (575h13m36.55139543s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ziK1cLtCwq29Ep2kNhnuy7vSwr5Qk3tdgtERxnz2WRVS4XFvx): protocol: expected piece hash; context canceled; EOF
Apr 3 15:24:33.535735892 (575h13m36.551405504s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold
Apr 3 15:24:33.535945878 (575h13m36.551615492s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSW1FsGdLjuXrE6eBo5suP7RHKv9uTUUenQWbCMFWWRcqoP9T): protocol: expected piece hash; context canceled; EOF
Apr 3 15:24:33.535961214 (575h13m36.551630824s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold
Apr 3 15:24:33.536141603 (575h13m36.551811196s) [seg_pos={0 0}, upload=552424]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 3 15:24:33.536421191 (575h13m36.552090785s) [upload=552424]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 3 15:24:33.536463199 (575h13m36.552132807s) [upload=552424]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 3 15:24:33.683231351 (575h13m36.698900952s) [upload=552424]: Done uploading segments...
Apr 3 15:24:33.683270427 (575h13m36.698940027s) [upload=552424]: Upload finished. err: <nil>
Duration: 3.02575694s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.751416085s trace:
https://jaeger.dev.storj.io/trace/c036a4f2d71a778
FAIL (2026-04-03 16:04:13 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
24:14.098265938 (575h13m17.113935551s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.098831891 (575h13m17.114501506s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.099058352 (575h13m17.114727971s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.099461616 (575h13m17.11513122s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.099500194 (575h13m17.115169795s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.099989808 (575h13m17.11565942s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.100032457 (575h13m17.115702071s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.100377681 (575h13m17.116047288s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.100513196 (575h13m17.116182799s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.100984246 (575h13m17.116653902s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.101216587 (575h13m17.116886189s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.101442365 (575h13m17.117111966s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.101701277 (575h13m17.117370881s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.101844572 (575h13m17.117514184s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.102128723 (575h13m17.117798352s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.102543800 (575h13m17.118213402s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.102912469 (575h13m17.118582073s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.654255388 (575h13m17.66992499s) [upload=552424]: Next returned nil segment
Apr 3 15:24:14.654276756 (575h13m17.669946361s) [upload=552424]: Waiting for error group managing segments...
Apr 3 15:24:14.804527655 (575h13m17.820197259s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:14.838399330 (575h13m17.854068932s) [noise=true , address=77.90.31.21:4903 , piece_id=36XTH3NLLEUBWFFQKVNHMUFK625M27I2SMS6Z2XG6IJIZMCY4DFQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:15.955952569 (575h13m18.971622182s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:17.252252820 (575h13m20.267922421s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:19.171247616 (575h13m22.186917217s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:19.217203345 (575h13m22.232872952s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:19.612521688 (575h13m22.628191289s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:22.414814811 (575h13m25.430484415s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:23.372257597 (575h13m26.387927189s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:26.665681955 (575h13m29.681351555s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:29.460066298 (575h13m32.475735909s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:30.385795001 (575h13m33.401464603s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:30.927622980 (575h13m33.943292592s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:33.534990842 (575h13m36.550660448s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:33.535026340 (575h13m36.550695943s) [seg_pos={0 0}, upload=552424]: Satisfied cohort requirements after 14 pieces
Apr 3 15:24:33.535257561 (575h13m36.550927173s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gsNGvM8oKL9Fw1KLTrtpANYVozX2KGDDtL5BUmDhL9GDeFGof): protocol: expected piece hash; context canceled; EOF
Apr 3 15:24:33.535265871 (575h13m36.550935474s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold
Apr 3 15:24:33.535403914 (575h13m36.551073528s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Apr 3 15:24:33.535421314 (575h13m36.551090929s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold
Apr 3 15:24:33.535725819 (575h13m36.55139543s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ziK1cLtCwq29Ep2kNhnuy7vSwr5Qk3tdgtERxnz2WRVS4XFvx): protocol: expected piece hash; context canceled; EOF
Apr 3 15:24:33.535735892 (575h13m36.551405504s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold
Apr 3 15:24:33.535945878 (575h13m36.551615492s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSW1FsGdLjuXrE6eBo5suP7RHKv9uTUUenQWbCMFWWRcqoP9T): protocol: expected piece hash; context canceled; EOF
Apr 3 15:24:33.535961214 (575h13m36.551630824s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold
Apr 3 15:24:33.536141603 (575h13m36.551811196s) [seg_pos={0 0}, upload=552424]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 3 15:24:33.536421191 (575h13m36.552090785s) [upload=552424]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 3 15:24:33.536463199 (575h13m36.552132807s) [upload=552424]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 3 15:24:33.683231351 (575h13m36.698900952s) [upload=552424]: Done uploading segments...
Apr 3 15:24:33.683270427 (575h13m36.698940027s) [upload=552424]: Upload finished. err: <nil>
Duration: 2.751444596s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [....X........................................X..............] duration:
1.743263258s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:04:04 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.743300156s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.938990927s trace:
https://jaeger.dev.storj.io/trace/c036a4f2d71a778
FAIL (2026-04-03 16:03:40 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
24:14.098265938 (575h13m17.113935551s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.098831891 (575h13m17.114501506s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.099058352 (575h13m17.114727971s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.099461616 (575h13m17.11513122s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.099500194 (575h13m17.115169795s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.099989808 (575h13m17.11565942s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.100032457 (575h13m17.115702071s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.100377681 (575h13m17.116047288s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.100513196 (575h13m17.116182799s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.100984246 (575h13m17.116653902s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.101216587 (575h13m17.116886189s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.101442365 (575h13m17.117111966s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.101701277 (575h13m17.117370881s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.101844572 (575h13m17.117514184s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.102128723 (575h13m17.117798352s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.102543800 (575h13m17.118213402s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.102912469 (575h13m17.118582073s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Uploading piece...
Apr 3 15:24:14.654255388 (575h13m17.66992499s) [upload=552424]: Next returned nil segment
Apr 3 15:24:14.654276756 (575h13m17.669946361s) [upload=552424]: Waiting for error group managing segments...
Apr 3 15:24:14.804527655 (575h13m17.820197259s) [noise=true , address=77.90.31.16:4745 , piece_id=A3WUTZNH4IBVVRCSVDJMBYHMMETDNQQRQ7UJBTDLMFLC4GQ6ROBA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:14.838399330 (575h13m17.854068932s) [noise=true , address=77.90.31.21:4903 , piece_id=36XTH3NLLEUBWFFQKVNHMUFK625M27I2SMS6Z2XG6IJIZMCY4DFQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:15.955952569 (575h13m18.971622182s) [noise=true , address=145.79.227.33:4897 , piece_id=WTVVSS2GM7YPZE3I52MIOYU4VPC6UX4N6QXTQK7FLTJSLMMEN4EA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:17.252252820 (575h13m20.267922421s) [noise=true , address=145.79.227.13:4818 , piece_id=EQ53LKD3QL6V52AJAELQBSR4EDULR32X2VY5EIV74JE4VTSEBKWQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:19.171247616 (575h13m22.186917217s) [noise=true , address=64.49.13.140:4506 , piece_id=3MCEL6K22E3ZR3RMRSOBBXFTRL7D2EJYGGTQSV6X3E2TJJYJBROA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:19.217203345 (575h13m22.232872952s) [noise=true , address=77.90.31.10:4542 , piece_id=2OEIKYWWNAR2HY4ILG2RTOTSYOP5PJHOW4PAUM2PRO7P6NMHT6MQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:19.612521688 (575h13m22.628191289s) [noise=true , address=45.91.116.13:4183 , piece_id=6LQYYMIZQMTVFE7PGX7ZL6V74DET6BG3NI4V74NVNVWLA3CQOP4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:22.414814811 (575h13m25.430484415s) [noise=true , address=45.91.116.7:4025 , piece_id=W4ALSH5GEHBRMFGP65P3UBKKZ7NTV2TBR7YPV5544TCG7J5XQWVA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:23.372257597 (575h13m26.387927189s) [noise=true , address=45.91.116.11:4133 , piece_id=NBNECP3KBWKATL7YZWQMPI3GVAUSNPN4NQNXF22BWCTW42WU73OQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:26.665681955 (575h13m29.681351555s) [noise=true , address=193.149.164.67:4010 , piece_id=JSL7EFOTNVHRNKXHP4UFSQLPOZPNMGALMGP62YBFT67BFOYTBRCQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:29.460066298 (575h13m32.475735909s) [noise=true , address=45.91.116.14:4210 , piece_id=TSDSSLPLD5OFIHMJXF7KOKUZIHF7JHRGAUZUUAXCUNCUUUCXEE4A, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:30.385795001 (575h13m33.401464603s) [noise=true , address=64.49.13.169:4706 , piece_id=EEYMZ4KZQXBGY4M3IVP72XY43DE4PWWQUVWJPMROFCTW243HUQVQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:30.927622980 (575h13m33.943292592s) [noise=true , address=193.149.164.69:4075 , piece_id=MZKPRYEXEDIY24H3UEPYJFYMZDFG3HSTKI43F37B64GMLTNWUL5Q, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:33.534990842 (575h13m36.550660448s) [noise=true , address=193.149.164.66:4980 , piece_id=AQJ3HP6H2IMCHPLZ7EFJQNFJKG2JCMXMOC24H4SHALYKUHG7FLIA, seg_pos={0 0}, upload=552424]: Done uploading piece. err: <nil>
Apr 3 15:24:33.535026340 (575h13m36.550695943s) [seg_pos={0 0}, upload=552424]: Satisfied cohort requirements after 14 pieces
Apr 3 15:24:33.535257561 (575h13m36.550927173s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gsNGvM8oKL9Fw1KLTrtpANYVozX2KGDDtL5BUmDhL9GDeFGof): protocol: expected piece hash; context canceled; EOF
Apr 3 15:24:33.535265871 (575h13m36.550935474s) [noise=true , address=45.91.116.5:4319 , piece_id=FJCYG63AKPCE6UDM5NWNE6AEYRDK6HCP2SU32NZNQVMEMXI2LWRQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold
Apr 3 15:24:33.535403914 (575h13m36.551073528s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Apr 3 15:24:33.535421314 (575h13m36.551090929s) [noise=true , address=145.79.227.38:4984 , piece_id=6ZHRHZRHOGK7T2VCQWQFLKZDH2EN5DIXWNKZ7MINSSPY3ARR5GBQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold
Apr 3 15:24:33.535725819 (575h13m36.55139543s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ziK1cLtCwq29Ep2kNhnuy7vSwr5Qk3tdgtERxnz2WRVS4XFvx): protocol: expected piece hash; context canceled; EOF
Apr 3 15:24:33.535735892 (575h13m36.551405504s) [noise=true , address=193.149.164.68:4063 , piece_id=S23R6I4BKMZ34CDB3ZB6IKDJFAHAQN5FAIDGIPZFUFJ2T6UW4GHQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold
Apr 3 15:24:33.535945878 (575h13m36.551615492s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vSW1FsGdLjuXrE6eBo5suP7RHKv9uTUUenQWbCMFWWRcqoP9T): protocol: expected piece hash; context canceled; EOF
Apr 3 15:24:33.535961214 (575h13m36.551630824s) [noise=true , address=193.149.164.70:4137 , piece_id=2NJOIDG52XMYU3URSFRSEQE4LDAHIVQMC4WJQUYFLCB6FXIC47FQ, seg_pos={0 0}, upload=552424]: Long tail cancellation due to optimal threshold
Apr 3 15:24:33.536141603 (575h13m36.551811196s) [seg_pos={0 0}, upload=552424]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 3 15:24:33.536421191 (575h13m36.552090785s) [upload=552424]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 3 15:24:33.536463199 (575h13m36.552132807s) [upload=552424]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 3 15:24:33.683231351 (575h13m36.698900952s) [upload=552424]: Done uploading segments...
Apr 3 15:24:33.683270427 (575h13m36.698940027s) [upload=552424]: Upload finished. err: <nil>
Duration: 2.93902432s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [.....X........................................X.............] duration:
1.719827903s trace:
https://jaeger.dev.storj.io/trace/6972825919f640d8
FAIL (2026-04-03 16:03:23 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.719860186s
core
uplink
us-select-1
us1-placement-20
|