Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
1.113029539s
FAIL (2025-10-07 11:16:42 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 1.113067879s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
927.578899ms
FAIL (2025-10-07 11:16:01 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 927.617269ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
1.110305763s
FAIL (2025-10-07 11:15:36 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 1.110355405s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
892.791762ms
FAIL (2025-10-07 11:14:59 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 892.825918ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
1.242901783s
FAIL (2025-10-07 11:14:27 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 1.242937819s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
841.265028ms
FAIL (2025-10-07 11:13:33 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 841.295866ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
938.313974ms
FAIL (2025-10-07 11:12:18 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 938.33575ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
988.94243ms
FAIL (2025-10-07 11:11:21 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 988.973567ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
1.138986372s
FAIL (2025-10-07 11:10:46 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 1.139016176s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
1.031368084s
FAIL (2025-10-07 11:09:37 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 1.031394842s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
957.70099ms
FAIL (2025-10-07 11:08:27 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 957.740267ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
1.056537156s
FAIL (2025-10-07 11:07:15 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 1.056572023s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
919.080949ms
FAIL (2025-10-07 11:06:58 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 919.209853ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
1.040474074s
FAIL (2025-10-07 11:06:26 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 1.040505207s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
935.876493ms
FAIL (2025-10-07 11:05:40 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 935.905575ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
1.094206414s
FAIL (2025-10-07 11:05:08 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 1.094240772s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
1.52272292s
FAIL (2025-10-07 11:04:12 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 1.522769164s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
1.164173683s
FAIL (2025-10-07 11:03:07 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 1.164202919s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
993.686114ms
FAIL (2025-10-07 11:02:31 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 993.714936ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
926.529921ms
FAIL (2025-10-07 11:01:35 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 926.562958ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
955.182416ms
FAIL (2025-10-07 11:00:52 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 955.221435ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
1.32066246s
FAIL (2025-10-07 11:00:04 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 1.320698773s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
1.216235812s
FAIL (2025-10-07 10:59:42 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 1.216277687s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
967.613308ms
FAIL (2025-10-07 10:58:39 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 967.643523ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
1.158821309s
FAIL (2025-10-07 10:58:02 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 1.158856919s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.421347599s
FAIL (2025-10-07 10:57:38 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 2.421410905s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
1.172114499s
FAIL (2025-10-07 10:57:05 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 1.172153502s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.446857331s
FAIL (2025-10-07 10:56:59 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 2.446898672s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
982.044255ms
FAIL (2025-10-07 10:56:22 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 982.078762ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.297354535s
FAIL (2025-10-07 10:56:11 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 2.297451832s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.164856002s
FAIL (2025-10-07 10:55:49 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 2.164891801s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
1.114371326s
FAIL (2025-10-07 10:55:46 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 1.114428794s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
1.017306927s
FAIL (2025-10-07 10:55:29 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 1.017338002s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
2 out of 60 is failed (threshold=3) [X...X.......................................................] duration:
2.141789429s
FAIL (2025-10-07 10:55:24 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 2.141824129s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.426906915s
FAIL (2025-10-07 10:55:19 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 7 10:12:07.306656774 (332h41m55.110121353s) [upload=292729]: Starting upload
Oct 7 10:12:07.306794557 (332h41m55.110259153s) [upload=292729]: Done starting upload
Oct 7 10:12:07.306959891 (332h41m55.110424468s) [upload=292729]: Uploading segments...
Oct 7 10:12:07.307411836 (332h41m55.110876417s) [upload=292729]: Got next segment. Inline: false
Oct 7 10:12:07.307485009 (332h41m55.110949602s) [upload=292729]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 7 10:12:07.307492302 (332h41m55.110956903s) [upload=292729]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 7 10:12:07.540963169 (332h41m55.344427762s) [seg_pos={0 0}, upload=292729]: Begin upload segment...
Oct 7 10:12:07.541037655 (332h41m55.344502238s) [seg_pos={0 0}, upload=292729]: Done begin upload segment.
Oct 7 10:12:07.541074187 (332h41m55.344538809s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.541090713 (332h41m55.344555316s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.541784911 (332h41m55.345249515s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.542309311 (332h41m55.345773916s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.542796975 (332h41m55.346261578s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.543247199 (332h41m55.346711802s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.543739269 (332h41m55.347203872s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.544225902 (332h41m55.347690502s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.544709310 (332h41m55.34817391s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.545163687 (332h41m55.348628289s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.546029033 (332h41m55.349493633s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.546617358 (332h41m55.350081961s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.547493041 (332h41m55.350957635s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.548088795 (332h41m55.351553395s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.548847836 (332h41m55.35231244s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.548913768 (332h41m55.352378353s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:08.170536647 (332h41m55.974001241s) [upload=292729]: Next returned nil segment
Oct 7 10:12:08.170559840 (332h41m55.974024475s) [upload=292729]: Waiting for error group managing segments...
Oct 7 10:12:08.304430668 (332h41m56.107895265s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.305363185 (332h41m56.108827777s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.306700170 (332h41m56.110164754s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.307067518 (332h41m56.110532104s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.308741631 (332h41m56.112206216s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.309537153 (332h41m56.113001742s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.310340574 (332h41m56.113805153s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.311182954 (332h41m56.11464754s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.313196428 (332h41m56.116661024s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.318452659 (332h41m56.121917244s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.328737265 (332h41m56.132201846s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.328934722 (332h41m56.132399301s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.329976841 (332h41m56.133441425s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.330015374 (332h41m56.133479965s) [seg_pos={0 0}, upload=292729]: Segment reached optimal threshold of 13 pieces.
Oct 7 10:12:08.330183190 (332h41m56.133647782s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF
Oct 7 10:12:08.330193562 (332h41m56.133658159s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold
Oct 7 10:12:08.330288373 (332h41m56.133752965s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF
Oct 7 10:12:08.330294885 (332h41m56.133759477s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold
Oct 7 10:12:08.330452305 (332h41m56.13391691s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF
Oct 7 10:12:08.330464871 (332h41m56.133929473s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold
Oct 7 10:12:08.330492924 (332h41m56.133957517s) [seg_pos={0 0}, upload=292729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 7 10:12:08.330636956 (332h41m56.134101547s) [upload=292729]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 7 10:12:08.330650493 (332h41m56.134115078s) [upload=292729]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 7 10:13:06.461738970 (332h42m54.265203553s) [upload=292729]: Done uploading segments...
Oct 7 10:13:06.461768088 (332h42m54.265232682s) [upload=292729]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.426938202s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.494660182s
FAIL (2025-10-07 10:54:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 7 10:12:07.306656774 (332h41m55.110121353s) [upload=292729]: Starting upload
Oct 7 10:12:07.306794557 (332h41m55.110259153s) [upload=292729]: Done starting upload
Oct 7 10:12:07.306959891 (332h41m55.110424468s) [upload=292729]: Uploading segments...
Oct 7 10:12:07.307411836 (332h41m55.110876417s) [upload=292729]: Got next segment. Inline: false
Oct 7 10:12:07.307485009 (332h41m55.110949602s) [upload=292729]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 7 10:12:07.307492302 (332h41m55.110956903s) [upload=292729]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 7 10:12:07.540963169 (332h41m55.344427762s) [seg_pos={0 0}, upload=292729]: Begin upload segment...
Oct 7 10:12:07.541037655 (332h41m55.344502238s) [seg_pos={0 0}, upload=292729]: Done begin upload segment.
Oct 7 10:12:07.541074187 (332h41m55.344538809s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.541090713 (332h41m55.344555316s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.541784911 (332h41m55.345249515s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.542309311 (332h41m55.345773916s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.542796975 (332h41m55.346261578s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.543247199 (332h41m55.346711802s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.543739269 (332h41m55.347203872s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.544225902 (332h41m55.347690502s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.544709310 (332h41m55.34817391s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.545163687 (332h41m55.348628289s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.546029033 (332h41m55.349493633s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.546617358 (332h41m55.350081961s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.547493041 (332h41m55.350957635s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.548088795 (332h41m55.351553395s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.548847836 (332h41m55.35231244s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.548913768 (332h41m55.352378353s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:08.170536647 (332h41m55.974001241s) [upload=292729]: Next returned nil segment
Oct 7 10:12:08.170559840 (332h41m55.974024475s) [upload=292729]: Waiting for error group managing segments...
Oct 7 10:12:08.304430668 (332h41m56.107895265s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.305363185 (332h41m56.108827777s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.306700170 (332h41m56.110164754s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.307067518 (332h41m56.110532104s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.308741631 (332h41m56.112206216s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.309537153 (332h41m56.113001742s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.310340574 (332h41m56.113805153s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.311182954 (332h41m56.11464754s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.313196428 (332h41m56.116661024s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.318452659 (332h41m56.121917244s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.328737265 (332h41m56.132201846s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.328934722 (332h41m56.132399301s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.329976841 (332h41m56.133441425s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.330015374 (332h41m56.133479965s) [seg_pos={0 0}, upload=292729]: Segment reached optimal threshold of 13 pieces.
Oct 7 10:12:08.330183190 (332h41m56.133647782s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF
Oct 7 10:12:08.330193562 (332h41m56.133658159s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold
Oct 7 10:12:08.330288373 (332h41m56.133752965s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF
Oct 7 10:12:08.330294885 (332h41m56.133759477s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold
Oct 7 10:12:08.330452305 (332h41m56.13391691s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF
Oct 7 10:12:08.330464871 (332h41m56.133929473s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold
Oct 7 10:12:08.330492924 (332h41m56.133957517s) [seg_pos={0 0}, upload=292729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 7 10:12:08.330636956 (332h41m56.134101547s) [upload=292729]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 7 10:12:08.330650493 (332h41m56.134115078s) [upload=292729]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 7 10:13:06.461738970 (332h42m54.265203553s) [upload=292729]: Done uploading segments...
Oct 7 10:13:06.461768088 (332h42m54.265232682s) [upload=292729]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.494708209s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
1.005803834s
FAIL (2025-10-07 10:54:47 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 1.006060461s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
1.058823929s
FAIL (2025-10-07 10:54:30 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 1.058877273s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X...X......................................................] duration:
1.949723909s
FAIL (2025-10-07 10:54:12 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 1.949755419s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X...X.....................................................] duration:
2.186532965s
FAIL (2025-10-07 10:53:53 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 2.186569831s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.410760432s
FAIL (2025-10-07 10:53:45 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 7 10:12:07.306656774 (332h41m55.110121353s) [upload=292729]: Starting upload
Oct 7 10:12:07.306794557 (332h41m55.110259153s) [upload=292729]: Done starting upload
Oct 7 10:12:07.306959891 (332h41m55.110424468s) [upload=292729]: Uploading segments...
Oct 7 10:12:07.307411836 (332h41m55.110876417s) [upload=292729]: Got next segment. Inline: false
Oct 7 10:12:07.307485009 (332h41m55.110949602s) [upload=292729]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 7 10:12:07.307492302 (332h41m55.110956903s) [upload=292729]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 7 10:12:07.540963169 (332h41m55.344427762s) [seg_pos={0 0}, upload=292729]: Begin upload segment...
Oct 7 10:12:07.541037655 (332h41m55.344502238s) [seg_pos={0 0}, upload=292729]: Done begin upload segment.
Oct 7 10:12:07.541074187 (332h41m55.344538809s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.541090713 (332h41m55.344555316s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.541784911 (332h41m55.345249515s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.542309311 (332h41m55.345773916s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.542796975 (332h41m55.346261578s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.543247199 (332h41m55.346711802s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.543739269 (332h41m55.347203872s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.544225902 (332h41m55.347690502s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.544709310 (332h41m55.34817391s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.545163687 (332h41m55.348628289s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.546029033 (332h41m55.349493633s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.546617358 (332h41m55.350081961s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.547493041 (332h41m55.350957635s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.548088795 (332h41m55.351553395s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.548847836 (332h41m55.35231244s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.548913768 (332h41m55.352378353s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:08.170536647 (332h41m55.974001241s) [upload=292729]: Next returned nil segment
Oct 7 10:12:08.170559840 (332h41m55.974024475s) [upload=292729]: Waiting for error group managing segments...
Oct 7 10:12:08.304430668 (332h41m56.107895265s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.305363185 (332h41m56.108827777s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.306700170 (332h41m56.110164754s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.307067518 (332h41m56.110532104s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.308741631 (332h41m56.112206216s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.309537153 (332h41m56.113001742s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.310340574 (332h41m56.113805153s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.311182954 (332h41m56.11464754s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.313196428 (332h41m56.116661024s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.318452659 (332h41m56.121917244s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.328737265 (332h41m56.132201846s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.328934722 (332h41m56.132399301s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.329976841 (332h41m56.133441425s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.330015374 (332h41m56.133479965s) [seg_pos={0 0}, upload=292729]: Segment reached optimal threshold of 13 pieces.
Oct 7 10:12:08.330183190 (332h41m56.133647782s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF
Oct 7 10:12:08.330193562 (332h41m56.133658159s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold
Oct 7 10:12:08.330288373 (332h41m56.133752965s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF
Oct 7 10:12:08.330294885 (332h41m56.133759477s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold
Oct 7 10:12:08.330452305 (332h41m56.13391691s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF
Oct 7 10:12:08.330464871 (332h41m56.133929473s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold
Oct 7 10:12:08.330492924 (332h41m56.133957517s) [seg_pos={0 0}, upload=292729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 7 10:12:08.330636956 (332h41m56.134101547s) [upload=292729]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 7 10:12:08.330650493 (332h41m56.134115078s) [upload=292729]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 7 10:13:06.461738970 (332h42m54.265203553s) [upload=292729]: Done uploading segments...
Oct 7 10:13:06.461768088 (332h42m54.265232682s) [upload=292729]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.410797825s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.380199167s
FAIL (2025-10-07 10:53:29 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 7 10:12:07.306656774 (332h41m55.110121353s) [upload=292729]: Starting upload
Oct 7 10:12:07.306794557 (332h41m55.110259153s) [upload=292729]: Done starting upload
Oct 7 10:12:07.306959891 (332h41m55.110424468s) [upload=292729]: Uploading segments...
Oct 7 10:12:07.307411836 (332h41m55.110876417s) [upload=292729]: Got next segment. Inline: false
Oct 7 10:12:07.307485009 (332h41m55.110949602s) [upload=292729]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 7 10:12:07.307492302 (332h41m55.110956903s) [upload=292729]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 7 10:12:07.540963169 (332h41m55.344427762s) [seg_pos={0 0}, upload=292729]: Begin upload segment...
Oct 7 10:12:07.541037655 (332h41m55.344502238s) [seg_pos={0 0}, upload=292729]: Done begin upload segment.
Oct 7 10:12:07.541074187 (332h41m55.344538809s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.541090713 (332h41m55.344555316s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.541784911 (332h41m55.345249515s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.542309311 (332h41m55.345773916s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.542796975 (332h41m55.346261578s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.543247199 (332h41m55.346711802s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.543739269 (332h41m55.347203872s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.544225902 (332h41m55.347690502s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.544709310 (332h41m55.34817391s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.545163687 (332h41m55.348628289s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.546029033 (332h41m55.349493633s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.546617358 (332h41m55.350081961s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.547493041 (332h41m55.350957635s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.548088795 (332h41m55.351553395s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.548847836 (332h41m55.35231244s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.548913768 (332h41m55.352378353s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:08.170536647 (332h41m55.974001241s) [upload=292729]: Next returned nil segment
Oct 7 10:12:08.170559840 (332h41m55.974024475s) [upload=292729]: Waiting for error group managing segments...
Oct 7 10:12:08.304430668 (332h41m56.107895265s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.305363185 (332h41m56.108827777s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.306700170 (332h41m56.110164754s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.307067518 (332h41m56.110532104s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.308741631 (332h41m56.112206216s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.309537153 (332h41m56.113001742s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.310340574 (332h41m56.113805153s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.311182954 (332h41m56.11464754s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.313196428 (332h41m56.116661024s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.318452659 (332h41m56.121917244s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.328737265 (332h41m56.132201846s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.328934722 (332h41m56.132399301s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.329976841 (332h41m56.133441425s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.330015374 (332h41m56.133479965s) [seg_pos={0 0}, upload=292729]: Segment reached optimal threshold of 13 pieces.
Oct 7 10:12:08.330183190 (332h41m56.133647782s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF
Oct 7 10:12:08.330193562 (332h41m56.133658159s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold
Oct 7 10:12:08.330288373 (332h41m56.133752965s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF
Oct 7 10:12:08.330294885 (332h41m56.133759477s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold
Oct 7 10:12:08.330452305 (332h41m56.13391691s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF
Oct 7 10:12:08.330464871 (332h41m56.133929473s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold
Oct 7 10:12:08.330492924 (332h41m56.133957517s) [seg_pos={0 0}, upload=292729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 7 10:12:08.330636956 (332h41m56.134101547s) [upload=292729]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 7 10:12:08.330650493 (332h41m56.134115078s) [upload=292729]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 7 10:13:06.461738970 (332h42m54.265203553s) [upload=292729]: Done uploading segments...
Oct 7 10:13:06.461768088 (332h42m54.265232682s) [upload=292729]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.380240347s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
1.23497034s
FAIL (2025-10-07 10:53:26 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 1.235008087s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X...X....................................................] duration:
1.865871193s
FAIL (2025-10-07 10:52:53 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 1.865908876s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.459762707s
FAIL (2025-10-07 10:52:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 7 10:12:07.306656774 (332h41m55.110121353s) [upload=292729]: Starting upload
Oct 7 10:12:07.306794557 (332h41m55.110259153s) [upload=292729]: Done starting upload
Oct 7 10:12:07.306959891 (332h41m55.110424468s) [upload=292729]: Uploading segments...
Oct 7 10:12:07.307411836 (332h41m55.110876417s) [upload=292729]: Got next segment. Inline: false
Oct 7 10:12:07.307485009 (332h41m55.110949602s) [upload=292729]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 7 10:12:07.307492302 (332h41m55.110956903s) [upload=292729]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 7 10:12:07.540963169 (332h41m55.344427762s) [seg_pos={0 0}, upload=292729]: Begin upload segment...
Oct 7 10:12:07.541037655 (332h41m55.344502238s) [seg_pos={0 0}, upload=292729]: Done begin upload segment.
Oct 7 10:12:07.541074187 (332h41m55.344538809s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.541090713 (332h41m55.344555316s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.541784911 (332h41m55.345249515s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.542309311 (332h41m55.345773916s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.542796975 (332h41m55.346261578s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.543247199 (332h41m55.346711802s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.543739269 (332h41m55.347203872s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.544225902 (332h41m55.347690502s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.544709310 (332h41m55.34817391s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.545163687 (332h41m55.348628289s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.546029033 (332h41m55.349493633s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.546617358 (332h41m55.350081961s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.547493041 (332h41m55.350957635s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.548088795 (332h41m55.351553395s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.548847836 (332h41m55.35231244s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.548913768 (332h41m55.352378353s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:08.170536647 (332h41m55.974001241s) [upload=292729]: Next returned nil segment
Oct 7 10:12:08.170559840 (332h41m55.974024475s) [upload=292729]: Waiting for error group managing segments...
Oct 7 10:12:08.304430668 (332h41m56.107895265s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.305363185 (332h41m56.108827777s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.306700170 (332h41m56.110164754s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.307067518 (332h41m56.110532104s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.308741631 (332h41m56.112206216s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.309537153 (332h41m56.113001742s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.310340574 (332h41m56.113805153s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.311182954 (332h41m56.11464754s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.313196428 (332h41m56.116661024s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.318452659 (332h41m56.121917244s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.328737265 (332h41m56.132201846s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.328934722 (332h41m56.132399301s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.329976841 (332h41m56.133441425s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.330015374 (332h41m56.133479965s) [seg_pos={0 0}, upload=292729]: Segment reached optimal threshold of 13 pieces.
Oct 7 10:12:08.330183190 (332h41m56.133647782s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF
Oct 7 10:12:08.330193562 (332h41m56.133658159s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold
Oct 7 10:12:08.330288373 (332h41m56.133752965s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF
Oct 7 10:12:08.330294885 (332h41m56.133759477s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold
Oct 7 10:12:08.330452305 (332h41m56.13391691s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF
Oct 7 10:12:08.330464871 (332h41m56.133929473s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold
Oct 7 10:12:08.330492924 (332h41m56.133957517s) [seg_pos={0 0}, upload=292729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 7 10:12:08.330636956 (332h41m56.134101547s) [upload=292729]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 7 10:12:08.330650493 (332h41m56.134115078s) [upload=292729]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 7 10:13:06.461738970 (332h42m54.265203553s) [upload=292729]: Done uploading segments...
Oct 7 10:13:06.461768088 (332h42m54.265232682s) [upload=292729]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.459810465s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
976.440152ms
FAIL (2025-10-07 10:52:25 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 976.471635ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.48938158s
FAIL (2025-10-07 10:51:59 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 7 10:12:07.306656774 (332h41m55.110121353s) [upload=292729]: Starting upload
Oct 7 10:12:07.306794557 (332h41m55.110259153s) [upload=292729]: Done starting upload
Oct 7 10:12:07.306959891 (332h41m55.110424468s) [upload=292729]: Uploading segments...
Oct 7 10:12:07.307411836 (332h41m55.110876417s) [upload=292729]: Got next segment. Inline: false
Oct 7 10:12:07.307485009 (332h41m55.110949602s) [upload=292729]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 7 10:12:07.307492302 (332h41m55.110956903s) [upload=292729]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 7 10:12:07.540963169 (332h41m55.344427762s) [seg_pos={0 0}, upload=292729]: Begin upload segment...
Oct 7 10:12:07.541037655 (332h41m55.344502238s) [seg_pos={0 0}, upload=292729]: Done begin upload segment.
Oct 7 10:12:07.541074187 (332h41m55.344538809s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.541090713 (332h41m55.344555316s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.541784911 (332h41m55.345249515s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.542309311 (332h41m55.345773916s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.542796975 (332h41m55.346261578s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.543247199 (332h41m55.346711802s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.543739269 (332h41m55.347203872s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.544225902 (332h41m55.347690502s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.544709310 (332h41m55.34817391s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.545163687 (332h41m55.348628289s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.546029033 (332h41m55.349493633s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.546617358 (332h41m55.350081961s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.547493041 (332h41m55.350957635s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.548088795 (332h41m55.351553395s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.548847836 (332h41m55.35231244s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.548913768 (332h41m55.352378353s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:08.170536647 (332h41m55.974001241s) [upload=292729]: Next returned nil segment
Oct 7 10:12:08.170559840 (332h41m55.974024475s) [upload=292729]: Waiting for error group managing segments...
Oct 7 10:12:08.304430668 (332h41m56.107895265s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.305363185 (332h41m56.108827777s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.306700170 (332h41m56.110164754s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.307067518 (332h41m56.110532104s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.308741631 (332h41m56.112206216s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.309537153 (332h41m56.113001742s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.310340574 (332h41m56.113805153s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.311182954 (332h41m56.11464754s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.313196428 (332h41m56.116661024s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.318452659 (332h41m56.121917244s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.328737265 (332h41m56.132201846s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.328934722 (332h41m56.132399301s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.329976841 (332h41m56.133441425s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.330015374 (332h41m56.133479965s) [seg_pos={0 0}, upload=292729]: Segment reached optimal threshold of 13 pieces.
Oct 7 10:12:08.330183190 (332h41m56.133647782s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF
Oct 7 10:12:08.330193562 (332h41m56.133658159s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold
Oct 7 10:12:08.330288373 (332h41m56.133752965s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF
Oct 7 10:12:08.330294885 (332h41m56.133759477s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold
Oct 7 10:12:08.330452305 (332h41m56.13391691s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF
Oct 7 10:12:08.330464871 (332h41m56.133929473s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold
Oct 7 10:12:08.330492924 (332h41m56.133957517s) [seg_pos={0 0}, upload=292729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 7 10:12:08.330636956 (332h41m56.134101547s) [upload=292729]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 7 10:12:08.330650493 (332h41m56.134115078s) [upload=292729]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 7 10:13:06.461738970 (332h42m54.265203553s) [upload=292729]: Done uploading segments...
Oct 7 10:13:06.461768088 (332h42m54.265232682s) [upload=292729]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.489414513s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X...X...................................................] duration:
2.224466945s
FAIL (2025-10-07 10:51:53 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 2.224499699s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.421071368s
FAIL (2025-10-07 10:51:19 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 7 10:12:07.306656774 (332h41m55.110121353s) [upload=292729]: Starting upload
Oct 7 10:12:07.306794557 (332h41m55.110259153s) [upload=292729]: Done starting upload
Oct 7 10:12:07.306959891 (332h41m55.110424468s) [upload=292729]: Uploading segments...
Oct 7 10:12:07.307411836 (332h41m55.110876417s) [upload=292729]: Got next segment. Inline: false
Oct 7 10:12:07.307485009 (332h41m55.110949602s) [upload=292729]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 7 10:12:07.307492302 (332h41m55.110956903s) [upload=292729]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 7 10:12:07.540963169 (332h41m55.344427762s) [seg_pos={0 0}, upload=292729]: Begin upload segment...
Oct 7 10:12:07.541037655 (332h41m55.344502238s) [seg_pos={0 0}, upload=292729]: Done begin upload segment.
Oct 7 10:12:07.541074187 (332h41m55.344538809s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.541090713 (332h41m55.344555316s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.541784911 (332h41m55.345249515s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.542309311 (332h41m55.345773916s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.542796975 (332h41m55.346261578s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.543247199 (332h41m55.346711802s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.543739269 (332h41m55.347203872s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.544225902 (332h41m55.347690502s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.544709310 (332h41m55.34817391s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.545163687 (332h41m55.348628289s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.546029033 (332h41m55.349493633s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.546617358 (332h41m55.350081961s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.547493041 (332h41m55.350957635s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.548088795 (332h41m55.351553395s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.548847836 (332h41m55.35231244s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:07.548913768 (332h41m55.352378353s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Uploading piece...
Oct 7 10:12:08.170536647 (332h41m55.974001241s) [upload=292729]: Next returned nil segment
Oct 7 10:12:08.170559840 (332h41m55.974024475s) [upload=292729]: Waiting for error group managing segments...
Oct 7 10:12:08.304430668 (332h41m56.107895265s) [noise=true , address=45.91.116.7:4009 , piece_id=PW6G7IKWGPLO4LT5KLIBIBNZFNDTL5JIEKEWTSF5PSJW55RIXT3Q, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.305363185 (332h41m56.108827777s) [noise=true , address=45.91.116.14:4190 , piece_id=2JHBABDWZZ65DDRBCTKPXD4IRXPSBHLS5KNF6H4KDCSOAL3HZLHA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.306700170 (332h41m56.110164754s) [noise=true , address=45.91.116.14:4191 , piece_id=V4YLZTE5FSJPIUPGDQ3K6OHEG42Z4TO2NSJAQVSJ3FIOFAEWRTIA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.307067518 (332h41m56.110532104s) [noise=true , address=45.91.116.12:4225 , piece_id=NYILBPM7TDFZHL4KZY5Z7SAW2UBBVIQ673OUNSJL6RNFAGD75RUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.308741631 (332h41m56.112206216s) [noise=true , address=45.91.116.4:4940 , piece_id=BSQJ3FL5STCWA3XHR53DPPB22KTIF2IONAW4CWEZSL6POZCZZZUQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.309537153 (332h41m56.113001742s) [noise=true , address=45.91.116.11:4118 , piece_id=Y4OOJXNAXVQAYFMA4DNPS3KK3CG2G72HFPWFQJCOHFLA52K5V4WA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.310340574 (332h41m56.113805153s) [noise=true , address=45.91.116.5:4297 , piece_id=5T5RVW3DRGCFHCWTV7VJVQN3URPAFM6QA6QNXFX4OBIRSR2L5NFQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.311182954 (332h41m56.11464754s) [noise=true , address=45.91.116.14:4189 , piece_id=WUG46J5L64X4OGQRMKQQEYFYAUH3INHXSARHCAIG4UJG3OZMJLBQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.313196428 (332h41m56.116661024s) [noise=true , address=45.91.116.13:4155 , piece_id=JWPKUVWT7W77RVD6KTHBLTAZX4POMNSYQCHGFR5TPVTIYCERFGUA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.318452659 (332h41m56.121917244s) [noise=true , address=145.79.227.16:4912 , piece_id=Y7SMHQVAEKVN2HRMIVZ7BYOMTZASGVJSBBN4IJFVJXH4YI2AHWYQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.328737265 (332h41m56.132201846s) [noise=true , address=145.79.227.7:4295 , piece_id=UR47ZJ5GB65RH7Y2SQSXCXTH4GFPZ6LOYX24R4EP6KLDG5MRAVSQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.328934722 (332h41m56.132399301s) [noise=true , address=145.79.227.15:4876 , piece_id=LPWSL6B3FZOP7RK4WWZOEYAYXAQKXP6B4MVANTER4V22Y7XAFMJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.329976841 (332h41m56.133441425s) [noise=true , address=145.79.227.12:4767 , piece_id=6UNBSGDTBDP35VTEXRCZV2TBXHP2KQRD3CWBMD4T5C5J7R25MWWQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: <nil>
Oct 7 10:12:08.330015374 (332h41m56.133479965s) [seg_pos={0 0}, upload=292729]: Segment reached optimal threshold of 13 pieces.
Oct 7 10:12:08.330183190 (332h41m56.133647782s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF
Oct 7 10:12:08.330193562 (332h41m56.133658159s) [noise=true , address=145.79.227.17:4971 , piece_id=OB62T7NSEQG3C74WBTY22WFIVN7XNIYRPBMUVPMANACXAESPAQGQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold
Oct 7 10:12:08.330288373 (332h41m56.133752965s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF
Oct 7 10:12:08.330294885 (332h41m56.133759477s) [noise=true , address=145.79.227.11:4729 , piece_id=JQMMV2534IWEDOG3L3IH22OX4G2ATYYET7QYRIKFRRA5GGTAPGQA, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold
Oct 7 10:12:08.330452305 (332h41m56.13391691s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF
Oct 7 10:12:08.330464871 (332h41m56.133929473s) [noise=true , address=145.79.227.15:4875 , piece_id=Y3KC6OC6YPRWQX6CKMSUQ2MYBJOFMBVV5RHNN2BRI3ID5TY52ZJQ, seg_pos={0 0}, upload=292729]: Long tail cancellation due to optimal threshold
Oct 7 10:12:08.330492924 (332h41m56.133957517s) [seg_pos={0 0}, upload=292729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 7 10:12:08.330636956 (332h41m56.134101547s) [upload=292729]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 7 10:12:08.330650493 (332h41m56.134115078s) [upload=292729]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 7 10:13:06.461738970 (332h42m54.265203553s) [upload=292729]: Done uploading segments...
Oct 7 10:13:06.461768088 (332h42m54.265232682s) [upload=292729]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.421091733s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
994.472224ms
FAIL (2025-10-07 10:51:19 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 994.532228ms
core
uplink
us1
|