Orbiter History

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 2 out of 60 is failed (threshold=3) [...............................XX...........................] duration: 12.866061ms remote: "tcp:[2a02:26f0:ab00:38d::1aca]:443" target: https://www.apple.com/robots.txt trace: https://jaeger.dev.storj.io/trace/1ed3628b79bc8725 FAIL (2026-03-18 16:44:47 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error Duration: 12.89567ms core website
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 2 out of 60 is failed (threshold=3) [................................XX..........................] duration: 14.493356ms remote: "tcp:[2a02:26f0:ab00:38d::1aca]:443" target: https://www.apple.com/robots.txt trace: https://jaeger.dev.storj.io/trace/1ed3628b79bc8725 FAIL (2026-03-18 16:44:01 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error Duration: 14.589772ms core website
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 2 out of 60 is failed (threshold=3) [.................................XX.........................] duration: 13.356088ms remote: "tcp:[2a02:26f0:ab00:38d::1aca]:443" target: https://www.apple.com/robots.txt trace: https://jaeger.dev.storj.io/trace/1ed3628b79bc8725 FAIL (2026-03-18 16:43:02 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error Duration: 13.435137ms core website
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 2 out of 60 is failed (threshold=3) [..................................XX........................] duration: 14.090193ms remote: "tcp:[2a02:26f0:ab00:38d::1aca]:443" target: https://www.apple.com/robots.txt trace: https://jaeger.dev.storj.io/trace/1ed3628b79bc8725 FAIL (2026-03-18 16:42:45 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error Duration: 14.151621ms core website
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 2 out of 60 is failed (threshold=3) [...................................XX.......................] duration: 13.012375ms remote: "tcp:[2a02:26f0:ab00:38d::1aca]:443" target: https://www.apple.com/robots.txt trace: https://jaeger.dev.storj.io/trace/1ed3628b79bc8725 FAIL (2026-03-18 16:42:11 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error Duration: 13.040309ms core website
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 2 out of 60 is failed (threshold=3) [....................................XX......................] duration: 14.046536ms remote: "tcp:[2a02:26f0:ab00:38d::1aca]:443" target: https://www.apple.com/robots.txt trace: https://jaeger.dev.storj.io/trace/1ed3628b79bc8725 FAIL (2026-03-18 16:41:09 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error Duration: 14.072205ms core website
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 2 out of 60 is failed (threshold=3) [.....................................XX.....................] duration: 23.848958ms remote: "tcp:[2a02:26f0:ab00:38d::1aca]:443" target: https://www.apple.com/robots.txt trace: https://jaeger.dev.storj.io/trace/1ed3628b79bc8725 FAIL (2026-03-18 16:40:01 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error Duration: 23.946832ms core website
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 2 out of 60 is failed (threshold=3) [......................................XX....................] duration: 26.930357ms remote: "tcp:[2a02:26f0:ab00:38d::1aca]:443" target: https://www.apple.com/robots.txt trace: https://jaeger.dev.storj.io/trace/1ed3628b79bc8725 FAIL (2026-03-18 16:39:23 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error Duration: 26.963316ms core website
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 2 out of 60 is failed (threshold=3) [.......................................XX...................] duration: 17.819149ms remote: "tcp:[2a02:26f0:ab00:38d::1aca]:443" target: https://www.apple.com/robots.txt trace: https://jaeger.dev.storj.io/trace/1ed3628b79bc8725 FAIL (2026-03-18 16:38:54 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error Duration: 17.843897ms core website
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 2 out of 60 is failed (threshold=3) [........................................XX..................] duration: 13.409854ms remote: "tcp:[2a02:26f0:ab00:38d::1aca]:443" target: https://www.apple.com/robots.txt trace: https://jaeger.dev.storj.io/trace/1ed3628b79bc8725 FAIL (2026-03-18 16:38:10 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error Duration: 13.504144ms core website
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 2 out of 60 is failed (threshold=3) [.........................................XX.................] duration: 13.570237ms remote: "tcp:[2a02:26f0:ab00:38d::1aca]:443" target: https://www.apple.com/robots.txt trace: https://jaeger.dev.storj.io/trace/1ed3628b79bc8725 FAIL (2026-03-18 16:36:57 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error Duration: 13.623872ms core website
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 2 out of 60 is failed (threshold=3) [..........................................XX................] duration: 33.650791ms remote: "tcp:[2a02:26f0:ab00:38d::1aca]:443" target: https://www.apple.com/robots.txt trace: https://jaeger.dev.storj.io/trace/1ed3628b79bc8725 FAIL (2026-03-18 16:36:19 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error Duration: 33.959392ms core website
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 2 out of 60 is failed (threshold=3) [...........................................XX...............] duration: 98.778844ms remote: "tcp:[2a02:26f0:ab00:38d::1aca]:443" target: https://www.apple.com/robots.txt trace: https://jaeger.dev.storj.io/trace/1ed3628b79bc8725 FAIL (2026-03-18 16:35:09 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error Duration: 98.801585ms core website
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 2 out of 60 is failed (threshold=3) [............................................XX..............] duration: 12.894808ms remote: "tcp:[2a02:26f0:ab00:38d::1aca]:443" target: https://www.apple.com/robots.txt trace: https://jaeger.dev.storj.io/trace/1ed3628b79bc8725 FAIL (2026-03-18 16:34:48 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error Duration: 12.918724ms core website
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 2 out of 60 is failed (threshold=3) [.............................................XX.............] duration: 11.435051ms remote: "tcp:[2a02:26f0:ab00:38d::1aca]:443" target: https://www.apple.com/robots.txt trace: https://jaeger.dev.storj.io/trace/1ed3628b79bc8725 FAIL (2026-03-18 16:34:33 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error Duration: 11.451969ms core website
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 2 out of 60 is failed (threshold=3) [..............................................XX............] duration: 18.338322ms remote: "tcp:[2a02:26f0:ab00:38d::1aca]:443" target: https://www.apple.com/robots.txt trace: https://jaeger.dev.storj.io/trace/1ed3628b79bc8725 FAIL (2026-03-18 16:33:26 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error Duration: 18.350713ms core website
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 2 out of 60 is failed (threshold=3) [...............................................XX...........] duration: 12.059996ms remote: "tcp:[2a02:26f0:ab00:38d::1aca]:443" target: https://www.apple.com/robots.txt trace: https://jaeger.dev.storj.io/trace/1ed3628b79bc8725 FAIL (2026-03-18 16:32:25 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error Duration: 12.089387ms core website
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 2 out of 60 is failed (threshold=3) [................................................XX..........] duration: 11.75471ms remote: "tcp:[2a02:26f0:ab00:38d::1aca]:443" target: https://www.apple.com/robots.txt trace: https://jaeger.dev.storj.io/trace/1ed3628b79bc8725 FAIL (2026-03-18 16:31:42 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error Duration: 11.833202ms core website
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 2 out of 60 is failed (threshold=3) [.................................................XX.........] duration: 16.800674ms remote: "tcp:[2a02:26f0:ab00:38d::1aca]:443" target: https://www.apple.com/robots.txt trace: https://jaeger.dev.storj.io/trace/1ed3628b79bc8725 FAIL (2026-03-18 16:30:50 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error Duration: 16.825319ms core website
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 2 out of 60 is failed (threshold=3) [..................................................XX........] duration: 14.655311ms remote: "tcp:[2a02:26f0:ab00:38d::1aca]:443" target: https://www.apple.com/robots.txt trace: https://jaeger.dev.storj.io/trace/1ed3628b79bc8725 FAIL (2026-03-18 16:29:52 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error Duration: 14.693176ms core website
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 2 out of 60 is failed (threshold=3) [...................................................XX.......] duration: 10.946105ms remote: "tcp:[2a02:26f0:ab00:38d::1aca]:443" target: https://www.apple.com/robots.txt trace: https://jaeger.dev.storj.io/trace/1ed3628b79bc8725 FAIL (2026-03-18 16:28:56 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error Duration: 10.977834ms core website
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 2 out of 60 is failed (threshold=3) [....................................................XX......] duration: 14.024ms remote: "tcp:[2a02:26f0:ab00:38d::1aca]:443" target: https://www.apple.com/robots.txt trace: https://jaeger.dev.storj.io/trace/1ed3628b79bc8725 FAIL (2026-03-18 16:28:20 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error Duration: 14.051433ms core website
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 2 out of 60 is failed (threshold=3) [.....................................................XX.....] duration: 13.687738ms remote: "tcp:[2a02:26f0:ab00:38d::1aca]:443" target: https://www.apple.com/robots.txt trace: https://jaeger.dev.storj.io/trace/1ed3628b79bc8725 FAIL (2026-03-18 16:27:47 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error Duration: 13.804054ms core website
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 2 out of 60 is failed (threshold=3) [......................................................XX....] duration: 12.818042ms remote: "tcp:[2a02:26f0:ab00:38d::1aca]:443" target: https://www.apple.com/robots.txt trace: https://jaeger.dev.storj.io/trace/1ed3628b79bc8725 FAIL (2026-03-18 16:26:58 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error Duration: 12.842726ms core website
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 2 out of 60 is failed (threshold=3) [.......................................................XX...] duration: 21.437196ms remote: "tcp:[2a02:26f0:ab00:38d::1aca]:443" target: https://www.apple.com/robots.txt trace: https://jaeger.dev.storj.io/trace/1ed3628b79bc8725 FAIL (2026-03-18 16:26:32 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error Duration: 21.46329ms core website
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 2 out of 60 is failed (threshold=3) [........................................................XX..] duration: 14.806605ms remote: "tcp:[2a02:26f0:ab00:38d::1aca]:443" target: https://www.apple.com/robots.txt trace: https://jaeger.dev.storj.io/trace/1ed3628b79bc8725 FAIL (2026-03-18 16:25:47 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error Duration: 14.852126ms core website
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 2 out of 60 is failed (threshold=3) [.........................................................XX.] duration: 10.819181ms remote: "tcp:[2a02:26f0:ab00:38d::1aca]:443" target: https://www.apple.com/robots.txt trace: https://jaeger.dev.storj.io/trace/1ed3628b79bc8725 FAIL (2026-03-18 16:24:53 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error Duration: 10.84631ms core website
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 3.289854365s remote: "tcp:[2a02:26f0:ab00:38d::1aca]:443" target: https://www.apple.com/robots.txt trace: https://jaeger.dev.storj.io/trace/1ed3628b79bc8725 FAIL (2026-03-18 16:23:55 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error Duration: 3.289885225s core website
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 4.576845064s remote: "tcp:[2a02:26f0:ab00:3a0::1aca]:443" target: https://www.apple.com/robots.txt trace: https://jaeger.dev.storj.io/trace/74818c97850d8b9f FAIL (2026-03-18 16:22:56 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error Duration: 4.576921259s core website
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 736.98274ms trace: https://jaeger.dev.storj.io/trace/2c31a8cce5d1c379 FAIL (2026-03-18 16:11:46 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 737.009969ms core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [XX..........................................................] duration: 739.591307ms trace: https://jaeger.dev.storj.io/trace/2c31a8cce5d1c379 FAIL (2026-03-18 16:11:24 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 739.623968ms core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.XX.........................................................] duration: 1.083981451s trace: https://jaeger.dev.storj.io/trace/2c31a8cce5d1c379 FAIL (2026-03-18 16:11:06 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.084011917s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..XX........................................................] duration: 727.470095ms trace: https://jaeger.dev.storj.io/trace/2c31a8cce5d1c379 FAIL (2026-03-18 16:10:42 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 727.502147ms core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [X..XX.......................................................] duration: 689.699829ms trace: https://jaeger.dev.storj.io/trace/2c31a8cce5d1c379 FAIL (2026-03-18 16:09:49 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 689.732948ms core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [XX..XX......................................................] duration: 818.21404ms trace: https://jaeger.dev.storj.io/trace/2c31a8cce5d1c379 FAIL (2026-03-18 16:09:31 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 818.245735ms core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [.XX..XX.....................................................] duration: 626.933728ms trace: https://jaeger.dev.storj.io/trace/2c31a8cce5d1c379 FAIL (2026-03-18 16:08:52 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 626.963554ms core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [..XX..XX....................................................] duration: 1.083333308s trace: https://jaeger.dev.storj.io/trace/2c31a8cce5d1c379 FAIL (2026-03-18 16:08:00 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.083371821s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [...XX..XX...................................................] duration: 729.867673ms trace: https://jaeger.dev.storj.io/trace/2c31a8cce5d1c379 FAIL (2026-03-18 16:07:34 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 729.909459ms core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.481068586s trace: https://jaeger.dev.storj.io/trace/21b23d7305e037a FAIL (2026-03-18 16:07:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s, Piece ID: 3J4NH2MLBKVMF7WBUQCQGUJPSONQGTXEUHIIZBFMN5P6I2N4QXDQ) context deadline exceeded; piecestore: (Node ID: 1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, Piece ID: KYPUR2EBM2QJWXJQG3VCHCCZLWCGLEF4HDXEJRU4YEXCHDWSTEDA) context deadline exceeded; piecestore: (Node ID: 12AQGSkJuNJDxoeqhChUenWxHwF5yK41UESCF63FQz3XvabXXfz, Piece ID: ZYW7ES3I3FN5TSJNJ57WX4JZZ7WCXBEXDQEEZGHXLSAMVV57JYUA) context deadline exceeded; piecestore: (Node ID: 128kFn1ZsqrdV936j55GuKpnHdERmtBxcL4B9bZrnjeXMaLpfsP, Piece ID: YAW47YHT74Q5PRWVOGBDEIXGGCXWJBQZK4PKC334IRGB5WBY44OQ) context deadline exceeded ======LOGS====== upload=183651]: Starting upload Mar 18 15:20:54.303457115 (191h9m57.319126727s) [upload=183651]: Done starting upload Mar 18 15:20:54.303665912 (191h9m57.319335513s) [upload=183651]: Uploading segments... Mar 18 15:20:54.303965721 (191h9m57.319635311s) [upload=183651]: Got next segment. Inline: false Mar 18 15:20:54.304013634 (191h9m57.319683246s) [upload=183651]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 15:20:54.304021720 (191h9m57.319691334s) [upload=183651]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 18 15:20:54.662509110 (191h9m57.67817871s) [seg_pos={0 0}, upload=183651]: Begin upload segment... Mar 18 15:20:54.662562678 (191h9m57.678232268s) [seg_pos={0 0}, upload=183651]: Done begin upload segment. Mar 18 15:20:54.662592279 (191h9m57.67826188s) [noise=true , address=45.91.116.7:4012 , piece_id=KYPUR2EBM2QJWXJQG3VCHCCZLWCGLEF4HDXEJRU4YEXCHDWSTEDA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.664091904 (191h9m57.679761511s) [noise=true , address=145.79.227.42:4123 , piece_id=C3AUR2K7GZPBX2O7HMPF3NS7SKPRJSCFHIFMARF5MNML32QPCJLA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.664760971 (191h9m57.680430574s) [noise=true , address=145.79.227.50:4373 , piece_id=ZYW7ES3I3FN5TSJNJ57WX4JZZ7WCXBEXDQEEZGHXLSAMVV57JYUA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.665304567 (191h9m57.68097417s) [noise=true , address=145.79.227.29:4945 , piece_id=YAW47YHT74Q5PRWVOGBDEIXGGCXWJBQZK4PKC334IRGB5WBY44OQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.666050630 (191h9m57.68172024s) [noise=true , address=45.91.116.11:4120 , piece_id=GR4SEE5RUEY6BZRC3NM22LRTB5LRD7XEQARZ3HNV73BWEHW77Q6A, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.666631225 (191h9m57.682300831s) [noise=true , address=45.91.116.13:4154 , piece_id=5C7TL3GT7YEUIUF6MQLHS5YQPWGU4HMVXJ3RXPHHQ4EUQ7WN2NBA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.667041838 (191h9m57.68271144s) [noise=true , address=77.90.31.14:4661 , piece_id=RIYVADNOLZAQSI55TC6QNMDHQRCCX6VJGWCXVHGEPNJWTYOLX5RQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.667546703 (191h9m57.683216304s) [noise=true , address=145.79.227.19:4083 , piece_id=GNMET2EJCABKI3ZEEY3U5SABD5PR4KAUCXVWEUJYRN7TO33QHEAA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.668012057 (191h9m57.683681657s) [noise=true , address=145.79.227.41:4090 , piece_id=6JKG7VBPB54GTHPNX6W37KD64QK6SJAYL6UQSW5U3RAWL52SHFGA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.668448937 (191h9m57.684118543s) [noise=true , address=79.127.219.45:4855 , piece_id=EYM67437Z7OQ3J4VRCVH53FCRBRAEBERDK4Y5MPBM7EGPFHAIXUQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.668687476 (191h9m57.684357085s) [noise=true , address=145.79.227.35:4484 , piece_id=4B5H6IWVZKFJFNPT2YFHHUJ7XPUK6JT7DHDSVYZNRXBGZUTM72TQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.669348163 (191h9m57.685017763s) [noise=true , address=145.79.227.14:4837 , piece_id=PQ2STQPAJZQTANRAMDKBTPFNSWGWV2Z4PF6MGUESOV7V35XI2Z6Q, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.670185533 (191h9m57.685855138s) [noise=true , address=145.79.227.30:4764 , piece_id=OBRMP5YGOPFDUHOMR5FKU2GVWAF7EBC7QSNIXDZWFOM4TOWVXDOA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.670284943 (191h9m57.685954546s) [noise=true , address=145.79.227.7:4297 , piece_id=NLAHTGYCTU6KA4KEYXYNXJGIJCHPQH5LVD3A5LMT3G4S2X6HI6WQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.670802120 (191h9m57.686471739s) [noise=true , address=145.79.227.49:4341 , piece_id=RBOQ42IOZAAZXE35PXOW6FITIIPUED6HQOKX3MZ3MJQJN7Z34NJQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.671365214 (191h9m57.687034823s) [noise=true , address=145.79.227.6:4262 , piece_id=3J4NH2MLBKVMF7WBUQCQGUJPSONQGTXEUHIIZBFMN5P6I2N4QXDQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:55.553326060 (191h9m58.568995658s) [upload=183651]: Next returned nil segment Mar 18 15:20:55.553350353 (191h9m58.569019965s) [upload=183651]: Waiting for error group managing segments... Mar 18 15:20:55.731225208 (191h9m58.746894812s) [noise=true , address=79.127.219.45:4855 , piece_id=EYM67437Z7OQ3J4VRCVH53FCRBRAEBERDK4Y5MPBM7EGPFHAIXUQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.877239140 (191h9m58.89290874s) [noise=true , address=145.79.227.7:4297 , piece_id=NLAHTGYCTU6KA4KEYXYNXJGIJCHPQH5LVD3A5LMT3G4S2X6HI6WQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.881970180 (191h9m58.897639791s) [noise=true , address=145.79.227.19:4083 , piece_id=GNMET2EJCABKI3ZEEY3U5SABD5PR4KAUCXVWEUJYRN7TO33QHEAA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.890259873 (191h9m58.905929478s) [noise=true , address=45.91.116.7:4012 , piece_id=KYPUR2EBM2QJWXJQG3VCHCCZLWCGLEF4HDXEJRU4YEXCHDWSTEDA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.895733842 (191h9m58.911403443s) [noise=true , address=145.79.227.6:4262 , piece_id=3J4NH2MLBKVMF7WBUQCQGUJPSONQGTXEUHIIZBFMN5P6I2N4QXDQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.922327749 (191h9m58.937997359s) [noise=true , address=145.79.227.14:4837 , piece_id=PQ2STQPAJZQTANRAMDKBTPFNSWGWV2Z4PF6MGUESOV7V35XI2Z6Q, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.935924481 (191h9m58.951594082s) [noise=true , address=145.79.227.50:4373 , piece_id=ZYW7ES3I3FN5TSJNJ57WX4JZZ7WCXBEXDQEEZGHXLSAMVV57JYUA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.490019568 (191h9m59.505689171s) [noise=true , address=77.90.31.14:4661 , piece_id=RIYVADNOLZAQSI55TC6QNMDHQRCCX6VJGWCXVHGEPNJWTYOLX5RQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.498992750 (191h9m59.51466235s) [noise=true , address=145.79.227.42:4123 , piece_id=C3AUR2K7GZPBX2O7HMPF3NS7SKPRJSCFHIFMARF5MNML32QPCJLA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.503673826 (191h9m59.519343429s) [noise=true , address=145.79.227.35:4484 , piece_id=4B5H6IWVZKFJFNPT2YFHHUJ7XPUK6JT7DHDSVYZNRXBGZUTM72TQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.584581917 (191h9m59.600251521s) [noise=true , address=45.91.116.13:4154 , piece_id=5C7TL3GT7YEUIUF6MQLHS5YQPWGU4HMVXJ3RXPHHQ4EUQ7WN2NBA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.596338514 (191h9m59.612008115s) [noise=true , address=145.79.227.49:4341 , piece_id=RBOQ42IOZAAZXE35PXOW6FITIIPUED6HQOKX3MZ3MJQJN7Z34NJQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.719952247 (191h9m59.735621857s) [noise=true , address=145.79.227.29:4945 , piece_id=YAW47YHT74Q5PRWVOGBDEIXGGCXWJBQZK4PKC334IRGB5WBY44OQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.719982026 (191h9m59.735651634s) [seg_pos={0 0}, upload=183651]: Satisfied cohort requirements after 13 pieces Mar 18 15:20:56.720279864 (191h9m59.735949473s) [noise=true , address=45.91.116.11:4120 , piece_id=GR4SEE5RUEY6BZRC3NM22LRTB5LRD7XEQARZ3HNV73BWEHW77Q6A, seg_pos={0 0}, upload=183651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: write tcp 139.59.144.22:42930->45.91.116.11:4120: use of closed network connection; write tcp 139.59.144.22:42930->45.91.116.11:4120: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42930->45.91.116.11:4120: use of closed network connection Mar 18 15:20:56.720290575 (191h9m59.735960184s) [noise=true , address=45.91.116.11:4120 , piece_id=GR4SEE5RUEY6BZRC3NM22LRTB5LRD7XEQARZ3HNV73BWEHW77Q6A, seg_pos={0 0}, upload=183651]: Long tail cancellation due to optimal threshold Mar 18 15:20:56.721072812 (191h9m59.736742422s) [noise=true , address=145.79.227.30:4764 , piece_id=OBRMP5YGOPFDUHOMR5FKU2GVWAF7EBC7QSNIXDZWFOM4TOWVXDOA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127hafVDbun7FoG4JdcogBmRNT6rhL2QQbLDLstFnx7HCWyiC9N): protocol: expected piece hash; context canceled; EOF Mar 18 15:20:56.721085662 (191h9m59.736755272s) [noise=true , address=145.79.227.30:4764 , piece_id=OBRMP5YGOPFDUHOMR5FKU2GVWAF7EBC7QSNIXDZWFOM4TOWVXDOA, seg_pos={0 0}, upload=183651]: Long tail cancellation due to optimal threshold Mar 18 15:20:56.721315732 (191h9m59.736985341s) [noise=true , address=145.79.227.41:4090 , piece_id=6JKG7VBPB54GTHPNX6W37KD64QK6SJAYL6UQSW5U3RAWL52SHFGA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UUnoD9p5FC7rq9fMSzu1phkFpsnPsu4UYxC59MhpMjJ6wUC6F): protocol: read tcp 139.59.144.22:41040->145.79.227.41:4090: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 18 15:20:56.721327176 (191h9m59.736996776s) [noise=true , address=145.79.227.41:4090 , piece_id=6JKG7VBPB54GTHPNX6W37KD64QK6SJAYL6UQSW5U3RAWL52SHFGA, seg_pos={0 0}, upload=183651]: Long tail cancellation due to optimal threshold Mar 18 15:20:56.721354703 (191h9m59.737024289s) [seg_pos={0 0}, upload=183651]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 18 15:20:56.721444047 (191h9m59.737113648s) [upload=183651]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 18 15:20:56.721450536 (191h9m59.737120136s) [upload=183651]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 15:20:56.945499978 (191h9m59.961169586s) [upload=183651]: Done uploading segments... Mar 18 15:20:56.945534492 (191h9m59.961204094s) [upload=183651]: Upload finished. err: <nil> Duration: 2.481096696s core uplink us-select-1
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [....XX..XX..................................................] duration: 703.06375ms trace: https://jaeger.dev.storj.io/trace/2c31a8cce5d1c379 FAIL (2026-03-18 16:06:50 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 703.092678ms core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [.....XX..XX.................................................] duration: 672.203025ms trace: https://jaeger.dev.storj.io/trace/2c31a8cce5d1c379 FAIL (2026-03-18 16:06:16 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 672.227386ms core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.457644314s trace: https://jaeger.dev.storj.io/trace/21b23d7305e037a FAIL (2026-03-18 16:06:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s, Piece ID: 3J4NH2MLBKVMF7WBUQCQGUJPSONQGTXEUHIIZBFMN5P6I2N4QXDQ) context deadline exceeded; piecestore: (Node ID: 1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, Piece ID: KYPUR2EBM2QJWXJQG3VCHCCZLWCGLEF4HDXEJRU4YEXCHDWSTEDA) context deadline exceeded; piecestore: (Node ID: 12AQGSkJuNJDxoeqhChUenWxHwF5yK41UESCF63FQz3XvabXXfz, Piece ID: ZYW7ES3I3FN5TSJNJ57WX4JZZ7WCXBEXDQEEZGHXLSAMVV57JYUA) context deadline exceeded; piecestore: (Node ID: 128kFn1ZsqrdV936j55GuKpnHdERmtBxcL4B9bZrnjeXMaLpfsP, Piece ID: YAW47YHT74Q5PRWVOGBDEIXGGCXWJBQZK4PKC334IRGB5WBY44OQ) context deadline exceeded ======LOGS====== upload=183651]: Starting upload Mar 18 15:20:54.303457115 (191h9m57.319126727s) [upload=183651]: Done starting upload Mar 18 15:20:54.303665912 (191h9m57.319335513s) [upload=183651]: Uploading segments... Mar 18 15:20:54.303965721 (191h9m57.319635311s) [upload=183651]: Got next segment. Inline: false Mar 18 15:20:54.304013634 (191h9m57.319683246s) [upload=183651]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 15:20:54.304021720 (191h9m57.319691334s) [upload=183651]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 18 15:20:54.662509110 (191h9m57.67817871s) [seg_pos={0 0}, upload=183651]: Begin upload segment... Mar 18 15:20:54.662562678 (191h9m57.678232268s) [seg_pos={0 0}, upload=183651]: Done begin upload segment. Mar 18 15:20:54.662592279 (191h9m57.67826188s) [noise=true , address=45.91.116.7:4012 , piece_id=KYPUR2EBM2QJWXJQG3VCHCCZLWCGLEF4HDXEJRU4YEXCHDWSTEDA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.664091904 (191h9m57.679761511s) [noise=true , address=145.79.227.42:4123 , piece_id=C3AUR2K7GZPBX2O7HMPF3NS7SKPRJSCFHIFMARF5MNML32QPCJLA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.664760971 (191h9m57.680430574s) [noise=true , address=145.79.227.50:4373 , piece_id=ZYW7ES3I3FN5TSJNJ57WX4JZZ7WCXBEXDQEEZGHXLSAMVV57JYUA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.665304567 (191h9m57.68097417s) [noise=true , address=145.79.227.29:4945 , piece_id=YAW47YHT74Q5PRWVOGBDEIXGGCXWJBQZK4PKC334IRGB5WBY44OQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.666050630 (191h9m57.68172024s) [noise=true , address=45.91.116.11:4120 , piece_id=GR4SEE5RUEY6BZRC3NM22LRTB5LRD7XEQARZ3HNV73BWEHW77Q6A, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.666631225 (191h9m57.682300831s) [noise=true , address=45.91.116.13:4154 , piece_id=5C7TL3GT7YEUIUF6MQLHS5YQPWGU4HMVXJ3RXPHHQ4EUQ7WN2NBA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.667041838 (191h9m57.68271144s) [noise=true , address=77.90.31.14:4661 , piece_id=RIYVADNOLZAQSI55TC6QNMDHQRCCX6VJGWCXVHGEPNJWTYOLX5RQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.667546703 (191h9m57.683216304s) [noise=true , address=145.79.227.19:4083 , piece_id=GNMET2EJCABKI3ZEEY3U5SABD5PR4KAUCXVWEUJYRN7TO33QHEAA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.668012057 (191h9m57.683681657s) [noise=true , address=145.79.227.41:4090 , piece_id=6JKG7VBPB54GTHPNX6W37KD64QK6SJAYL6UQSW5U3RAWL52SHFGA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.668448937 (191h9m57.684118543s) [noise=true , address=79.127.219.45:4855 , piece_id=EYM67437Z7OQ3J4VRCVH53FCRBRAEBERDK4Y5MPBM7EGPFHAIXUQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.668687476 (191h9m57.684357085s) [noise=true , address=145.79.227.35:4484 , piece_id=4B5H6IWVZKFJFNPT2YFHHUJ7XPUK6JT7DHDSVYZNRXBGZUTM72TQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.669348163 (191h9m57.685017763s) [noise=true , address=145.79.227.14:4837 , piece_id=PQ2STQPAJZQTANRAMDKBTPFNSWGWV2Z4PF6MGUESOV7V35XI2Z6Q, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.670185533 (191h9m57.685855138s) [noise=true , address=145.79.227.30:4764 , piece_id=OBRMP5YGOPFDUHOMR5FKU2GVWAF7EBC7QSNIXDZWFOM4TOWVXDOA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.670284943 (191h9m57.685954546s) [noise=true , address=145.79.227.7:4297 , piece_id=NLAHTGYCTU6KA4KEYXYNXJGIJCHPQH5LVD3A5LMT3G4S2X6HI6WQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.670802120 (191h9m57.686471739s) [noise=true , address=145.79.227.49:4341 , piece_id=RBOQ42IOZAAZXE35PXOW6FITIIPUED6HQOKX3MZ3MJQJN7Z34NJQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.671365214 (191h9m57.687034823s) [noise=true , address=145.79.227.6:4262 , piece_id=3J4NH2MLBKVMF7WBUQCQGUJPSONQGTXEUHIIZBFMN5P6I2N4QXDQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:55.553326060 (191h9m58.568995658s) [upload=183651]: Next returned nil segment Mar 18 15:20:55.553350353 (191h9m58.569019965s) [upload=183651]: Waiting for error group managing segments... Mar 18 15:20:55.731225208 (191h9m58.746894812s) [noise=true , address=79.127.219.45:4855 , piece_id=EYM67437Z7OQ3J4VRCVH53FCRBRAEBERDK4Y5MPBM7EGPFHAIXUQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.877239140 (191h9m58.89290874s) [noise=true , address=145.79.227.7:4297 , piece_id=NLAHTGYCTU6KA4KEYXYNXJGIJCHPQH5LVD3A5LMT3G4S2X6HI6WQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.881970180 (191h9m58.897639791s) [noise=true , address=145.79.227.19:4083 , piece_id=GNMET2EJCABKI3ZEEY3U5SABD5PR4KAUCXVWEUJYRN7TO33QHEAA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.890259873 (191h9m58.905929478s) [noise=true , address=45.91.116.7:4012 , piece_id=KYPUR2EBM2QJWXJQG3VCHCCZLWCGLEF4HDXEJRU4YEXCHDWSTEDA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.895733842 (191h9m58.911403443s) [noise=true , address=145.79.227.6:4262 , piece_id=3J4NH2MLBKVMF7WBUQCQGUJPSONQGTXEUHIIZBFMN5P6I2N4QXDQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.922327749 (191h9m58.937997359s) [noise=true , address=145.79.227.14:4837 , piece_id=PQ2STQPAJZQTANRAMDKBTPFNSWGWV2Z4PF6MGUESOV7V35XI2Z6Q, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.935924481 (191h9m58.951594082s) [noise=true , address=145.79.227.50:4373 , piece_id=ZYW7ES3I3FN5TSJNJ57WX4JZZ7WCXBEXDQEEZGHXLSAMVV57JYUA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.490019568 (191h9m59.505689171s) [noise=true , address=77.90.31.14:4661 , piece_id=RIYVADNOLZAQSI55TC6QNMDHQRCCX6VJGWCXVHGEPNJWTYOLX5RQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.498992750 (191h9m59.51466235s) [noise=true , address=145.79.227.42:4123 , piece_id=C3AUR2K7GZPBX2O7HMPF3NS7SKPRJSCFHIFMARF5MNML32QPCJLA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.503673826 (191h9m59.519343429s) [noise=true , address=145.79.227.35:4484 , piece_id=4B5H6IWVZKFJFNPT2YFHHUJ7XPUK6JT7DHDSVYZNRXBGZUTM72TQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.584581917 (191h9m59.600251521s) [noise=true , address=45.91.116.13:4154 , piece_id=5C7TL3GT7YEUIUF6MQLHS5YQPWGU4HMVXJ3RXPHHQ4EUQ7WN2NBA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.596338514 (191h9m59.612008115s) [noise=true , address=145.79.227.49:4341 , piece_id=RBOQ42IOZAAZXE35PXOW6FITIIPUED6HQOKX3MZ3MJQJN7Z34NJQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.719952247 (191h9m59.735621857s) [noise=true , address=145.79.227.29:4945 , piece_id=YAW47YHT74Q5PRWVOGBDEIXGGCXWJBQZK4PKC334IRGB5WBY44OQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.719982026 (191h9m59.735651634s) [seg_pos={0 0}, upload=183651]: Satisfied cohort requirements after 13 pieces Mar 18 15:20:56.720279864 (191h9m59.735949473s) [noise=true , address=45.91.116.11:4120 , piece_id=GR4SEE5RUEY6BZRC3NM22LRTB5LRD7XEQARZ3HNV73BWEHW77Q6A, seg_pos={0 0}, upload=183651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: write tcp 139.59.144.22:42930->45.91.116.11:4120: use of closed network connection; write tcp 139.59.144.22:42930->45.91.116.11:4120: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42930->45.91.116.11:4120: use of closed network connection Mar 18 15:20:56.720290575 (191h9m59.735960184s) [noise=true , address=45.91.116.11:4120 , piece_id=GR4SEE5RUEY6BZRC3NM22LRTB5LRD7XEQARZ3HNV73BWEHW77Q6A, seg_pos={0 0}, upload=183651]: Long tail cancellation due to optimal threshold Mar 18 15:20:56.721072812 (191h9m59.736742422s) [noise=true , address=145.79.227.30:4764 , piece_id=OBRMP5YGOPFDUHOMR5FKU2GVWAF7EBC7QSNIXDZWFOM4TOWVXDOA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127hafVDbun7FoG4JdcogBmRNT6rhL2QQbLDLstFnx7HCWyiC9N): protocol: expected piece hash; context canceled; EOF Mar 18 15:20:56.721085662 (191h9m59.736755272s) [noise=true , address=145.79.227.30:4764 , piece_id=OBRMP5YGOPFDUHOMR5FKU2GVWAF7EBC7QSNIXDZWFOM4TOWVXDOA, seg_pos={0 0}, upload=183651]: Long tail cancellation due to optimal threshold Mar 18 15:20:56.721315732 (191h9m59.736985341s) [noise=true , address=145.79.227.41:4090 , piece_id=6JKG7VBPB54GTHPNX6W37KD64QK6SJAYL6UQSW5U3RAWL52SHFGA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UUnoD9p5FC7rq9fMSzu1phkFpsnPsu4UYxC59MhpMjJ6wUC6F): protocol: read tcp 139.59.144.22:41040->145.79.227.41:4090: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 18 15:20:56.721327176 (191h9m59.736996776s) [noise=true , address=145.79.227.41:4090 , piece_id=6JKG7VBPB54GTHPNX6W37KD64QK6SJAYL6UQSW5U3RAWL52SHFGA, seg_pos={0 0}, upload=183651]: Long tail cancellation due to optimal threshold Mar 18 15:20:56.721354703 (191h9m59.737024289s) [seg_pos={0 0}, upload=183651]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 18 15:20:56.721444047 (191h9m59.737113648s) [upload=183651]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 18 15:20:56.721450536 (191h9m59.737120136s) [upload=183651]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 15:20:56.945499978 (191h9m59.961169586s) [upload=183651]: Done uploading segments... Mar 18 15:20:56.945534492 (191h9m59.961204094s) [upload=183651]: Upload finished. err: <nil> Duration: 2.457674289s core uplink us-select-1
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [......XX..XX................................................] duration: 675.601837ms trace: https://jaeger.dev.storj.io/trace/2c31a8cce5d1c379 FAIL (2026-03-18 16:05:15 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 675.641681ms core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.474627129s trace: https://jaeger.dev.storj.io/trace/21b23d7305e037a FAIL (2026-03-18 16:05:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s, Piece ID: 3J4NH2MLBKVMF7WBUQCQGUJPSONQGTXEUHIIZBFMN5P6I2N4QXDQ) context deadline exceeded; piecestore: (Node ID: 1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, Piece ID: KYPUR2EBM2QJWXJQG3VCHCCZLWCGLEF4HDXEJRU4YEXCHDWSTEDA) context deadline exceeded; piecestore: (Node ID: 12AQGSkJuNJDxoeqhChUenWxHwF5yK41UESCF63FQz3XvabXXfz, Piece ID: ZYW7ES3I3FN5TSJNJ57WX4JZZ7WCXBEXDQEEZGHXLSAMVV57JYUA) context deadline exceeded; piecestore: (Node ID: 128kFn1ZsqrdV936j55GuKpnHdERmtBxcL4B9bZrnjeXMaLpfsP, Piece ID: YAW47YHT74Q5PRWVOGBDEIXGGCXWJBQZK4PKC334IRGB5WBY44OQ) context deadline exceeded ======LOGS====== upload=183651]: Starting upload Mar 18 15:20:54.303457115 (191h9m57.319126727s) [upload=183651]: Done starting upload Mar 18 15:20:54.303665912 (191h9m57.319335513s) [upload=183651]: Uploading segments... Mar 18 15:20:54.303965721 (191h9m57.319635311s) [upload=183651]: Got next segment. Inline: false Mar 18 15:20:54.304013634 (191h9m57.319683246s) [upload=183651]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 15:20:54.304021720 (191h9m57.319691334s) [upload=183651]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 18 15:20:54.662509110 (191h9m57.67817871s) [seg_pos={0 0}, upload=183651]: Begin upload segment... Mar 18 15:20:54.662562678 (191h9m57.678232268s) [seg_pos={0 0}, upload=183651]: Done begin upload segment. Mar 18 15:20:54.662592279 (191h9m57.67826188s) [noise=true , address=45.91.116.7:4012 , piece_id=KYPUR2EBM2QJWXJQG3VCHCCZLWCGLEF4HDXEJRU4YEXCHDWSTEDA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.664091904 (191h9m57.679761511s) [noise=true , address=145.79.227.42:4123 , piece_id=C3AUR2K7GZPBX2O7HMPF3NS7SKPRJSCFHIFMARF5MNML32QPCJLA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.664760971 (191h9m57.680430574s) [noise=true , address=145.79.227.50:4373 , piece_id=ZYW7ES3I3FN5TSJNJ57WX4JZZ7WCXBEXDQEEZGHXLSAMVV57JYUA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.665304567 (191h9m57.68097417s) [noise=true , address=145.79.227.29:4945 , piece_id=YAW47YHT74Q5PRWVOGBDEIXGGCXWJBQZK4PKC334IRGB5WBY44OQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.666050630 (191h9m57.68172024s) [noise=true , address=45.91.116.11:4120 , piece_id=GR4SEE5RUEY6BZRC3NM22LRTB5LRD7XEQARZ3HNV73BWEHW77Q6A, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.666631225 (191h9m57.682300831s) [noise=true , address=45.91.116.13:4154 , piece_id=5C7TL3GT7YEUIUF6MQLHS5YQPWGU4HMVXJ3RXPHHQ4EUQ7WN2NBA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.667041838 (191h9m57.68271144s) [noise=true , address=77.90.31.14:4661 , piece_id=RIYVADNOLZAQSI55TC6QNMDHQRCCX6VJGWCXVHGEPNJWTYOLX5RQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.667546703 (191h9m57.683216304s) [noise=true , address=145.79.227.19:4083 , piece_id=GNMET2EJCABKI3ZEEY3U5SABD5PR4KAUCXVWEUJYRN7TO33QHEAA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.668012057 (191h9m57.683681657s) [noise=true , address=145.79.227.41:4090 , piece_id=6JKG7VBPB54GTHPNX6W37KD64QK6SJAYL6UQSW5U3RAWL52SHFGA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.668448937 (191h9m57.684118543s) [noise=true , address=79.127.219.45:4855 , piece_id=EYM67437Z7OQ3J4VRCVH53FCRBRAEBERDK4Y5MPBM7EGPFHAIXUQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.668687476 (191h9m57.684357085s) [noise=true , address=145.79.227.35:4484 , piece_id=4B5H6IWVZKFJFNPT2YFHHUJ7XPUK6JT7DHDSVYZNRXBGZUTM72TQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.669348163 (191h9m57.685017763s) [noise=true , address=145.79.227.14:4837 , piece_id=PQ2STQPAJZQTANRAMDKBTPFNSWGWV2Z4PF6MGUESOV7V35XI2Z6Q, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.670185533 (191h9m57.685855138s) [noise=true , address=145.79.227.30:4764 , piece_id=OBRMP5YGOPFDUHOMR5FKU2GVWAF7EBC7QSNIXDZWFOM4TOWVXDOA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.670284943 (191h9m57.685954546s) [noise=true , address=145.79.227.7:4297 , piece_id=NLAHTGYCTU6KA4KEYXYNXJGIJCHPQH5LVD3A5LMT3G4S2X6HI6WQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.670802120 (191h9m57.686471739s) [noise=true , address=145.79.227.49:4341 , piece_id=RBOQ42IOZAAZXE35PXOW6FITIIPUED6HQOKX3MZ3MJQJN7Z34NJQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.671365214 (191h9m57.687034823s) [noise=true , address=145.79.227.6:4262 , piece_id=3J4NH2MLBKVMF7WBUQCQGUJPSONQGTXEUHIIZBFMN5P6I2N4QXDQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:55.553326060 (191h9m58.568995658s) [upload=183651]: Next returned nil segment Mar 18 15:20:55.553350353 (191h9m58.569019965s) [upload=183651]: Waiting for error group managing segments... Mar 18 15:20:55.731225208 (191h9m58.746894812s) [noise=true , address=79.127.219.45:4855 , piece_id=EYM67437Z7OQ3J4VRCVH53FCRBRAEBERDK4Y5MPBM7EGPFHAIXUQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.877239140 (191h9m58.89290874s) [noise=true , address=145.79.227.7:4297 , piece_id=NLAHTGYCTU6KA4KEYXYNXJGIJCHPQH5LVD3A5LMT3G4S2X6HI6WQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.881970180 (191h9m58.897639791s) [noise=true , address=145.79.227.19:4083 , piece_id=GNMET2EJCABKI3ZEEY3U5SABD5PR4KAUCXVWEUJYRN7TO33QHEAA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.890259873 (191h9m58.905929478s) [noise=true , address=45.91.116.7:4012 , piece_id=KYPUR2EBM2QJWXJQG3VCHCCZLWCGLEF4HDXEJRU4YEXCHDWSTEDA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.895733842 (191h9m58.911403443s) [noise=true , address=145.79.227.6:4262 , piece_id=3J4NH2MLBKVMF7WBUQCQGUJPSONQGTXEUHIIZBFMN5P6I2N4QXDQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.922327749 (191h9m58.937997359s) [noise=true , address=145.79.227.14:4837 , piece_id=PQ2STQPAJZQTANRAMDKBTPFNSWGWV2Z4PF6MGUESOV7V35XI2Z6Q, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.935924481 (191h9m58.951594082s) [noise=true , address=145.79.227.50:4373 , piece_id=ZYW7ES3I3FN5TSJNJ57WX4JZZ7WCXBEXDQEEZGHXLSAMVV57JYUA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.490019568 (191h9m59.505689171s) [noise=true , address=77.90.31.14:4661 , piece_id=RIYVADNOLZAQSI55TC6QNMDHQRCCX6VJGWCXVHGEPNJWTYOLX5RQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.498992750 (191h9m59.51466235s) [noise=true , address=145.79.227.42:4123 , piece_id=C3AUR2K7GZPBX2O7HMPF3NS7SKPRJSCFHIFMARF5MNML32QPCJLA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.503673826 (191h9m59.519343429s) [noise=true , address=145.79.227.35:4484 , piece_id=4B5H6IWVZKFJFNPT2YFHHUJ7XPUK6JT7DHDSVYZNRXBGZUTM72TQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.584581917 (191h9m59.600251521s) [noise=true , address=45.91.116.13:4154 , piece_id=5C7TL3GT7YEUIUF6MQLHS5YQPWGU4HMVXJ3RXPHHQ4EUQ7WN2NBA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.596338514 (191h9m59.612008115s) [noise=true , address=145.79.227.49:4341 , piece_id=RBOQ42IOZAAZXE35PXOW6FITIIPUED6HQOKX3MZ3MJQJN7Z34NJQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.719952247 (191h9m59.735621857s) [noise=true , address=145.79.227.29:4945 , piece_id=YAW47YHT74Q5PRWVOGBDEIXGGCXWJBQZK4PKC334IRGB5WBY44OQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.719982026 (191h9m59.735651634s) [seg_pos={0 0}, upload=183651]: Satisfied cohort requirements after 13 pieces Mar 18 15:20:56.720279864 (191h9m59.735949473s) [noise=true , address=45.91.116.11:4120 , piece_id=GR4SEE5RUEY6BZRC3NM22LRTB5LRD7XEQARZ3HNV73BWEHW77Q6A, seg_pos={0 0}, upload=183651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: write tcp 139.59.144.22:42930->45.91.116.11:4120: use of closed network connection; write tcp 139.59.144.22:42930->45.91.116.11:4120: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42930->45.91.116.11:4120: use of closed network connection Mar 18 15:20:56.720290575 (191h9m59.735960184s) [noise=true , address=45.91.116.11:4120 , piece_id=GR4SEE5RUEY6BZRC3NM22LRTB5LRD7XEQARZ3HNV73BWEHW77Q6A, seg_pos={0 0}, upload=183651]: Long tail cancellation due to optimal threshold Mar 18 15:20:56.721072812 (191h9m59.736742422s) [noise=true , address=145.79.227.30:4764 , piece_id=OBRMP5YGOPFDUHOMR5FKU2GVWAF7EBC7QSNIXDZWFOM4TOWVXDOA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127hafVDbun7FoG4JdcogBmRNT6rhL2QQbLDLstFnx7HCWyiC9N): protocol: expected piece hash; context canceled; EOF Mar 18 15:20:56.721085662 (191h9m59.736755272s) [noise=true , address=145.79.227.30:4764 , piece_id=OBRMP5YGOPFDUHOMR5FKU2GVWAF7EBC7QSNIXDZWFOM4TOWVXDOA, seg_pos={0 0}, upload=183651]: Long tail cancellation due to optimal threshold Mar 18 15:20:56.721315732 (191h9m59.736985341s) [noise=true , address=145.79.227.41:4090 , piece_id=6JKG7VBPB54GTHPNX6W37KD64QK6SJAYL6UQSW5U3RAWL52SHFGA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UUnoD9p5FC7rq9fMSzu1phkFpsnPsu4UYxC59MhpMjJ6wUC6F): protocol: read tcp 139.59.144.22:41040->145.79.227.41:4090: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 18 15:20:56.721327176 (191h9m59.736996776s) [noise=true , address=145.79.227.41:4090 , piece_id=6JKG7VBPB54GTHPNX6W37KD64QK6SJAYL6UQSW5U3RAWL52SHFGA, seg_pos={0 0}, upload=183651]: Long tail cancellation due to optimal threshold Mar 18 15:20:56.721354703 (191h9m59.737024289s) [seg_pos={0 0}, upload=183651]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 18 15:20:56.721444047 (191h9m59.737113648s) [upload=183651]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 18 15:20:56.721450536 (191h9m59.737120136s) [upload=183651]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 15:20:56.945499978 (191h9m59.961169586s) [upload=183651]: Done uploading segments... Mar 18 15:20:56.945534492 (191h9m59.961204094s) [upload=183651]: Upload finished. err: <nil> Duration: 2.474741739s core uplink us-select-1
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [.......XX..XX...............................................] duration: 667.124009ms trace: https://jaeger.dev.storj.io/trace/2c31a8cce5d1c379 FAIL (2026-03-18 16:04:36 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 667.154828ms core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.364821645s trace: https://jaeger.dev.storj.io/trace/21b23d7305e037a FAIL (2026-03-18 16:04:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s, Piece ID: 3J4NH2MLBKVMF7WBUQCQGUJPSONQGTXEUHIIZBFMN5P6I2N4QXDQ) context deadline exceeded; piecestore: (Node ID: 1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, Piece ID: KYPUR2EBM2QJWXJQG3VCHCCZLWCGLEF4HDXEJRU4YEXCHDWSTEDA) context deadline exceeded; piecestore: (Node ID: 12AQGSkJuNJDxoeqhChUenWxHwF5yK41UESCF63FQz3XvabXXfz, Piece ID: ZYW7ES3I3FN5TSJNJ57WX4JZZ7WCXBEXDQEEZGHXLSAMVV57JYUA) context deadline exceeded; piecestore: (Node ID: 128kFn1ZsqrdV936j55GuKpnHdERmtBxcL4B9bZrnjeXMaLpfsP, Piece ID: YAW47YHT74Q5PRWVOGBDEIXGGCXWJBQZK4PKC334IRGB5WBY44OQ) context deadline exceeded ======LOGS====== upload=183651]: Starting upload Mar 18 15:20:54.303457115 (191h9m57.319126727s) [upload=183651]: Done starting upload Mar 18 15:20:54.303665912 (191h9m57.319335513s) [upload=183651]: Uploading segments... Mar 18 15:20:54.303965721 (191h9m57.319635311s) [upload=183651]: Got next segment. Inline: false Mar 18 15:20:54.304013634 (191h9m57.319683246s) [upload=183651]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 15:20:54.304021720 (191h9m57.319691334s) [upload=183651]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 18 15:20:54.662509110 (191h9m57.67817871s) [seg_pos={0 0}, upload=183651]: Begin upload segment... Mar 18 15:20:54.662562678 (191h9m57.678232268s) [seg_pos={0 0}, upload=183651]: Done begin upload segment. Mar 18 15:20:54.662592279 (191h9m57.67826188s) [noise=true , address=45.91.116.7:4012 , piece_id=KYPUR2EBM2QJWXJQG3VCHCCZLWCGLEF4HDXEJRU4YEXCHDWSTEDA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.664091904 (191h9m57.679761511s) [noise=true , address=145.79.227.42:4123 , piece_id=C3AUR2K7GZPBX2O7HMPF3NS7SKPRJSCFHIFMARF5MNML32QPCJLA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.664760971 (191h9m57.680430574s) [noise=true , address=145.79.227.50:4373 , piece_id=ZYW7ES3I3FN5TSJNJ57WX4JZZ7WCXBEXDQEEZGHXLSAMVV57JYUA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.665304567 (191h9m57.68097417s) [noise=true , address=145.79.227.29:4945 , piece_id=YAW47YHT74Q5PRWVOGBDEIXGGCXWJBQZK4PKC334IRGB5WBY44OQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.666050630 (191h9m57.68172024s) [noise=true , address=45.91.116.11:4120 , piece_id=GR4SEE5RUEY6BZRC3NM22LRTB5LRD7XEQARZ3HNV73BWEHW77Q6A, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.666631225 (191h9m57.682300831s) [noise=true , address=45.91.116.13:4154 , piece_id=5C7TL3GT7YEUIUF6MQLHS5YQPWGU4HMVXJ3RXPHHQ4EUQ7WN2NBA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.667041838 (191h9m57.68271144s) [noise=true , address=77.90.31.14:4661 , piece_id=RIYVADNOLZAQSI55TC6QNMDHQRCCX6VJGWCXVHGEPNJWTYOLX5RQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.667546703 (191h9m57.683216304s) [noise=true , address=145.79.227.19:4083 , piece_id=GNMET2EJCABKI3ZEEY3U5SABD5PR4KAUCXVWEUJYRN7TO33QHEAA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.668012057 (191h9m57.683681657s) [noise=true , address=145.79.227.41:4090 , piece_id=6JKG7VBPB54GTHPNX6W37KD64QK6SJAYL6UQSW5U3RAWL52SHFGA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.668448937 (191h9m57.684118543s) [noise=true , address=79.127.219.45:4855 , piece_id=EYM67437Z7OQ3J4VRCVH53FCRBRAEBERDK4Y5MPBM7EGPFHAIXUQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.668687476 (191h9m57.684357085s) [noise=true , address=145.79.227.35:4484 , piece_id=4B5H6IWVZKFJFNPT2YFHHUJ7XPUK6JT7DHDSVYZNRXBGZUTM72TQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.669348163 (191h9m57.685017763s) [noise=true , address=145.79.227.14:4837 , piece_id=PQ2STQPAJZQTANRAMDKBTPFNSWGWV2Z4PF6MGUESOV7V35XI2Z6Q, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.670185533 (191h9m57.685855138s) [noise=true , address=145.79.227.30:4764 , piece_id=OBRMP5YGOPFDUHOMR5FKU2GVWAF7EBC7QSNIXDZWFOM4TOWVXDOA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.670284943 (191h9m57.685954546s) [noise=true , address=145.79.227.7:4297 , piece_id=NLAHTGYCTU6KA4KEYXYNXJGIJCHPQH5LVD3A5LMT3G4S2X6HI6WQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.670802120 (191h9m57.686471739s) [noise=true , address=145.79.227.49:4341 , piece_id=RBOQ42IOZAAZXE35PXOW6FITIIPUED6HQOKX3MZ3MJQJN7Z34NJQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.671365214 (191h9m57.687034823s) [noise=true , address=145.79.227.6:4262 , piece_id=3J4NH2MLBKVMF7WBUQCQGUJPSONQGTXEUHIIZBFMN5P6I2N4QXDQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:55.553326060 (191h9m58.568995658s) [upload=183651]: Next returned nil segment Mar 18 15:20:55.553350353 (191h9m58.569019965s) [upload=183651]: Waiting for error group managing segments... Mar 18 15:20:55.731225208 (191h9m58.746894812s) [noise=true , address=79.127.219.45:4855 , piece_id=EYM67437Z7OQ3J4VRCVH53FCRBRAEBERDK4Y5MPBM7EGPFHAIXUQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.877239140 (191h9m58.89290874s) [noise=true , address=145.79.227.7:4297 , piece_id=NLAHTGYCTU6KA4KEYXYNXJGIJCHPQH5LVD3A5LMT3G4S2X6HI6WQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.881970180 (191h9m58.897639791s) [noise=true , address=145.79.227.19:4083 , piece_id=GNMET2EJCABKI3ZEEY3U5SABD5PR4KAUCXVWEUJYRN7TO33QHEAA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.890259873 (191h9m58.905929478s) [noise=true , address=45.91.116.7:4012 , piece_id=KYPUR2EBM2QJWXJQG3VCHCCZLWCGLEF4HDXEJRU4YEXCHDWSTEDA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.895733842 (191h9m58.911403443s) [noise=true , address=145.79.227.6:4262 , piece_id=3J4NH2MLBKVMF7WBUQCQGUJPSONQGTXEUHIIZBFMN5P6I2N4QXDQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.922327749 (191h9m58.937997359s) [noise=true , address=145.79.227.14:4837 , piece_id=PQ2STQPAJZQTANRAMDKBTPFNSWGWV2Z4PF6MGUESOV7V35XI2Z6Q, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.935924481 (191h9m58.951594082s) [noise=true , address=145.79.227.50:4373 , piece_id=ZYW7ES3I3FN5TSJNJ57WX4JZZ7WCXBEXDQEEZGHXLSAMVV57JYUA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.490019568 (191h9m59.505689171s) [noise=true , address=77.90.31.14:4661 , piece_id=RIYVADNOLZAQSI55TC6QNMDHQRCCX6VJGWCXVHGEPNJWTYOLX5RQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.498992750 (191h9m59.51466235s) [noise=true , address=145.79.227.42:4123 , piece_id=C3AUR2K7GZPBX2O7HMPF3NS7SKPRJSCFHIFMARF5MNML32QPCJLA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.503673826 (191h9m59.519343429s) [noise=true , address=145.79.227.35:4484 , piece_id=4B5H6IWVZKFJFNPT2YFHHUJ7XPUK6JT7DHDSVYZNRXBGZUTM72TQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.584581917 (191h9m59.600251521s) [noise=true , address=45.91.116.13:4154 , piece_id=5C7TL3GT7YEUIUF6MQLHS5YQPWGU4HMVXJ3RXPHHQ4EUQ7WN2NBA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.596338514 (191h9m59.612008115s) [noise=true , address=145.79.227.49:4341 , piece_id=RBOQ42IOZAAZXE35PXOW6FITIIPUED6HQOKX3MZ3MJQJN7Z34NJQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.719952247 (191h9m59.735621857s) [noise=true , address=145.79.227.29:4945 , piece_id=YAW47YHT74Q5PRWVOGBDEIXGGCXWJBQZK4PKC334IRGB5WBY44OQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.719982026 (191h9m59.735651634s) [seg_pos={0 0}, upload=183651]: Satisfied cohort requirements after 13 pieces Mar 18 15:20:56.720279864 (191h9m59.735949473s) [noise=true , address=45.91.116.11:4120 , piece_id=GR4SEE5RUEY6BZRC3NM22LRTB5LRD7XEQARZ3HNV73BWEHW77Q6A, seg_pos={0 0}, upload=183651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: write tcp 139.59.144.22:42930->45.91.116.11:4120: use of closed network connection; write tcp 139.59.144.22:42930->45.91.116.11:4120: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42930->45.91.116.11:4120: use of closed network connection Mar 18 15:20:56.720290575 (191h9m59.735960184s) [noise=true , address=45.91.116.11:4120 , piece_id=GR4SEE5RUEY6BZRC3NM22LRTB5LRD7XEQARZ3HNV73BWEHW77Q6A, seg_pos={0 0}, upload=183651]: Long tail cancellation due to optimal threshold Mar 18 15:20:56.721072812 (191h9m59.736742422s) [noise=true , address=145.79.227.30:4764 , piece_id=OBRMP5YGOPFDUHOMR5FKU2GVWAF7EBC7QSNIXDZWFOM4TOWVXDOA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127hafVDbun7FoG4JdcogBmRNT6rhL2QQbLDLstFnx7HCWyiC9N): protocol: expected piece hash; context canceled; EOF Mar 18 15:20:56.721085662 (191h9m59.736755272s) [noise=true , address=145.79.227.30:4764 , piece_id=OBRMP5YGOPFDUHOMR5FKU2GVWAF7EBC7QSNIXDZWFOM4TOWVXDOA, seg_pos={0 0}, upload=183651]: Long tail cancellation due to optimal threshold Mar 18 15:20:56.721315732 (191h9m59.736985341s) [noise=true , address=145.79.227.41:4090 , piece_id=6JKG7VBPB54GTHPNX6W37KD64QK6SJAYL6UQSW5U3RAWL52SHFGA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UUnoD9p5FC7rq9fMSzu1phkFpsnPsu4UYxC59MhpMjJ6wUC6F): protocol: read tcp 139.59.144.22:41040->145.79.227.41:4090: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 18 15:20:56.721327176 (191h9m59.736996776s) [noise=true , address=145.79.227.41:4090 , piece_id=6JKG7VBPB54GTHPNX6W37KD64QK6SJAYL6UQSW5U3RAWL52SHFGA, seg_pos={0 0}, upload=183651]: Long tail cancellation due to optimal threshold Mar 18 15:20:56.721354703 (191h9m59.737024289s) [seg_pos={0 0}, upload=183651]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 18 15:20:56.721444047 (191h9m59.737113648s) [upload=183651]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 18 15:20:56.721450536 (191h9m59.737120136s) [upload=183651]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 15:20:56.945499978 (191h9m59.961169586s) [upload=183651]: Done uploading segments... Mar 18 15:20:56.945534492 (191h9m59.961204094s) [upload=183651]: Upload finished. err: <nil> Duration: 2.364848424s core uplink us-select-1
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [........XX..XX..............................................] duration: 648.811321ms trace: https://jaeger.dev.storj.io/trace/2c31a8cce5d1c379 FAIL (2026-03-18 16:04:05 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 648.841306ms core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.394071487s trace: https://jaeger.dev.storj.io/trace/21b23d7305e037a FAIL (2026-03-18 16:03:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s, Piece ID: 3J4NH2MLBKVMF7WBUQCQGUJPSONQGTXEUHIIZBFMN5P6I2N4QXDQ) context deadline exceeded; piecestore: (Node ID: 1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, Piece ID: KYPUR2EBM2QJWXJQG3VCHCCZLWCGLEF4HDXEJRU4YEXCHDWSTEDA) context deadline exceeded; piecestore: (Node ID: 12AQGSkJuNJDxoeqhChUenWxHwF5yK41UESCF63FQz3XvabXXfz, Piece ID: ZYW7ES3I3FN5TSJNJ57WX4JZZ7WCXBEXDQEEZGHXLSAMVV57JYUA) context deadline exceeded; piecestore: (Node ID: 128kFn1ZsqrdV936j55GuKpnHdERmtBxcL4B9bZrnjeXMaLpfsP, Piece ID: YAW47YHT74Q5PRWVOGBDEIXGGCXWJBQZK4PKC334IRGB5WBY44OQ) context deadline exceeded ======LOGS====== upload=183651]: Starting upload Mar 18 15:20:54.303457115 (191h9m57.319126727s) [upload=183651]: Done starting upload Mar 18 15:20:54.303665912 (191h9m57.319335513s) [upload=183651]: Uploading segments... Mar 18 15:20:54.303965721 (191h9m57.319635311s) [upload=183651]: Got next segment. Inline: false Mar 18 15:20:54.304013634 (191h9m57.319683246s) [upload=183651]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 15:20:54.304021720 (191h9m57.319691334s) [upload=183651]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 18 15:20:54.662509110 (191h9m57.67817871s) [seg_pos={0 0}, upload=183651]: Begin upload segment... Mar 18 15:20:54.662562678 (191h9m57.678232268s) [seg_pos={0 0}, upload=183651]: Done begin upload segment. Mar 18 15:20:54.662592279 (191h9m57.67826188s) [noise=true , address=45.91.116.7:4012 , piece_id=KYPUR2EBM2QJWXJQG3VCHCCZLWCGLEF4HDXEJRU4YEXCHDWSTEDA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.664091904 (191h9m57.679761511s) [noise=true , address=145.79.227.42:4123 , piece_id=C3AUR2K7GZPBX2O7HMPF3NS7SKPRJSCFHIFMARF5MNML32QPCJLA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.664760971 (191h9m57.680430574s) [noise=true , address=145.79.227.50:4373 , piece_id=ZYW7ES3I3FN5TSJNJ57WX4JZZ7WCXBEXDQEEZGHXLSAMVV57JYUA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.665304567 (191h9m57.68097417s) [noise=true , address=145.79.227.29:4945 , piece_id=YAW47YHT74Q5PRWVOGBDEIXGGCXWJBQZK4PKC334IRGB5WBY44OQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.666050630 (191h9m57.68172024s) [noise=true , address=45.91.116.11:4120 , piece_id=GR4SEE5RUEY6BZRC3NM22LRTB5LRD7XEQARZ3HNV73BWEHW77Q6A, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.666631225 (191h9m57.682300831s) [noise=true , address=45.91.116.13:4154 , piece_id=5C7TL3GT7YEUIUF6MQLHS5YQPWGU4HMVXJ3RXPHHQ4EUQ7WN2NBA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.667041838 (191h9m57.68271144s) [noise=true , address=77.90.31.14:4661 , piece_id=RIYVADNOLZAQSI55TC6QNMDHQRCCX6VJGWCXVHGEPNJWTYOLX5RQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.667546703 (191h9m57.683216304s) [noise=true , address=145.79.227.19:4083 , piece_id=GNMET2EJCABKI3ZEEY3U5SABD5PR4KAUCXVWEUJYRN7TO33QHEAA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.668012057 (191h9m57.683681657s) [noise=true , address=145.79.227.41:4090 , piece_id=6JKG7VBPB54GTHPNX6W37KD64QK6SJAYL6UQSW5U3RAWL52SHFGA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.668448937 (191h9m57.684118543s) [noise=true , address=79.127.219.45:4855 , piece_id=EYM67437Z7OQ3J4VRCVH53FCRBRAEBERDK4Y5MPBM7EGPFHAIXUQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.668687476 (191h9m57.684357085s) [noise=true , address=145.79.227.35:4484 , piece_id=4B5H6IWVZKFJFNPT2YFHHUJ7XPUK6JT7DHDSVYZNRXBGZUTM72TQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.669348163 (191h9m57.685017763s) [noise=true , address=145.79.227.14:4837 , piece_id=PQ2STQPAJZQTANRAMDKBTPFNSWGWV2Z4PF6MGUESOV7V35XI2Z6Q, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.670185533 (191h9m57.685855138s) [noise=true , address=145.79.227.30:4764 , piece_id=OBRMP5YGOPFDUHOMR5FKU2GVWAF7EBC7QSNIXDZWFOM4TOWVXDOA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.670284943 (191h9m57.685954546s) [noise=true , address=145.79.227.7:4297 , piece_id=NLAHTGYCTU6KA4KEYXYNXJGIJCHPQH5LVD3A5LMT3G4S2X6HI6WQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.670802120 (191h9m57.686471739s) [noise=true , address=145.79.227.49:4341 , piece_id=RBOQ42IOZAAZXE35PXOW6FITIIPUED6HQOKX3MZ3MJQJN7Z34NJQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.671365214 (191h9m57.687034823s) [noise=true , address=145.79.227.6:4262 , piece_id=3J4NH2MLBKVMF7WBUQCQGUJPSONQGTXEUHIIZBFMN5P6I2N4QXDQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:55.553326060 (191h9m58.568995658s) [upload=183651]: Next returned nil segment Mar 18 15:20:55.553350353 (191h9m58.569019965s) [upload=183651]: Waiting for error group managing segments... Mar 18 15:20:55.731225208 (191h9m58.746894812s) [noise=true , address=79.127.219.45:4855 , piece_id=EYM67437Z7OQ3J4VRCVH53FCRBRAEBERDK4Y5MPBM7EGPFHAIXUQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.877239140 (191h9m58.89290874s) [noise=true , address=145.79.227.7:4297 , piece_id=NLAHTGYCTU6KA4KEYXYNXJGIJCHPQH5LVD3A5LMT3G4S2X6HI6WQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.881970180 (191h9m58.897639791s) [noise=true , address=145.79.227.19:4083 , piece_id=GNMET2EJCABKI3ZEEY3U5SABD5PR4KAUCXVWEUJYRN7TO33QHEAA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.890259873 (191h9m58.905929478s) [noise=true , address=45.91.116.7:4012 , piece_id=KYPUR2EBM2QJWXJQG3VCHCCZLWCGLEF4HDXEJRU4YEXCHDWSTEDA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.895733842 (191h9m58.911403443s) [noise=true , address=145.79.227.6:4262 , piece_id=3J4NH2MLBKVMF7WBUQCQGUJPSONQGTXEUHIIZBFMN5P6I2N4QXDQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.922327749 (191h9m58.937997359s) [noise=true , address=145.79.227.14:4837 , piece_id=PQ2STQPAJZQTANRAMDKBTPFNSWGWV2Z4PF6MGUESOV7V35XI2Z6Q, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.935924481 (191h9m58.951594082s) [noise=true , address=145.79.227.50:4373 , piece_id=ZYW7ES3I3FN5TSJNJ57WX4JZZ7WCXBEXDQEEZGHXLSAMVV57JYUA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.490019568 (191h9m59.505689171s) [noise=true , address=77.90.31.14:4661 , piece_id=RIYVADNOLZAQSI55TC6QNMDHQRCCX6VJGWCXVHGEPNJWTYOLX5RQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.498992750 (191h9m59.51466235s) [noise=true , address=145.79.227.42:4123 , piece_id=C3AUR2K7GZPBX2O7HMPF3NS7SKPRJSCFHIFMARF5MNML32QPCJLA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.503673826 (191h9m59.519343429s) [noise=true , address=145.79.227.35:4484 , piece_id=4B5H6IWVZKFJFNPT2YFHHUJ7XPUK6JT7DHDSVYZNRXBGZUTM72TQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.584581917 (191h9m59.600251521s) [noise=true , address=45.91.116.13:4154 , piece_id=5C7TL3GT7YEUIUF6MQLHS5YQPWGU4HMVXJ3RXPHHQ4EUQ7WN2NBA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.596338514 (191h9m59.612008115s) [noise=true , address=145.79.227.49:4341 , piece_id=RBOQ42IOZAAZXE35PXOW6FITIIPUED6HQOKX3MZ3MJQJN7Z34NJQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.719952247 (191h9m59.735621857s) [noise=true , address=145.79.227.29:4945 , piece_id=YAW47YHT74Q5PRWVOGBDEIXGGCXWJBQZK4PKC334IRGB5WBY44OQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.719982026 (191h9m59.735651634s) [seg_pos={0 0}, upload=183651]: Satisfied cohort requirements after 13 pieces Mar 18 15:20:56.720279864 (191h9m59.735949473s) [noise=true , address=45.91.116.11:4120 , piece_id=GR4SEE5RUEY6BZRC3NM22LRTB5LRD7XEQARZ3HNV73BWEHW77Q6A, seg_pos={0 0}, upload=183651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: write tcp 139.59.144.22:42930->45.91.116.11:4120: use of closed network connection; write tcp 139.59.144.22:42930->45.91.116.11:4120: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42930->45.91.116.11:4120: use of closed network connection Mar 18 15:20:56.720290575 (191h9m59.735960184s) [noise=true , address=45.91.116.11:4120 , piece_id=GR4SEE5RUEY6BZRC3NM22LRTB5LRD7XEQARZ3HNV73BWEHW77Q6A, seg_pos={0 0}, upload=183651]: Long tail cancellation due to optimal threshold Mar 18 15:20:56.721072812 (191h9m59.736742422s) [noise=true , address=145.79.227.30:4764 , piece_id=OBRMP5YGOPFDUHOMR5FKU2GVWAF7EBC7QSNIXDZWFOM4TOWVXDOA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127hafVDbun7FoG4JdcogBmRNT6rhL2QQbLDLstFnx7HCWyiC9N): protocol: expected piece hash; context canceled; EOF Mar 18 15:20:56.721085662 (191h9m59.736755272s) [noise=true , address=145.79.227.30:4764 , piece_id=OBRMP5YGOPFDUHOMR5FKU2GVWAF7EBC7QSNIXDZWFOM4TOWVXDOA, seg_pos={0 0}, upload=183651]: Long tail cancellation due to optimal threshold Mar 18 15:20:56.721315732 (191h9m59.736985341s) [noise=true , address=145.79.227.41:4090 , piece_id=6JKG7VBPB54GTHPNX6W37KD64QK6SJAYL6UQSW5U3RAWL52SHFGA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UUnoD9p5FC7rq9fMSzu1phkFpsnPsu4UYxC59MhpMjJ6wUC6F): protocol: read tcp 139.59.144.22:41040->145.79.227.41:4090: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 18 15:20:56.721327176 (191h9m59.736996776s) [noise=true , address=145.79.227.41:4090 , piece_id=6JKG7VBPB54GTHPNX6W37KD64QK6SJAYL6UQSW5U3RAWL52SHFGA, seg_pos={0 0}, upload=183651]: Long tail cancellation due to optimal threshold Mar 18 15:20:56.721354703 (191h9m59.737024289s) [seg_pos={0 0}, upload=183651]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 18 15:20:56.721444047 (191h9m59.737113648s) [upload=183651]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 18 15:20:56.721450536 (191h9m59.737120136s) [upload=183651]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 15:20:56.945499978 (191h9m59.961169586s) [upload=183651]: Done uploading segments... Mar 18 15:20:56.945534492 (191h9m59.961204094s) [upload=183651]: Upload finished. err: <nil> Duration: 2.394184303s core uplink us-select-1
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [.........XX..XX.............................................] duration: 755.95329ms trace: https://jaeger.dev.storj.io/trace/2c31a8cce5d1c379 FAIL (2026-03-18 16:03:04 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 755.990483ms core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.368728176s trace: https://jaeger.dev.storj.io/trace/21b23d7305e037a FAIL (2026-03-18 16:02:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s, Piece ID: 3J4NH2MLBKVMF7WBUQCQGUJPSONQGTXEUHIIZBFMN5P6I2N4QXDQ) context deadline exceeded; piecestore: (Node ID: 1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, Piece ID: KYPUR2EBM2QJWXJQG3VCHCCZLWCGLEF4HDXEJRU4YEXCHDWSTEDA) context deadline exceeded; piecestore: (Node ID: 12AQGSkJuNJDxoeqhChUenWxHwF5yK41UESCF63FQz3XvabXXfz, Piece ID: ZYW7ES3I3FN5TSJNJ57WX4JZZ7WCXBEXDQEEZGHXLSAMVV57JYUA) context deadline exceeded; piecestore: (Node ID: 128kFn1ZsqrdV936j55GuKpnHdERmtBxcL4B9bZrnjeXMaLpfsP, Piece ID: YAW47YHT74Q5PRWVOGBDEIXGGCXWJBQZK4PKC334IRGB5WBY44OQ) context deadline exceeded ======LOGS====== upload=183651]: Starting upload Mar 18 15:20:54.303457115 (191h9m57.319126727s) [upload=183651]: Done starting upload Mar 18 15:20:54.303665912 (191h9m57.319335513s) [upload=183651]: Uploading segments... Mar 18 15:20:54.303965721 (191h9m57.319635311s) [upload=183651]: Got next segment. Inline: false Mar 18 15:20:54.304013634 (191h9m57.319683246s) [upload=183651]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 15:20:54.304021720 (191h9m57.319691334s) [upload=183651]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 18 15:20:54.662509110 (191h9m57.67817871s) [seg_pos={0 0}, upload=183651]: Begin upload segment... Mar 18 15:20:54.662562678 (191h9m57.678232268s) [seg_pos={0 0}, upload=183651]: Done begin upload segment. Mar 18 15:20:54.662592279 (191h9m57.67826188s) [noise=true , address=45.91.116.7:4012 , piece_id=KYPUR2EBM2QJWXJQG3VCHCCZLWCGLEF4HDXEJRU4YEXCHDWSTEDA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.664091904 (191h9m57.679761511s) [noise=true , address=145.79.227.42:4123 , piece_id=C3AUR2K7GZPBX2O7HMPF3NS7SKPRJSCFHIFMARF5MNML32QPCJLA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.664760971 (191h9m57.680430574s) [noise=true , address=145.79.227.50:4373 , piece_id=ZYW7ES3I3FN5TSJNJ57WX4JZZ7WCXBEXDQEEZGHXLSAMVV57JYUA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.665304567 (191h9m57.68097417s) [noise=true , address=145.79.227.29:4945 , piece_id=YAW47YHT74Q5PRWVOGBDEIXGGCXWJBQZK4PKC334IRGB5WBY44OQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.666050630 (191h9m57.68172024s) [noise=true , address=45.91.116.11:4120 , piece_id=GR4SEE5RUEY6BZRC3NM22LRTB5LRD7XEQARZ3HNV73BWEHW77Q6A, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.666631225 (191h9m57.682300831s) [noise=true , address=45.91.116.13:4154 , piece_id=5C7TL3GT7YEUIUF6MQLHS5YQPWGU4HMVXJ3RXPHHQ4EUQ7WN2NBA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.667041838 (191h9m57.68271144s) [noise=true , address=77.90.31.14:4661 , piece_id=RIYVADNOLZAQSI55TC6QNMDHQRCCX6VJGWCXVHGEPNJWTYOLX5RQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.667546703 (191h9m57.683216304s) [noise=true , address=145.79.227.19:4083 , piece_id=GNMET2EJCABKI3ZEEY3U5SABD5PR4KAUCXVWEUJYRN7TO33QHEAA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.668012057 (191h9m57.683681657s) [noise=true , address=145.79.227.41:4090 , piece_id=6JKG7VBPB54GTHPNX6W37KD64QK6SJAYL6UQSW5U3RAWL52SHFGA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.668448937 (191h9m57.684118543s) [noise=true , address=79.127.219.45:4855 , piece_id=EYM67437Z7OQ3J4VRCVH53FCRBRAEBERDK4Y5MPBM7EGPFHAIXUQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.668687476 (191h9m57.684357085s) [noise=true , address=145.79.227.35:4484 , piece_id=4B5H6IWVZKFJFNPT2YFHHUJ7XPUK6JT7DHDSVYZNRXBGZUTM72TQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.669348163 (191h9m57.685017763s) [noise=true , address=145.79.227.14:4837 , piece_id=PQ2STQPAJZQTANRAMDKBTPFNSWGWV2Z4PF6MGUESOV7V35XI2Z6Q, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.670185533 (191h9m57.685855138s) [noise=true , address=145.79.227.30:4764 , piece_id=OBRMP5YGOPFDUHOMR5FKU2GVWAF7EBC7QSNIXDZWFOM4TOWVXDOA, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.670284943 (191h9m57.685954546s) [noise=true , address=145.79.227.7:4297 , piece_id=NLAHTGYCTU6KA4KEYXYNXJGIJCHPQH5LVD3A5LMT3G4S2X6HI6WQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.670802120 (191h9m57.686471739s) [noise=true , address=145.79.227.49:4341 , piece_id=RBOQ42IOZAAZXE35PXOW6FITIIPUED6HQOKX3MZ3MJQJN7Z34NJQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:54.671365214 (191h9m57.687034823s) [noise=true , address=145.79.227.6:4262 , piece_id=3J4NH2MLBKVMF7WBUQCQGUJPSONQGTXEUHIIZBFMN5P6I2N4QXDQ, seg_pos={0 0}, upload=183651]: Uploading piece... Mar 18 15:20:55.553326060 (191h9m58.568995658s) [upload=183651]: Next returned nil segment Mar 18 15:20:55.553350353 (191h9m58.569019965s) [upload=183651]: Waiting for error group managing segments... Mar 18 15:20:55.731225208 (191h9m58.746894812s) [noise=true , address=79.127.219.45:4855 , piece_id=EYM67437Z7OQ3J4VRCVH53FCRBRAEBERDK4Y5MPBM7EGPFHAIXUQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.877239140 (191h9m58.89290874s) [noise=true , address=145.79.227.7:4297 , piece_id=NLAHTGYCTU6KA4KEYXYNXJGIJCHPQH5LVD3A5LMT3G4S2X6HI6WQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.881970180 (191h9m58.897639791s) [noise=true , address=145.79.227.19:4083 , piece_id=GNMET2EJCABKI3ZEEY3U5SABD5PR4KAUCXVWEUJYRN7TO33QHEAA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.890259873 (191h9m58.905929478s) [noise=true , address=45.91.116.7:4012 , piece_id=KYPUR2EBM2QJWXJQG3VCHCCZLWCGLEF4HDXEJRU4YEXCHDWSTEDA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.895733842 (191h9m58.911403443s) [noise=true , address=145.79.227.6:4262 , piece_id=3J4NH2MLBKVMF7WBUQCQGUJPSONQGTXEUHIIZBFMN5P6I2N4QXDQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.922327749 (191h9m58.937997359s) [noise=true , address=145.79.227.14:4837 , piece_id=PQ2STQPAJZQTANRAMDKBTPFNSWGWV2Z4PF6MGUESOV7V35XI2Z6Q, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:55.935924481 (191h9m58.951594082s) [noise=true , address=145.79.227.50:4373 , piece_id=ZYW7ES3I3FN5TSJNJ57WX4JZZ7WCXBEXDQEEZGHXLSAMVV57JYUA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.490019568 (191h9m59.505689171s) [noise=true , address=77.90.31.14:4661 , piece_id=RIYVADNOLZAQSI55TC6QNMDHQRCCX6VJGWCXVHGEPNJWTYOLX5RQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.498992750 (191h9m59.51466235s) [noise=true , address=145.79.227.42:4123 , piece_id=C3AUR2K7GZPBX2O7HMPF3NS7SKPRJSCFHIFMARF5MNML32QPCJLA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.503673826 (191h9m59.519343429s) [noise=true , address=145.79.227.35:4484 , piece_id=4B5H6IWVZKFJFNPT2YFHHUJ7XPUK6JT7DHDSVYZNRXBGZUTM72TQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.584581917 (191h9m59.600251521s) [noise=true , address=45.91.116.13:4154 , piece_id=5C7TL3GT7YEUIUF6MQLHS5YQPWGU4HMVXJ3RXPHHQ4EUQ7WN2NBA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.596338514 (191h9m59.612008115s) [noise=true , address=145.79.227.49:4341 , piece_id=RBOQ42IOZAAZXE35PXOW6FITIIPUED6HQOKX3MZ3MJQJN7Z34NJQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.719952247 (191h9m59.735621857s) [noise=true , address=145.79.227.29:4945 , piece_id=YAW47YHT74Q5PRWVOGBDEIXGGCXWJBQZK4PKC334IRGB5WBY44OQ, seg_pos={0 0}, upload=183651]: Done uploading piece. err: <nil> Mar 18 15:20:56.719982026 (191h9m59.735651634s) [seg_pos={0 0}, upload=183651]: Satisfied cohort requirements after 13 pieces Mar 18 15:20:56.720279864 (191h9m59.735949473s) [noise=true , address=45.91.116.11:4120 , piece_id=GR4SEE5RUEY6BZRC3NM22LRTB5LRD7XEQARZ3HNV73BWEHW77Q6A, seg_pos={0 0}, upload=183651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: write tcp 139.59.144.22:42930->45.91.116.11:4120: use of closed network connection; write tcp 139.59.144.22:42930->45.91.116.11:4120: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42930->45.91.116.11:4120: use of closed network connection Mar 18 15:20:56.720290575 (191h9m59.735960184s) [noise=true , address=45.91.116.11:4120 , piece_id=GR4SEE5RUEY6BZRC3NM22LRTB5LRD7XEQARZ3HNV73BWEHW77Q6A, seg_pos={0 0}, upload=183651]: Long tail cancellation due to optimal threshold Mar 18 15:20:56.721072812 (191h9m59.736742422s) [noise=true , address=145.79.227.30:4764 , piece_id=OBRMP5YGOPFDUHOMR5FKU2GVWAF7EBC7QSNIXDZWFOM4TOWVXDOA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127hafVDbun7FoG4JdcogBmRNT6rhL2QQbLDLstFnx7HCWyiC9N): protocol: expected piece hash; context canceled; EOF Mar 18 15:20:56.721085662 (191h9m59.736755272s) [noise=true , address=145.79.227.30:4764 , piece_id=OBRMP5YGOPFDUHOMR5FKU2GVWAF7EBC7QSNIXDZWFOM4TOWVXDOA, seg_pos={0 0}, upload=183651]: Long tail cancellation due to optimal threshold Mar 18 15:20:56.721315732 (191h9m59.736985341s) [noise=true , address=145.79.227.41:4090 , piece_id=6JKG7VBPB54GTHPNX6W37KD64QK6SJAYL6UQSW5U3RAWL52SHFGA, seg_pos={0 0}, upload=183651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UUnoD9p5FC7rq9fMSzu1phkFpsnPsu4UYxC59MhpMjJ6wUC6F): protocol: read tcp 139.59.144.22:41040->145.79.227.41:4090: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 18 15:20:56.721327176 (191h9m59.736996776s) [noise=true , address=145.79.227.41:4090 , piece_id=6JKG7VBPB54GTHPNX6W37KD64QK6SJAYL6UQSW5U3RAWL52SHFGA, seg_pos={0 0}, upload=183651]: Long tail cancellation due to optimal threshold Mar 18 15:20:56.721354703 (191h9m59.737024289s) [seg_pos={0 0}, upload=183651]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 18 15:20:56.721444047 (191h9m59.737113648s) [upload=183651]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 18 15:20:56.721450536 (191h9m59.737120136s) [upload=183651]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 15:20:56.945499978 (191h9m59.961169586s) [upload=183651]: Done uploading segments... Mar 18 15:20:56.945534492 (191h9m59.961204094s) [upload=183651]: Upload finished. err: <nil> Duration: 2.368757153s core uplink us-select-1

Orbiter Check History

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)