Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
521.402389ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 17:15:24 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 521.439309ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
519.732109ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 17:14:18 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 519.762633ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
527.036822ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 17:13:57 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 527.073804ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
527.286232ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 17:12:52 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 527.329851ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
520.041622ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 17:12:09 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 520.06835ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
517.791467ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 17:11:10 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 517.840413ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
514.209304ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 17:10:18 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 514.234621ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
522.767806ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 17:09:50 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 522.866039ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
519.637097ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 17:09:32 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 519.666482ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
509.607463ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 17:08:58 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 509.636916ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
522.47253ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 17:08:13 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 522.497131ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
523.457687ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 17:07:22 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 523.490138ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
511.669213ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 17:06:47 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 511.704425ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
555.940254ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 17:05:43 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 556.041899ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
521.393282ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 17:04:34 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 521.428234ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
511.700132ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 17:04:10 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 511.729916ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
524.299463ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 17:03:20 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 524.332575ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
513.684785ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 17:02:40 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 513.711506ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
529.24095ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 17:01:58 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 529.270974ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
522.230913ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 17:00:52 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 522.260371ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
528.616053ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 16:59:59 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 528.79105ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
523.682251ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 16:58:55 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 523.706058ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
520.137441ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 16:58:08 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 520.226224ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
512.68224ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 16:57:19 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 512.733068ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
514.922831ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 16:56:28 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 514.950193ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
514.666343ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 16:55:59 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 514.705052ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
520.204727ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 16:54:53 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 520.288532ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
525.047792ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 16:54:34 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 525.092675ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
507.14118ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 16:53:49 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 507.172178ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
520.748599ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 16:53:02 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 520.782781ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
528.581358ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 16:51:49 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 528.610288ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
522.280733ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 16:51:02 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 522.308527ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
498.442867ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 16:50:26 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 498.46557ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
505.676271ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 16:49:26 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 505.727688ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
511.719335ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 16:48:32 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 511.752869ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
549.47572ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 16:48:14 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 549.502679ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
510.700384ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 16:47:21 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 510.750714ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
536.288302ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 16:46:20 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 536.317077ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
526.578366ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 16:45:15 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 526.613433ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
176.481129ms target:
https://ap1.storj.io/login
FAIL (2025-10-06 16:44:36 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: connect: connection refused
Duration: 176.512662ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.508233543s
FAIL (2025-10-06 16:33:59 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 6 15:48:28.323181802 (314h18m16.126646393s) [upload=276569]: Starting upload
Oct 6 15:48:28.323273509 (314h18m16.126738087s) [upload=276569]: Done starting upload
Oct 6 15:48:28.323405962 (314h18m16.12687054s) [upload=276569]: Uploading segments...
Oct 6 15:48:28.324175266 (314h18m16.127639865s) [upload=276569]: Got next segment. Inline: false
Oct 6 15:48:28.324234736 (314h18m16.127699327s) [upload=276569]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 6 15:48:28.324241207 (314h18m16.127705799s) [upload=276569]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 6 15:48:28.448109636 (314h18m16.251574228s) [seg_pos={0 0}, upload=276569]: Begin upload segment...
Oct 6 15:48:28.448178380 (314h18m16.25164297s) [seg_pos={0 0}, upload=276569]: Done begin upload segment.
Oct 6 15:48:28.448207497 (314h18m16.251672094s) [noise=true , address=45.91.116.10:4082 , piece_id=5JKIFAIDG5ZRICLZSJZSBHYTQVS5EI4MBPTLCE5U6DV3QU56OMRQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.449447618 (314h18m16.252912218s) [noise=true , address=145.79.227.19:4079 , piece_id=AZYCXUE5VDSQ7I2GMXAZMNDC5AQKPZSQWL6A6HXR5ASX3P3DKTGQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.450272425 (314h18m16.253737017s) [noise=true , address=145.79.227.16:4910 , piece_id=O7N234LDGO4MSYC4RAC3F4WLKZBUBUKMZ2OLCBQU3F2WONHA5COA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.450628085 (314h18m16.254092685s) [noise=true , address=145.79.227.7:4295 , piece_id=ISTGXKKTT6DIP3THAGG26O22MWDJY3HFTK5M3B3UTCS3SFND3QEA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.451240193 (314h18m16.254704783s) [noise=true , address=145.79.227.7:4294 , piece_id=D334YG6DNFM47LGYUEMT3SU3LF5RCCOFG3NEA5LYAZJQRZSW72EQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.451713584 (314h18m16.255178192s) [noise=true , address=45.91.116.5:4298 , piece_id=B5GWVEHSNBZ3XVZLJAXTLZQCWESLWT6CLG3N7LYNK42FN2DJ6LZA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.452167920 (314h18m16.255632514s) [noise=true , address=77.90.31.15:4699 , piece_id=RRMAEKMQC76UDN57IJPWDJ3EEPGAI3ZV5J5CMEP7ZJVXDTUW6L4Q, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.452525996 (314h18m16.255990589s) [noise=true , address=145.79.227.13:4804 , piece_id=675BJQLFIPFRRMXBCXUWHMBXATHGCJA5J4DSIDPZDVCPO2ZXJJFQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.452921615 (314h18m16.256386209s) [noise=true , address=145.79.227.17:4972 , piece_id=4PHRQYM6AWFRTGPT5CTTAACFDIXTPZGMNXOQFKSSKTGVBXPDDB7A, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.453338920 (314h18m16.256803514s) [noise=true , address=77.90.31.10:4517 , piece_id=Y56CSTTJSWPMQD5OLVIPPW7FH64RAXX2BK3VLHMEMCLLWPGZ6DZA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.453701634 (314h18m16.257166228s) [noise=true , address=45.91.116.13:4153 , piece_id=6JH44B3EJNZM2CXWAFUTURG5CEO2OY2JJF2R7DRVUOUPB42PCCJA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.454306789 (314h18m16.257771383s) [noise=true , address=145.79.227.3:4151 , piece_id=MBFF7B5GRVYQWKI5H3R3NAZQTSEN3T5BYDKUQGF7PCJZW5HD5PHQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.454638758 (314h18m16.25810335s) [noise=true , address=45.91.116.6:4975 , piece_id=6ZCJH35VKWJGGHD7TGKH6BVNALDXYK373KFPXS7PVNCROT6VJTSA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.454930199 (314h18m16.258394793s) [noise=true , address=145.79.227.18:4005 , piece_id=57ILRUIJN7GJXVOHFX4UZYWQXLSRSUJUU4OMR4SYAWCL4657MXBQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.455218559 (314h18m16.258683153s) [noise=true , address=45.91.116.4:4938 , piece_id=FIBMEUI7YFRHS64EKIFDJV3UWOZXOXHSU73R3DPFXN4NMHNPGLHA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.455494726 (314h18m16.258959319s) [noise=true , address=45.91.116.14:4191 , piece_id=YGUDAIHMX4CVJ3ICZI5VCLAHQWEJHKHYLGZ2APHV3DQ7O4NDVRUA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:29.063359790 (314h18m16.866824384s) [upload=276569]: Next returned nil segment
Oct 6 15:48:29.063385773 (314h18m16.866850366s) [upload=276569]: Waiting for error group managing segments...
Oct 6 15:48:29.207573603 (314h18m17.011038185s) [noise=true , address=45.91.116.4:4938 , piece_id=FIBMEUI7YFRHS64EKIFDJV3UWOZXOXHSU73R3DPFXN4NMHNPGLHA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.210676593 (314h18m17.01414117s) [noise=true , address=45.91.116.13:4153 , piece_id=6JH44B3EJNZM2CXWAFUTURG5CEO2OY2JJF2R7DRVUOUPB42PCCJA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.251463356 (314h18m17.054927939s) [noise=true , address=145.79.227.13:4804 , piece_id=675BJQLFIPFRRMXBCXUWHMBXATHGCJA5J4DSIDPZDVCPO2ZXJJFQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.257610190 (314h18m17.061074773s) [noise=true , address=145.79.227.19:4079 , piece_id=AZYCXUE5VDSQ7I2GMXAZMNDC5AQKPZSQWL6A6HXR5ASX3P3DKTGQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.258398549 (314h18m17.061863126s) [noise=true , address=145.79.227.16:4910 , piece_id=O7N234LDGO4MSYC4RAC3F4WLKZBUBUKMZ2OLCBQU3F2WONHA5COA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.259387548 (314h18m17.062852127s) [noise=true , address=145.79.227.17:4972 , piece_id=4PHRQYM6AWFRTGPT5CTTAACFDIXTPZGMNXOQFKSSKTGVBXPDDB7A, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.262359616 (314h18m17.065824194s) [noise=true , address=145.79.227.7:4294 , piece_id=D334YG6DNFM47LGYUEMT3SU3LF5RCCOFG3NEA5LYAZJQRZSW72EQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.264785106 (314h18m17.068249686s) [noise=true , address=145.79.227.7:4295 , piece_id=ISTGXKKTT6DIP3THAGG26O22MWDJY3HFTK5M3B3UTCS3SFND3QEA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.280441321 (314h18m17.083905901s) [noise=true , address=145.79.227.18:4005 , piece_id=57ILRUIJN7GJXVOHFX4UZYWQXLSRSUJUU4OMR4SYAWCL4657MXBQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.280499248 (314h18m17.083963828s) [noise=true , address=145.79.227.3:4151 , piece_id=MBFF7B5GRVYQWKI5H3R3NAZQTSEN3T5BYDKUQGF7PCJZW5HD5PHQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.283118885 (314h18m17.08658347s) [noise=true , address=45.91.116.14:4191 , piece_id=YGUDAIHMX4CVJ3ICZI5VCLAHQWEJHKHYLGZ2APHV3DQ7O4NDVRUA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.284525898 (314h18m17.087990475s) [noise=true , address=77.90.31.15:4699 , piece_id=RRMAEKMQC76UDN57IJPWDJ3EEPGAI3ZV5J5CMEP7ZJVXDTUW6L4Q, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.287866544 (314h18m17.091331136s) [noise=true , address=77.90.31.10:4517 , piece_id=Y56CSTTJSWPMQD5OLVIPPW7FH64RAXX2BK3VLHMEMCLLWPGZ6DZA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.287890841 (314h18m17.091355441s) [seg_pos={0 0}, upload=276569]: Segment reached optimal threshold of 13 pieces.
Oct 6 15:48:29.288021612 (314h18m17.091486198s) [noise=true , address=45.91.116.6:4975 , piece_id=6ZCJH35VKWJGGHD7TGKH6BVNALDXYK373KFPXS7PVNCROT6VJTSA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Oct 6 15:48:29.288034623 (314h18m17.091499215s) [noise=true , address=45.91.116.6:4975 , piece_id=6ZCJH35VKWJGGHD7TGKH6BVNALDXYK373KFPXS7PVNCROT6VJTSA, seg_pos={0 0}, upload=276569]: Long tail cancellation due to optimal threshold
Oct 6 15:48:29.288147194 (314h18m17.091611786s) [noise=true , address=45.91.116.5:4298 , piece_id=B5GWVEHSNBZ3XVZLJAXTLZQCWESLWT6CLG3N7LYNK42FN2DJ6LZA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Oct 6 15:48:29.288156173 (314h18m17.091620769s) [noise=true , address=45.91.116.5:4298 , piece_id=B5GWVEHSNBZ3XVZLJAXTLZQCWESLWT6CLG3N7LYNK42FN2DJ6LZA, seg_pos={0 0}, upload=276569]: Long tail cancellation due to optimal threshold
Oct 6 15:48:29.288225500 (314h18m17.09169009s) [noise=true , address=45.91.116.10:4082 , piece_id=5JKIFAIDG5ZRICLZSJZSBHYTQVS5EI4MBPTLCE5U6DV3QU56OMRQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Oct 6 15:48:29.288234451 (314h18m17.091699042s) [noise=true , address=45.91.116.10:4082 , piece_id=5JKIFAIDG5ZRICLZSJZSBHYTQVS5EI4MBPTLCE5U6DV3QU56OMRQ, seg_pos={0 0}, upload=276569]: Long tail cancellation due to optimal threshold
Oct 6 15:48:29.288261295 (314h18m17.091725984s) [seg_pos={0 0}, upload=276569]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 6 15:48:29.288342320 (314h18m17.091806917s) [upload=276569]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 6 15:48:29.288349544 (314h18m17.091814144s) [upload=276569]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 6 15:49:14.636526649 (314h19m2.439991241s) [upload=276569]: Done uploading segments...
Oct 6 15:49:14.636563271 (314h19m2.440027867s) [upload=276569]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.508267775s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.449163435s
FAIL (2025-10-06 16:32:46 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 6 15:48:28.323181802 (314h18m16.126646393s) [upload=276569]: Starting upload
Oct 6 15:48:28.323273509 (314h18m16.126738087s) [upload=276569]: Done starting upload
Oct 6 15:48:28.323405962 (314h18m16.12687054s) [upload=276569]: Uploading segments...
Oct 6 15:48:28.324175266 (314h18m16.127639865s) [upload=276569]: Got next segment. Inline: false
Oct 6 15:48:28.324234736 (314h18m16.127699327s) [upload=276569]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 6 15:48:28.324241207 (314h18m16.127705799s) [upload=276569]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 6 15:48:28.448109636 (314h18m16.251574228s) [seg_pos={0 0}, upload=276569]: Begin upload segment...
Oct 6 15:48:28.448178380 (314h18m16.25164297s) [seg_pos={0 0}, upload=276569]: Done begin upload segment.
Oct 6 15:48:28.448207497 (314h18m16.251672094s) [noise=true , address=45.91.116.10:4082 , piece_id=5JKIFAIDG5ZRICLZSJZSBHYTQVS5EI4MBPTLCE5U6DV3QU56OMRQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.449447618 (314h18m16.252912218s) [noise=true , address=145.79.227.19:4079 , piece_id=AZYCXUE5VDSQ7I2GMXAZMNDC5AQKPZSQWL6A6HXR5ASX3P3DKTGQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.450272425 (314h18m16.253737017s) [noise=true , address=145.79.227.16:4910 , piece_id=O7N234LDGO4MSYC4RAC3F4WLKZBUBUKMZ2OLCBQU3F2WONHA5COA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.450628085 (314h18m16.254092685s) [noise=true , address=145.79.227.7:4295 , piece_id=ISTGXKKTT6DIP3THAGG26O22MWDJY3HFTK5M3B3UTCS3SFND3QEA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.451240193 (314h18m16.254704783s) [noise=true , address=145.79.227.7:4294 , piece_id=D334YG6DNFM47LGYUEMT3SU3LF5RCCOFG3NEA5LYAZJQRZSW72EQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.451713584 (314h18m16.255178192s) [noise=true , address=45.91.116.5:4298 , piece_id=B5GWVEHSNBZ3XVZLJAXTLZQCWESLWT6CLG3N7LYNK42FN2DJ6LZA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.452167920 (314h18m16.255632514s) [noise=true , address=77.90.31.15:4699 , piece_id=RRMAEKMQC76UDN57IJPWDJ3EEPGAI3ZV5J5CMEP7ZJVXDTUW6L4Q, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.452525996 (314h18m16.255990589s) [noise=true , address=145.79.227.13:4804 , piece_id=675BJQLFIPFRRMXBCXUWHMBXATHGCJA5J4DSIDPZDVCPO2ZXJJFQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.452921615 (314h18m16.256386209s) [noise=true , address=145.79.227.17:4972 , piece_id=4PHRQYM6AWFRTGPT5CTTAACFDIXTPZGMNXOQFKSSKTGVBXPDDB7A, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.453338920 (314h18m16.256803514s) [noise=true , address=77.90.31.10:4517 , piece_id=Y56CSTTJSWPMQD5OLVIPPW7FH64RAXX2BK3VLHMEMCLLWPGZ6DZA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.453701634 (314h18m16.257166228s) [noise=true , address=45.91.116.13:4153 , piece_id=6JH44B3EJNZM2CXWAFUTURG5CEO2OY2JJF2R7DRVUOUPB42PCCJA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.454306789 (314h18m16.257771383s) [noise=true , address=145.79.227.3:4151 , piece_id=MBFF7B5GRVYQWKI5H3R3NAZQTSEN3T5BYDKUQGF7PCJZW5HD5PHQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.454638758 (314h18m16.25810335s) [noise=true , address=45.91.116.6:4975 , piece_id=6ZCJH35VKWJGGHD7TGKH6BVNALDXYK373KFPXS7PVNCROT6VJTSA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.454930199 (314h18m16.258394793s) [noise=true , address=145.79.227.18:4005 , piece_id=57ILRUIJN7GJXVOHFX4UZYWQXLSRSUJUU4OMR4SYAWCL4657MXBQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.455218559 (314h18m16.258683153s) [noise=true , address=45.91.116.4:4938 , piece_id=FIBMEUI7YFRHS64EKIFDJV3UWOZXOXHSU73R3DPFXN4NMHNPGLHA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.455494726 (314h18m16.258959319s) [noise=true , address=45.91.116.14:4191 , piece_id=YGUDAIHMX4CVJ3ICZI5VCLAHQWEJHKHYLGZ2APHV3DQ7O4NDVRUA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:29.063359790 (314h18m16.866824384s) [upload=276569]: Next returned nil segment
Oct 6 15:48:29.063385773 (314h18m16.866850366s) [upload=276569]: Waiting for error group managing segments...
Oct 6 15:48:29.207573603 (314h18m17.011038185s) [noise=true , address=45.91.116.4:4938 , piece_id=FIBMEUI7YFRHS64EKIFDJV3UWOZXOXHSU73R3DPFXN4NMHNPGLHA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.210676593 (314h18m17.01414117s) [noise=true , address=45.91.116.13:4153 , piece_id=6JH44B3EJNZM2CXWAFUTURG5CEO2OY2JJF2R7DRVUOUPB42PCCJA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.251463356 (314h18m17.054927939s) [noise=true , address=145.79.227.13:4804 , piece_id=675BJQLFIPFRRMXBCXUWHMBXATHGCJA5J4DSIDPZDVCPO2ZXJJFQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.257610190 (314h18m17.061074773s) [noise=true , address=145.79.227.19:4079 , piece_id=AZYCXUE5VDSQ7I2GMXAZMNDC5AQKPZSQWL6A6HXR5ASX3P3DKTGQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.258398549 (314h18m17.061863126s) [noise=true , address=145.79.227.16:4910 , piece_id=O7N234LDGO4MSYC4RAC3F4WLKZBUBUKMZ2OLCBQU3F2WONHA5COA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.259387548 (314h18m17.062852127s) [noise=true , address=145.79.227.17:4972 , piece_id=4PHRQYM6AWFRTGPT5CTTAACFDIXTPZGMNXOQFKSSKTGVBXPDDB7A, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.262359616 (314h18m17.065824194s) [noise=true , address=145.79.227.7:4294 , piece_id=D334YG6DNFM47LGYUEMT3SU3LF5RCCOFG3NEA5LYAZJQRZSW72EQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.264785106 (314h18m17.068249686s) [noise=true , address=145.79.227.7:4295 , piece_id=ISTGXKKTT6DIP3THAGG26O22MWDJY3HFTK5M3B3UTCS3SFND3QEA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.280441321 (314h18m17.083905901s) [noise=true , address=145.79.227.18:4005 , piece_id=57ILRUIJN7GJXVOHFX4UZYWQXLSRSUJUU4OMR4SYAWCL4657MXBQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.280499248 (314h18m17.083963828s) [noise=true , address=145.79.227.3:4151 , piece_id=MBFF7B5GRVYQWKI5H3R3NAZQTSEN3T5BYDKUQGF7PCJZW5HD5PHQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.283118885 (314h18m17.08658347s) [noise=true , address=45.91.116.14:4191 , piece_id=YGUDAIHMX4CVJ3ICZI5VCLAHQWEJHKHYLGZ2APHV3DQ7O4NDVRUA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.284525898 (314h18m17.087990475s) [noise=true , address=77.90.31.15:4699 , piece_id=RRMAEKMQC76UDN57IJPWDJ3EEPGAI3ZV5J5CMEP7ZJVXDTUW6L4Q, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.287866544 (314h18m17.091331136s) [noise=true , address=77.90.31.10:4517 , piece_id=Y56CSTTJSWPMQD5OLVIPPW7FH64RAXX2BK3VLHMEMCLLWPGZ6DZA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.287890841 (314h18m17.091355441s) [seg_pos={0 0}, upload=276569]: Segment reached optimal threshold of 13 pieces.
Oct 6 15:48:29.288021612 (314h18m17.091486198s) [noise=true , address=45.91.116.6:4975 , piece_id=6ZCJH35VKWJGGHD7TGKH6BVNALDXYK373KFPXS7PVNCROT6VJTSA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Oct 6 15:48:29.288034623 (314h18m17.091499215s) [noise=true , address=45.91.116.6:4975 , piece_id=6ZCJH35VKWJGGHD7TGKH6BVNALDXYK373KFPXS7PVNCROT6VJTSA, seg_pos={0 0}, upload=276569]: Long tail cancellation due to optimal threshold
Oct 6 15:48:29.288147194 (314h18m17.091611786s) [noise=true , address=45.91.116.5:4298 , piece_id=B5GWVEHSNBZ3XVZLJAXTLZQCWESLWT6CLG3N7LYNK42FN2DJ6LZA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Oct 6 15:48:29.288156173 (314h18m17.091620769s) [noise=true , address=45.91.116.5:4298 , piece_id=B5GWVEHSNBZ3XVZLJAXTLZQCWESLWT6CLG3N7LYNK42FN2DJ6LZA, seg_pos={0 0}, upload=276569]: Long tail cancellation due to optimal threshold
Oct 6 15:48:29.288225500 (314h18m17.09169009s) [noise=true , address=45.91.116.10:4082 , piece_id=5JKIFAIDG5ZRICLZSJZSBHYTQVS5EI4MBPTLCE5U6DV3QU56OMRQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Oct 6 15:48:29.288234451 (314h18m17.091699042s) [noise=true , address=45.91.116.10:4082 , piece_id=5JKIFAIDG5ZRICLZSJZSBHYTQVS5EI4MBPTLCE5U6DV3QU56OMRQ, seg_pos={0 0}, upload=276569]: Long tail cancellation due to optimal threshold
Oct 6 15:48:29.288261295 (314h18m17.091725984s) [seg_pos={0 0}, upload=276569]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 6 15:48:29.288342320 (314h18m17.091806917s) [upload=276569]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 6 15:48:29.288349544 (314h18m17.091814144s) [upload=276569]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 6 15:49:14.636526649 (314h19m2.439991241s) [upload=276569]: Done uploading segments...
Oct 6 15:49:14.636563271 (314h19m2.440027867s) [upload=276569]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.449192636s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.098781525s
FAIL (2025-10-06 16:32:16 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 2.098811796s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.457605421s
FAIL (2025-10-06 16:31:56 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 6 15:48:28.323181802 (314h18m16.126646393s) [upload=276569]: Starting upload
Oct 6 15:48:28.323273509 (314h18m16.126738087s) [upload=276569]: Done starting upload
Oct 6 15:48:28.323405962 (314h18m16.12687054s) [upload=276569]: Uploading segments...
Oct 6 15:48:28.324175266 (314h18m16.127639865s) [upload=276569]: Got next segment. Inline: false
Oct 6 15:48:28.324234736 (314h18m16.127699327s) [upload=276569]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 6 15:48:28.324241207 (314h18m16.127705799s) [upload=276569]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 6 15:48:28.448109636 (314h18m16.251574228s) [seg_pos={0 0}, upload=276569]: Begin upload segment...
Oct 6 15:48:28.448178380 (314h18m16.25164297s) [seg_pos={0 0}, upload=276569]: Done begin upload segment.
Oct 6 15:48:28.448207497 (314h18m16.251672094s) [noise=true , address=45.91.116.10:4082 , piece_id=5JKIFAIDG5ZRICLZSJZSBHYTQVS5EI4MBPTLCE5U6DV3QU56OMRQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.449447618 (314h18m16.252912218s) [noise=true , address=145.79.227.19:4079 , piece_id=AZYCXUE5VDSQ7I2GMXAZMNDC5AQKPZSQWL6A6HXR5ASX3P3DKTGQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.450272425 (314h18m16.253737017s) [noise=true , address=145.79.227.16:4910 , piece_id=O7N234LDGO4MSYC4RAC3F4WLKZBUBUKMZ2OLCBQU3F2WONHA5COA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.450628085 (314h18m16.254092685s) [noise=true , address=145.79.227.7:4295 , piece_id=ISTGXKKTT6DIP3THAGG26O22MWDJY3HFTK5M3B3UTCS3SFND3QEA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.451240193 (314h18m16.254704783s) [noise=true , address=145.79.227.7:4294 , piece_id=D334YG6DNFM47LGYUEMT3SU3LF5RCCOFG3NEA5LYAZJQRZSW72EQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.451713584 (314h18m16.255178192s) [noise=true , address=45.91.116.5:4298 , piece_id=B5GWVEHSNBZ3XVZLJAXTLZQCWESLWT6CLG3N7LYNK42FN2DJ6LZA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.452167920 (314h18m16.255632514s) [noise=true , address=77.90.31.15:4699 , piece_id=RRMAEKMQC76UDN57IJPWDJ3EEPGAI3ZV5J5CMEP7ZJVXDTUW6L4Q, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.452525996 (314h18m16.255990589s) [noise=true , address=145.79.227.13:4804 , piece_id=675BJQLFIPFRRMXBCXUWHMBXATHGCJA5J4DSIDPZDVCPO2ZXJJFQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.452921615 (314h18m16.256386209s) [noise=true , address=145.79.227.17:4972 , piece_id=4PHRQYM6AWFRTGPT5CTTAACFDIXTPZGMNXOQFKSSKTGVBXPDDB7A, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.453338920 (314h18m16.256803514s) [noise=true , address=77.90.31.10:4517 , piece_id=Y56CSTTJSWPMQD5OLVIPPW7FH64RAXX2BK3VLHMEMCLLWPGZ6DZA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.453701634 (314h18m16.257166228s) [noise=true , address=45.91.116.13:4153 , piece_id=6JH44B3EJNZM2CXWAFUTURG5CEO2OY2JJF2R7DRVUOUPB42PCCJA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.454306789 (314h18m16.257771383s) [noise=true , address=145.79.227.3:4151 , piece_id=MBFF7B5GRVYQWKI5H3R3NAZQTSEN3T5BYDKUQGF7PCJZW5HD5PHQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.454638758 (314h18m16.25810335s) [noise=true , address=45.91.116.6:4975 , piece_id=6ZCJH35VKWJGGHD7TGKH6BVNALDXYK373KFPXS7PVNCROT6VJTSA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.454930199 (314h18m16.258394793s) [noise=true , address=145.79.227.18:4005 , piece_id=57ILRUIJN7GJXVOHFX4UZYWQXLSRSUJUU4OMR4SYAWCL4657MXBQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.455218559 (314h18m16.258683153s) [noise=true , address=45.91.116.4:4938 , piece_id=FIBMEUI7YFRHS64EKIFDJV3UWOZXOXHSU73R3DPFXN4NMHNPGLHA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.455494726 (314h18m16.258959319s) [noise=true , address=45.91.116.14:4191 , piece_id=YGUDAIHMX4CVJ3ICZI5VCLAHQWEJHKHYLGZ2APHV3DQ7O4NDVRUA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:29.063359790 (314h18m16.866824384s) [upload=276569]: Next returned nil segment
Oct 6 15:48:29.063385773 (314h18m16.866850366s) [upload=276569]: Waiting for error group managing segments...
Oct 6 15:48:29.207573603 (314h18m17.011038185s) [noise=true , address=45.91.116.4:4938 , piece_id=FIBMEUI7YFRHS64EKIFDJV3UWOZXOXHSU73R3DPFXN4NMHNPGLHA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.210676593 (314h18m17.01414117s) [noise=true , address=45.91.116.13:4153 , piece_id=6JH44B3EJNZM2CXWAFUTURG5CEO2OY2JJF2R7DRVUOUPB42PCCJA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.251463356 (314h18m17.054927939s) [noise=true , address=145.79.227.13:4804 , piece_id=675BJQLFIPFRRMXBCXUWHMBXATHGCJA5J4DSIDPZDVCPO2ZXJJFQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.257610190 (314h18m17.061074773s) [noise=true , address=145.79.227.19:4079 , piece_id=AZYCXUE5VDSQ7I2GMXAZMNDC5AQKPZSQWL6A6HXR5ASX3P3DKTGQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.258398549 (314h18m17.061863126s) [noise=true , address=145.79.227.16:4910 , piece_id=O7N234LDGO4MSYC4RAC3F4WLKZBUBUKMZ2OLCBQU3F2WONHA5COA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.259387548 (314h18m17.062852127s) [noise=true , address=145.79.227.17:4972 , piece_id=4PHRQYM6AWFRTGPT5CTTAACFDIXTPZGMNXOQFKSSKTGVBXPDDB7A, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.262359616 (314h18m17.065824194s) [noise=true , address=145.79.227.7:4294 , piece_id=D334YG6DNFM47LGYUEMT3SU3LF5RCCOFG3NEA5LYAZJQRZSW72EQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.264785106 (314h18m17.068249686s) [noise=true , address=145.79.227.7:4295 , piece_id=ISTGXKKTT6DIP3THAGG26O22MWDJY3HFTK5M3B3UTCS3SFND3QEA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.280441321 (314h18m17.083905901s) [noise=true , address=145.79.227.18:4005 , piece_id=57ILRUIJN7GJXVOHFX4UZYWQXLSRSUJUU4OMR4SYAWCL4657MXBQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.280499248 (314h18m17.083963828s) [noise=true , address=145.79.227.3:4151 , piece_id=MBFF7B5GRVYQWKI5H3R3NAZQTSEN3T5BYDKUQGF7PCJZW5HD5PHQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.283118885 (314h18m17.08658347s) [noise=true , address=45.91.116.14:4191 , piece_id=YGUDAIHMX4CVJ3ICZI5VCLAHQWEJHKHYLGZ2APHV3DQ7O4NDVRUA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.284525898 (314h18m17.087990475s) [noise=true , address=77.90.31.15:4699 , piece_id=RRMAEKMQC76UDN57IJPWDJ3EEPGAI3ZV5J5CMEP7ZJVXDTUW6L4Q, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.287866544 (314h18m17.091331136s) [noise=true , address=77.90.31.10:4517 , piece_id=Y56CSTTJSWPMQD5OLVIPPW7FH64RAXX2BK3VLHMEMCLLWPGZ6DZA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.287890841 (314h18m17.091355441s) [seg_pos={0 0}, upload=276569]: Segment reached optimal threshold of 13 pieces.
Oct 6 15:48:29.288021612 (314h18m17.091486198s) [noise=true , address=45.91.116.6:4975 , piece_id=6ZCJH35VKWJGGHD7TGKH6BVNALDXYK373KFPXS7PVNCROT6VJTSA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Oct 6 15:48:29.288034623 (314h18m17.091499215s) [noise=true , address=45.91.116.6:4975 , piece_id=6ZCJH35VKWJGGHD7TGKH6BVNALDXYK373KFPXS7PVNCROT6VJTSA, seg_pos={0 0}, upload=276569]: Long tail cancellation due to optimal threshold
Oct 6 15:48:29.288147194 (314h18m17.091611786s) [noise=true , address=45.91.116.5:4298 , piece_id=B5GWVEHSNBZ3XVZLJAXTLZQCWESLWT6CLG3N7LYNK42FN2DJ6LZA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Oct 6 15:48:29.288156173 (314h18m17.091620769s) [noise=true , address=45.91.116.5:4298 , piece_id=B5GWVEHSNBZ3XVZLJAXTLZQCWESLWT6CLG3N7LYNK42FN2DJ6LZA, seg_pos={0 0}, upload=276569]: Long tail cancellation due to optimal threshold
Oct 6 15:48:29.288225500 (314h18m17.09169009s) [noise=true , address=45.91.116.10:4082 , piece_id=5JKIFAIDG5ZRICLZSJZSBHYTQVS5EI4MBPTLCE5U6DV3QU56OMRQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Oct 6 15:48:29.288234451 (314h18m17.091699042s) [noise=true , address=45.91.116.10:4082 , piece_id=5JKIFAIDG5ZRICLZSJZSBHYTQVS5EI4MBPTLCE5U6DV3QU56OMRQ, seg_pos={0 0}, upload=276569]: Long tail cancellation due to optimal threshold
Oct 6 15:48:29.288261295 (314h18m17.091725984s) [seg_pos={0 0}, upload=276569]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 6 15:48:29.288342320 (314h18m17.091806917s) [upload=276569]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 6 15:48:29.288349544 (314h18m17.091814144s) [upload=276569]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 6 15:49:14.636526649 (314h19m2.439991241s) [upload=276569]: Done uploading segments...
Oct 6 15:49:14.636563271 (314h19m2.440027867s) [upload=276569]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.457645785s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.235800645s
FAIL (2025-10-06 16:31:47 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 2.235827849s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.611606118s
FAIL (2025-10-06 16:31:38 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 6 15:48:28.323181802 (314h18m16.126646393s) [upload=276569]: Starting upload
Oct 6 15:48:28.323273509 (314h18m16.126738087s) [upload=276569]: Done starting upload
Oct 6 15:48:28.323405962 (314h18m16.12687054s) [upload=276569]: Uploading segments...
Oct 6 15:48:28.324175266 (314h18m16.127639865s) [upload=276569]: Got next segment. Inline: false
Oct 6 15:48:28.324234736 (314h18m16.127699327s) [upload=276569]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 6 15:48:28.324241207 (314h18m16.127705799s) [upload=276569]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 6 15:48:28.448109636 (314h18m16.251574228s) [seg_pos={0 0}, upload=276569]: Begin upload segment...
Oct 6 15:48:28.448178380 (314h18m16.25164297s) [seg_pos={0 0}, upload=276569]: Done begin upload segment.
Oct 6 15:48:28.448207497 (314h18m16.251672094s) [noise=true , address=45.91.116.10:4082 , piece_id=5JKIFAIDG5ZRICLZSJZSBHYTQVS5EI4MBPTLCE5U6DV3QU56OMRQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.449447618 (314h18m16.252912218s) [noise=true , address=145.79.227.19:4079 , piece_id=AZYCXUE5VDSQ7I2GMXAZMNDC5AQKPZSQWL6A6HXR5ASX3P3DKTGQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.450272425 (314h18m16.253737017s) [noise=true , address=145.79.227.16:4910 , piece_id=O7N234LDGO4MSYC4RAC3F4WLKZBUBUKMZ2OLCBQU3F2WONHA5COA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.450628085 (314h18m16.254092685s) [noise=true , address=145.79.227.7:4295 , piece_id=ISTGXKKTT6DIP3THAGG26O22MWDJY3HFTK5M3B3UTCS3SFND3QEA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.451240193 (314h18m16.254704783s) [noise=true , address=145.79.227.7:4294 , piece_id=D334YG6DNFM47LGYUEMT3SU3LF5RCCOFG3NEA5LYAZJQRZSW72EQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.451713584 (314h18m16.255178192s) [noise=true , address=45.91.116.5:4298 , piece_id=B5GWVEHSNBZ3XVZLJAXTLZQCWESLWT6CLG3N7LYNK42FN2DJ6LZA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.452167920 (314h18m16.255632514s) [noise=true , address=77.90.31.15:4699 , piece_id=RRMAEKMQC76UDN57IJPWDJ3EEPGAI3ZV5J5CMEP7ZJVXDTUW6L4Q, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.452525996 (314h18m16.255990589s) [noise=true , address=145.79.227.13:4804 , piece_id=675BJQLFIPFRRMXBCXUWHMBXATHGCJA5J4DSIDPZDVCPO2ZXJJFQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.452921615 (314h18m16.256386209s) [noise=true , address=145.79.227.17:4972 , piece_id=4PHRQYM6AWFRTGPT5CTTAACFDIXTPZGMNXOQFKSSKTGVBXPDDB7A, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.453338920 (314h18m16.256803514s) [noise=true , address=77.90.31.10:4517 , piece_id=Y56CSTTJSWPMQD5OLVIPPW7FH64RAXX2BK3VLHMEMCLLWPGZ6DZA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.453701634 (314h18m16.257166228s) [noise=true , address=45.91.116.13:4153 , piece_id=6JH44B3EJNZM2CXWAFUTURG5CEO2OY2JJF2R7DRVUOUPB42PCCJA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.454306789 (314h18m16.257771383s) [noise=true , address=145.79.227.3:4151 , piece_id=MBFF7B5GRVYQWKI5H3R3NAZQTSEN3T5BYDKUQGF7PCJZW5HD5PHQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.454638758 (314h18m16.25810335s) [noise=true , address=45.91.116.6:4975 , piece_id=6ZCJH35VKWJGGHD7TGKH6BVNALDXYK373KFPXS7PVNCROT6VJTSA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.454930199 (314h18m16.258394793s) [noise=true , address=145.79.227.18:4005 , piece_id=57ILRUIJN7GJXVOHFX4UZYWQXLSRSUJUU4OMR4SYAWCL4657MXBQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.455218559 (314h18m16.258683153s) [noise=true , address=45.91.116.4:4938 , piece_id=FIBMEUI7YFRHS64EKIFDJV3UWOZXOXHSU73R3DPFXN4NMHNPGLHA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.455494726 (314h18m16.258959319s) [noise=true , address=45.91.116.14:4191 , piece_id=YGUDAIHMX4CVJ3ICZI5VCLAHQWEJHKHYLGZ2APHV3DQ7O4NDVRUA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:29.063359790 (314h18m16.866824384s) [upload=276569]: Next returned nil segment
Oct 6 15:48:29.063385773 (314h18m16.866850366s) [upload=276569]: Waiting for error group managing segments...
Oct 6 15:48:29.207573603 (314h18m17.011038185s) [noise=true , address=45.91.116.4:4938 , piece_id=FIBMEUI7YFRHS64EKIFDJV3UWOZXOXHSU73R3DPFXN4NMHNPGLHA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.210676593 (314h18m17.01414117s) [noise=true , address=45.91.116.13:4153 , piece_id=6JH44B3EJNZM2CXWAFUTURG5CEO2OY2JJF2R7DRVUOUPB42PCCJA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.251463356 (314h18m17.054927939s) [noise=true , address=145.79.227.13:4804 , piece_id=675BJQLFIPFRRMXBCXUWHMBXATHGCJA5J4DSIDPZDVCPO2ZXJJFQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.257610190 (314h18m17.061074773s) [noise=true , address=145.79.227.19:4079 , piece_id=AZYCXUE5VDSQ7I2GMXAZMNDC5AQKPZSQWL6A6HXR5ASX3P3DKTGQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.258398549 (314h18m17.061863126s) [noise=true , address=145.79.227.16:4910 , piece_id=O7N234LDGO4MSYC4RAC3F4WLKZBUBUKMZ2OLCBQU3F2WONHA5COA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.259387548 (314h18m17.062852127s) [noise=true , address=145.79.227.17:4972 , piece_id=4PHRQYM6AWFRTGPT5CTTAACFDIXTPZGMNXOQFKSSKTGVBXPDDB7A, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.262359616 (314h18m17.065824194s) [noise=true , address=145.79.227.7:4294 , piece_id=D334YG6DNFM47LGYUEMT3SU3LF5RCCOFG3NEA5LYAZJQRZSW72EQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.264785106 (314h18m17.068249686s) [noise=true , address=145.79.227.7:4295 , piece_id=ISTGXKKTT6DIP3THAGG26O22MWDJY3HFTK5M3B3UTCS3SFND3QEA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.280441321 (314h18m17.083905901s) [noise=true , address=145.79.227.18:4005 , piece_id=57ILRUIJN7GJXVOHFX4UZYWQXLSRSUJUU4OMR4SYAWCL4657MXBQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.280499248 (314h18m17.083963828s) [noise=true , address=145.79.227.3:4151 , piece_id=MBFF7B5GRVYQWKI5H3R3NAZQTSEN3T5BYDKUQGF7PCJZW5HD5PHQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.283118885 (314h18m17.08658347s) [noise=true , address=45.91.116.14:4191 , piece_id=YGUDAIHMX4CVJ3ICZI5VCLAHQWEJHKHYLGZ2APHV3DQ7O4NDVRUA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.284525898 (314h18m17.087990475s) [noise=true , address=77.90.31.15:4699 , piece_id=RRMAEKMQC76UDN57IJPWDJ3EEPGAI3ZV5J5CMEP7ZJVXDTUW6L4Q, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.287866544 (314h18m17.091331136s) [noise=true , address=77.90.31.10:4517 , piece_id=Y56CSTTJSWPMQD5OLVIPPW7FH64RAXX2BK3VLHMEMCLLWPGZ6DZA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.287890841 (314h18m17.091355441s) [seg_pos={0 0}, upload=276569]: Segment reached optimal threshold of 13 pieces.
Oct 6 15:48:29.288021612 (314h18m17.091486198s) [noise=true , address=45.91.116.6:4975 , piece_id=6ZCJH35VKWJGGHD7TGKH6BVNALDXYK373KFPXS7PVNCROT6VJTSA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Oct 6 15:48:29.288034623 (314h18m17.091499215s) [noise=true , address=45.91.116.6:4975 , piece_id=6ZCJH35VKWJGGHD7TGKH6BVNALDXYK373KFPXS7PVNCROT6VJTSA, seg_pos={0 0}, upload=276569]: Long tail cancellation due to optimal threshold
Oct 6 15:48:29.288147194 (314h18m17.091611786s) [noise=true , address=45.91.116.5:4298 , piece_id=B5GWVEHSNBZ3XVZLJAXTLZQCWESLWT6CLG3N7LYNK42FN2DJ6LZA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Oct 6 15:48:29.288156173 (314h18m17.091620769s) [noise=true , address=45.91.116.5:4298 , piece_id=B5GWVEHSNBZ3XVZLJAXTLZQCWESLWT6CLG3N7LYNK42FN2DJ6LZA, seg_pos={0 0}, upload=276569]: Long tail cancellation due to optimal threshold
Oct 6 15:48:29.288225500 (314h18m17.09169009s) [noise=true , address=45.91.116.10:4082 , piece_id=5JKIFAIDG5ZRICLZSJZSBHYTQVS5EI4MBPTLCE5U6DV3QU56OMRQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Oct 6 15:48:29.288234451 (314h18m17.091699042s) [noise=true , address=45.91.116.10:4082 , piece_id=5JKIFAIDG5ZRICLZSJZSBHYTQVS5EI4MBPTLCE5U6DV3QU56OMRQ, seg_pos={0 0}, upload=276569]: Long tail cancellation due to optimal threshold
Oct 6 15:48:29.288261295 (314h18m17.091725984s) [seg_pos={0 0}, upload=276569]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 6 15:48:29.288342320 (314h18m17.091806917s) [upload=276569]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 6 15:48:29.288349544 (314h18m17.091814144s) [upload=276569]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 6 15:49:14.636526649 (314h19m2.439991241s) [upload=276569]: Done uploading segments...
Oct 6 15:49:14.636563271 (314h19m2.440027867s) [upload=276569]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.6116449s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.582398371s
FAIL (2025-10-06 16:31:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 6 15:48:28.323181802 (314h18m16.126646393s) [upload=276569]: Starting upload
Oct 6 15:48:28.323273509 (314h18m16.126738087s) [upload=276569]: Done starting upload
Oct 6 15:48:28.323405962 (314h18m16.12687054s) [upload=276569]: Uploading segments...
Oct 6 15:48:28.324175266 (314h18m16.127639865s) [upload=276569]: Got next segment. Inline: false
Oct 6 15:48:28.324234736 (314h18m16.127699327s) [upload=276569]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 6 15:48:28.324241207 (314h18m16.127705799s) [upload=276569]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 6 15:48:28.448109636 (314h18m16.251574228s) [seg_pos={0 0}, upload=276569]: Begin upload segment...
Oct 6 15:48:28.448178380 (314h18m16.25164297s) [seg_pos={0 0}, upload=276569]: Done begin upload segment.
Oct 6 15:48:28.448207497 (314h18m16.251672094s) [noise=true , address=45.91.116.10:4082 , piece_id=5JKIFAIDG5ZRICLZSJZSBHYTQVS5EI4MBPTLCE5U6DV3QU56OMRQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.449447618 (314h18m16.252912218s) [noise=true , address=145.79.227.19:4079 , piece_id=AZYCXUE5VDSQ7I2GMXAZMNDC5AQKPZSQWL6A6HXR5ASX3P3DKTGQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.450272425 (314h18m16.253737017s) [noise=true , address=145.79.227.16:4910 , piece_id=O7N234LDGO4MSYC4RAC3F4WLKZBUBUKMZ2OLCBQU3F2WONHA5COA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.450628085 (314h18m16.254092685s) [noise=true , address=145.79.227.7:4295 , piece_id=ISTGXKKTT6DIP3THAGG26O22MWDJY3HFTK5M3B3UTCS3SFND3QEA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.451240193 (314h18m16.254704783s) [noise=true , address=145.79.227.7:4294 , piece_id=D334YG6DNFM47LGYUEMT3SU3LF5RCCOFG3NEA5LYAZJQRZSW72EQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.451713584 (314h18m16.255178192s) [noise=true , address=45.91.116.5:4298 , piece_id=B5GWVEHSNBZ3XVZLJAXTLZQCWESLWT6CLG3N7LYNK42FN2DJ6LZA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.452167920 (314h18m16.255632514s) [noise=true , address=77.90.31.15:4699 , piece_id=RRMAEKMQC76UDN57IJPWDJ3EEPGAI3ZV5J5CMEP7ZJVXDTUW6L4Q, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.452525996 (314h18m16.255990589s) [noise=true , address=145.79.227.13:4804 , piece_id=675BJQLFIPFRRMXBCXUWHMBXATHGCJA5J4DSIDPZDVCPO2ZXJJFQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.452921615 (314h18m16.256386209s) [noise=true , address=145.79.227.17:4972 , piece_id=4PHRQYM6AWFRTGPT5CTTAACFDIXTPZGMNXOQFKSSKTGVBXPDDB7A, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.453338920 (314h18m16.256803514s) [noise=true , address=77.90.31.10:4517 , piece_id=Y56CSTTJSWPMQD5OLVIPPW7FH64RAXX2BK3VLHMEMCLLWPGZ6DZA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.453701634 (314h18m16.257166228s) [noise=true , address=45.91.116.13:4153 , piece_id=6JH44B3EJNZM2CXWAFUTURG5CEO2OY2JJF2R7DRVUOUPB42PCCJA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.454306789 (314h18m16.257771383s) [noise=true , address=145.79.227.3:4151 , piece_id=MBFF7B5GRVYQWKI5H3R3NAZQTSEN3T5BYDKUQGF7PCJZW5HD5PHQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.454638758 (314h18m16.25810335s) [noise=true , address=45.91.116.6:4975 , piece_id=6ZCJH35VKWJGGHD7TGKH6BVNALDXYK373KFPXS7PVNCROT6VJTSA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.454930199 (314h18m16.258394793s) [noise=true , address=145.79.227.18:4005 , piece_id=57ILRUIJN7GJXVOHFX4UZYWQXLSRSUJUU4OMR4SYAWCL4657MXBQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.455218559 (314h18m16.258683153s) [noise=true , address=45.91.116.4:4938 , piece_id=FIBMEUI7YFRHS64EKIFDJV3UWOZXOXHSU73R3DPFXN4NMHNPGLHA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.455494726 (314h18m16.258959319s) [noise=true , address=45.91.116.14:4191 , piece_id=YGUDAIHMX4CVJ3ICZI5VCLAHQWEJHKHYLGZ2APHV3DQ7O4NDVRUA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:29.063359790 (314h18m16.866824384s) [upload=276569]: Next returned nil segment
Oct 6 15:48:29.063385773 (314h18m16.866850366s) [upload=276569]: Waiting for error group managing segments...
Oct 6 15:48:29.207573603 (314h18m17.011038185s) [noise=true , address=45.91.116.4:4938 , piece_id=FIBMEUI7YFRHS64EKIFDJV3UWOZXOXHSU73R3DPFXN4NMHNPGLHA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.210676593 (314h18m17.01414117s) [noise=true , address=45.91.116.13:4153 , piece_id=6JH44B3EJNZM2CXWAFUTURG5CEO2OY2JJF2R7DRVUOUPB42PCCJA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.251463356 (314h18m17.054927939s) [noise=true , address=145.79.227.13:4804 , piece_id=675BJQLFIPFRRMXBCXUWHMBXATHGCJA5J4DSIDPZDVCPO2ZXJJFQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.257610190 (314h18m17.061074773s) [noise=true , address=145.79.227.19:4079 , piece_id=AZYCXUE5VDSQ7I2GMXAZMNDC5AQKPZSQWL6A6HXR5ASX3P3DKTGQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.258398549 (314h18m17.061863126s) [noise=true , address=145.79.227.16:4910 , piece_id=O7N234LDGO4MSYC4RAC3F4WLKZBUBUKMZ2OLCBQU3F2WONHA5COA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.259387548 (314h18m17.062852127s) [noise=true , address=145.79.227.17:4972 , piece_id=4PHRQYM6AWFRTGPT5CTTAACFDIXTPZGMNXOQFKSSKTGVBXPDDB7A, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.262359616 (314h18m17.065824194s) [noise=true , address=145.79.227.7:4294 , piece_id=D334YG6DNFM47LGYUEMT3SU3LF5RCCOFG3NEA5LYAZJQRZSW72EQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.264785106 (314h18m17.068249686s) [noise=true , address=145.79.227.7:4295 , piece_id=ISTGXKKTT6DIP3THAGG26O22MWDJY3HFTK5M3B3UTCS3SFND3QEA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.280441321 (314h18m17.083905901s) [noise=true , address=145.79.227.18:4005 , piece_id=57ILRUIJN7GJXVOHFX4UZYWQXLSRSUJUU4OMR4SYAWCL4657MXBQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.280499248 (314h18m17.083963828s) [noise=true , address=145.79.227.3:4151 , piece_id=MBFF7B5GRVYQWKI5H3R3NAZQTSEN3T5BYDKUQGF7PCJZW5HD5PHQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.283118885 (314h18m17.08658347s) [noise=true , address=45.91.116.14:4191 , piece_id=YGUDAIHMX4CVJ3ICZI5VCLAHQWEJHKHYLGZ2APHV3DQ7O4NDVRUA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.284525898 (314h18m17.087990475s) [noise=true , address=77.90.31.15:4699 , piece_id=RRMAEKMQC76UDN57IJPWDJ3EEPGAI3ZV5J5CMEP7ZJVXDTUW6L4Q, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.287866544 (314h18m17.091331136s) [noise=true , address=77.90.31.10:4517 , piece_id=Y56CSTTJSWPMQD5OLVIPPW7FH64RAXX2BK3VLHMEMCLLWPGZ6DZA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.287890841 (314h18m17.091355441s) [seg_pos={0 0}, upload=276569]: Segment reached optimal threshold of 13 pieces.
Oct 6 15:48:29.288021612 (314h18m17.091486198s) [noise=true , address=45.91.116.6:4975 , piece_id=6ZCJH35VKWJGGHD7TGKH6BVNALDXYK373KFPXS7PVNCROT6VJTSA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Oct 6 15:48:29.288034623 (314h18m17.091499215s) [noise=true , address=45.91.116.6:4975 , piece_id=6ZCJH35VKWJGGHD7TGKH6BVNALDXYK373KFPXS7PVNCROT6VJTSA, seg_pos={0 0}, upload=276569]: Long tail cancellation due to optimal threshold
Oct 6 15:48:29.288147194 (314h18m17.091611786s) [noise=true , address=45.91.116.5:4298 , piece_id=B5GWVEHSNBZ3XVZLJAXTLZQCWESLWT6CLG3N7LYNK42FN2DJ6LZA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Oct 6 15:48:29.288156173 (314h18m17.091620769s) [noise=true , address=45.91.116.5:4298 , piece_id=B5GWVEHSNBZ3XVZLJAXTLZQCWESLWT6CLG3N7LYNK42FN2DJ6LZA, seg_pos={0 0}, upload=276569]: Long tail cancellation due to optimal threshold
Oct 6 15:48:29.288225500 (314h18m17.09169009s) [noise=true , address=45.91.116.10:4082 , piece_id=5JKIFAIDG5ZRICLZSJZSBHYTQVS5EI4MBPTLCE5U6DV3QU56OMRQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Oct 6 15:48:29.288234451 (314h18m17.091699042s) [noise=true , address=45.91.116.10:4082 , piece_id=5JKIFAIDG5ZRICLZSJZSBHYTQVS5EI4MBPTLCE5U6DV3QU56OMRQ, seg_pos={0 0}, upload=276569]: Long tail cancellation due to optimal threshold
Oct 6 15:48:29.288261295 (314h18m17.091725984s) [seg_pos={0 0}, upload=276569]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 6 15:48:29.288342320 (314h18m17.091806917s) [upload=276569]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 6 15:48:29.288349544 (314h18m17.091814144s) [upload=276569]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 6 15:49:14.636526649 (314h19m2.439991241s) [upload=276569]: Done uploading segments...
Oct 6 15:49:14.636563271 (314h19m2.440027867s) [upload=276569]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.582456254s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.011887673s
FAIL (2025-10-06 16:30:49 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 2.011917808s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.180898588s
FAIL (2025-10-06 16:30:11 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 2.180990062s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.764960277s
FAIL (2025-10-06 16:30:09 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 6 15:48:28.323181802 (314h18m16.126646393s) [upload=276569]: Starting upload
Oct 6 15:48:28.323273509 (314h18m16.126738087s) [upload=276569]: Done starting upload
Oct 6 15:48:28.323405962 (314h18m16.12687054s) [upload=276569]: Uploading segments...
Oct 6 15:48:28.324175266 (314h18m16.127639865s) [upload=276569]: Got next segment. Inline: false
Oct 6 15:48:28.324234736 (314h18m16.127699327s) [upload=276569]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 6 15:48:28.324241207 (314h18m16.127705799s) [upload=276569]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 6 15:48:28.448109636 (314h18m16.251574228s) [seg_pos={0 0}, upload=276569]: Begin upload segment...
Oct 6 15:48:28.448178380 (314h18m16.25164297s) [seg_pos={0 0}, upload=276569]: Done begin upload segment.
Oct 6 15:48:28.448207497 (314h18m16.251672094s) [noise=true , address=45.91.116.10:4082 , piece_id=5JKIFAIDG5ZRICLZSJZSBHYTQVS5EI4MBPTLCE5U6DV3QU56OMRQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.449447618 (314h18m16.252912218s) [noise=true , address=145.79.227.19:4079 , piece_id=AZYCXUE5VDSQ7I2GMXAZMNDC5AQKPZSQWL6A6HXR5ASX3P3DKTGQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.450272425 (314h18m16.253737017s) [noise=true , address=145.79.227.16:4910 , piece_id=O7N234LDGO4MSYC4RAC3F4WLKZBUBUKMZ2OLCBQU3F2WONHA5COA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.450628085 (314h18m16.254092685s) [noise=true , address=145.79.227.7:4295 , piece_id=ISTGXKKTT6DIP3THAGG26O22MWDJY3HFTK5M3B3UTCS3SFND3QEA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.451240193 (314h18m16.254704783s) [noise=true , address=145.79.227.7:4294 , piece_id=D334YG6DNFM47LGYUEMT3SU3LF5RCCOFG3NEA5LYAZJQRZSW72EQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.451713584 (314h18m16.255178192s) [noise=true , address=45.91.116.5:4298 , piece_id=B5GWVEHSNBZ3XVZLJAXTLZQCWESLWT6CLG3N7LYNK42FN2DJ6LZA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.452167920 (314h18m16.255632514s) [noise=true , address=77.90.31.15:4699 , piece_id=RRMAEKMQC76UDN57IJPWDJ3EEPGAI3ZV5J5CMEP7ZJVXDTUW6L4Q, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.452525996 (314h18m16.255990589s) [noise=true , address=145.79.227.13:4804 , piece_id=675BJQLFIPFRRMXBCXUWHMBXATHGCJA5J4DSIDPZDVCPO2ZXJJFQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.452921615 (314h18m16.256386209s) [noise=true , address=145.79.227.17:4972 , piece_id=4PHRQYM6AWFRTGPT5CTTAACFDIXTPZGMNXOQFKSSKTGVBXPDDB7A, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.453338920 (314h18m16.256803514s) [noise=true , address=77.90.31.10:4517 , piece_id=Y56CSTTJSWPMQD5OLVIPPW7FH64RAXX2BK3VLHMEMCLLWPGZ6DZA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.453701634 (314h18m16.257166228s) [noise=true , address=45.91.116.13:4153 , piece_id=6JH44B3EJNZM2CXWAFUTURG5CEO2OY2JJF2R7DRVUOUPB42PCCJA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.454306789 (314h18m16.257771383s) [noise=true , address=145.79.227.3:4151 , piece_id=MBFF7B5GRVYQWKI5H3R3NAZQTSEN3T5BYDKUQGF7PCJZW5HD5PHQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.454638758 (314h18m16.25810335s) [noise=true , address=45.91.116.6:4975 , piece_id=6ZCJH35VKWJGGHD7TGKH6BVNALDXYK373KFPXS7PVNCROT6VJTSA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.454930199 (314h18m16.258394793s) [noise=true , address=145.79.227.18:4005 , piece_id=57ILRUIJN7GJXVOHFX4UZYWQXLSRSUJUU4OMR4SYAWCL4657MXBQ, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.455218559 (314h18m16.258683153s) [noise=true , address=45.91.116.4:4938 , piece_id=FIBMEUI7YFRHS64EKIFDJV3UWOZXOXHSU73R3DPFXN4NMHNPGLHA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:28.455494726 (314h18m16.258959319s) [noise=true , address=45.91.116.14:4191 , piece_id=YGUDAIHMX4CVJ3ICZI5VCLAHQWEJHKHYLGZ2APHV3DQ7O4NDVRUA, seg_pos={0 0}, upload=276569]: Uploading piece...
Oct 6 15:48:29.063359790 (314h18m16.866824384s) [upload=276569]: Next returned nil segment
Oct 6 15:48:29.063385773 (314h18m16.866850366s) [upload=276569]: Waiting for error group managing segments...
Oct 6 15:48:29.207573603 (314h18m17.011038185s) [noise=true , address=45.91.116.4:4938 , piece_id=FIBMEUI7YFRHS64EKIFDJV3UWOZXOXHSU73R3DPFXN4NMHNPGLHA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.210676593 (314h18m17.01414117s) [noise=true , address=45.91.116.13:4153 , piece_id=6JH44B3EJNZM2CXWAFUTURG5CEO2OY2JJF2R7DRVUOUPB42PCCJA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.251463356 (314h18m17.054927939s) [noise=true , address=145.79.227.13:4804 , piece_id=675BJQLFIPFRRMXBCXUWHMBXATHGCJA5J4DSIDPZDVCPO2ZXJJFQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.257610190 (314h18m17.061074773s) [noise=true , address=145.79.227.19:4079 , piece_id=AZYCXUE5VDSQ7I2GMXAZMNDC5AQKPZSQWL6A6HXR5ASX3P3DKTGQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.258398549 (314h18m17.061863126s) [noise=true , address=145.79.227.16:4910 , piece_id=O7N234LDGO4MSYC4RAC3F4WLKZBUBUKMZ2OLCBQU3F2WONHA5COA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.259387548 (314h18m17.062852127s) [noise=true , address=145.79.227.17:4972 , piece_id=4PHRQYM6AWFRTGPT5CTTAACFDIXTPZGMNXOQFKSSKTGVBXPDDB7A, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.262359616 (314h18m17.065824194s) [noise=true , address=145.79.227.7:4294 , piece_id=D334YG6DNFM47LGYUEMT3SU3LF5RCCOFG3NEA5LYAZJQRZSW72EQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.264785106 (314h18m17.068249686s) [noise=true , address=145.79.227.7:4295 , piece_id=ISTGXKKTT6DIP3THAGG26O22MWDJY3HFTK5M3B3UTCS3SFND3QEA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.280441321 (314h18m17.083905901s) [noise=true , address=145.79.227.18:4005 , piece_id=57ILRUIJN7GJXVOHFX4UZYWQXLSRSUJUU4OMR4SYAWCL4657MXBQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.280499248 (314h18m17.083963828s) [noise=true , address=145.79.227.3:4151 , piece_id=MBFF7B5GRVYQWKI5H3R3NAZQTSEN3T5BYDKUQGF7PCJZW5HD5PHQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.283118885 (314h18m17.08658347s) [noise=true , address=45.91.116.14:4191 , piece_id=YGUDAIHMX4CVJ3ICZI5VCLAHQWEJHKHYLGZ2APHV3DQ7O4NDVRUA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.284525898 (314h18m17.087990475s) [noise=true , address=77.90.31.15:4699 , piece_id=RRMAEKMQC76UDN57IJPWDJ3EEPGAI3ZV5J5CMEP7ZJVXDTUW6L4Q, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.287866544 (314h18m17.091331136s) [noise=true , address=77.90.31.10:4517 , piece_id=Y56CSTTJSWPMQD5OLVIPPW7FH64RAXX2BK3VLHMEMCLLWPGZ6DZA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: <nil>
Oct 6 15:48:29.287890841 (314h18m17.091355441s) [seg_pos={0 0}, upload=276569]: Segment reached optimal threshold of 13 pieces.
Oct 6 15:48:29.288021612 (314h18m17.091486198s) [noise=true , address=45.91.116.6:4975 , piece_id=6ZCJH35VKWJGGHD7TGKH6BVNALDXYK373KFPXS7PVNCROT6VJTSA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Oct 6 15:48:29.288034623 (314h18m17.091499215s) [noise=true , address=45.91.116.6:4975 , piece_id=6ZCJH35VKWJGGHD7TGKH6BVNALDXYK373KFPXS7PVNCROT6VJTSA, seg_pos={0 0}, upload=276569]: Long tail cancellation due to optimal threshold
Oct 6 15:48:29.288147194 (314h18m17.091611786s) [noise=true , address=45.91.116.5:4298 , piece_id=B5GWVEHSNBZ3XVZLJAXTLZQCWESLWT6CLG3N7LYNK42FN2DJ6LZA, seg_pos={0 0}, upload=276569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Oct 6 15:48:29.288156173 (314h18m17.091620769s) [noise=true , address=45.91.116.5:4298 , piece_id=B5GWVEHSNBZ3XVZLJAXTLZQCWESLWT6CLG3N7LYNK42FN2DJ6LZA, seg_pos={0 0}, upload=276569]: Long tail cancellation due to optimal threshold
Oct 6 15:48:29.288225500 (314h18m17.09169009s) [noise=true , address=45.91.116.10:4082 , piece_id=5JKIFAIDG5ZRICLZSJZSBHYTQVS5EI4MBPTLCE5U6DV3QU56OMRQ, seg_pos={0 0}, upload=276569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Oct 6 15:48:29.288234451 (314h18m17.091699042s) [noise=true , address=45.91.116.10:4082 , piece_id=5JKIFAIDG5ZRICLZSJZSBHYTQVS5EI4MBPTLCE5U6DV3QU56OMRQ, seg_pos={0 0}, upload=276569]: Long tail cancellation due to optimal threshold
Oct 6 15:48:29.288261295 (314h18m17.091725984s) [seg_pos={0 0}, upload=276569]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 6 15:48:29.288342320 (314h18m17.091806917s) [upload=276569]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 6 15:48:29.288349544 (314h18m17.091814144s) [upload=276569]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 6 15:49:14.636526649 (314h19m2.439991241s) [upload=276569]: Done uploading segments...
Oct 6 15:49:14.636563271 (314h19m2.440027867s) [upload=276569]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.764984695s
core
uplink
us-select-1
|