Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
1.083890048s
FAIL (2025-06-28 22:45:29 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.083919252s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
3.053928425s
FAIL (2025-06-28 22:45:00 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.053953048s
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
322.155863ms
FAIL (2025-06-28 22:44:54 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error
Duration: 322.219606ms
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.775557533s
FAIL (2025-06-28 22:44:38 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.775599003s
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
331.758374ms
FAIL (2025-06-28 22:44:36 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error
Duration: 331.788723ms
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
1.057174321s
FAIL (2025-06-28 22:44:24 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.057210865s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
1.056415551s
FAIL (2025-06-28 22:44:01 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.056440133s
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
303.880262ms
FAIL (2025-06-28 22:43:59 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error
Duration: 303.939096ms
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.64475391s
FAIL (2025-06-28 22:43:44 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.64478577s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
1.012853237s
FAIL (2025-06-28 22:43:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.012881795s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.584632133s
FAIL (2025-06-28 22:43:16 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.584716829s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
1.136840934s
FAIL (2025-06-28 22:43:04 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.136873086s
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
340.274611ms
FAIL (2025-06-28 22:43:04 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error
Duration: 340.309258ms
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.77838392s
FAIL (2025-06-28 22:42:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.77840421s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
1.260798365s
FAIL (2025-06-28 22:41:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.260813077s
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
306.999855ms
FAIL (2025-06-28 22:41:56 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error
Duration: 307.033245ms
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
1.036224184s
FAIL (2025-06-28 22:41:44 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.036247224s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.706100684s
FAIL (2025-06-28 22:41:38 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.706158596s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
1.072559935s
FAIL (2025-06-28 22:41:14 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.072590091s
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
312.588347ms
FAIL (2025-06-28 22:40:50 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error
Duration: 312.62898ms
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.507816186s
FAIL (2025-06-28 22:40:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.507850478s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
1.110470051s
FAIL (2025-06-28 22:40:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.110498494s
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
330.81693ms
FAIL (2025-06-28 22:40:05 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error
Duration: 331.016751ms
edge
authservice
http
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m12.123017099s
FAIL (2025-06-28 22:40:04 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error
Duration: 1m12.123071894s
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
30.001655575s
FAIL (2025-06-28 22:39:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001683034s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
1.202981595s
FAIL (2025-06-28 22:39:56 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.203402614s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001285567s
FAIL (2025-06-28 22:39:55 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001306189s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001525442s
FAIL (2025-06-28 22:39:25 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001550609s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
268.533111ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:48:24 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 268.556995ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
274.38323ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:47:13 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 274.413957ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.140392506s target:
https://us1.storj.io/login
FAIL (2025-06-28 10:46:18 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 2.140419618s
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
271.527568ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:45:29 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 271.552832ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
938.709114ms
FAIL (2025-06-28 10:45:13 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 938.814497ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
845.585932ms
FAIL (2025-06-28 10:44:28 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 845.620234ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
692.595401ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:44:22 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 692.622846ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
268.77819ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:43:47 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 268.807285ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
912.445202ms
FAIL (2025-06-28 10:43:36 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 912.469029ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
369.410682ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:43:07 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 369.4409ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
883.076558ms
FAIL (2025-06-28 10:43:05 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 883.10646ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
273.017565ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:42:28 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 273.071646ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
887.976941ms
FAIL (2025-06-28 10:42:10 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 888.026714ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
425.966576ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:41:32 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 425.996066ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
847.99584ms
FAIL (2025-06-28 10:41:26 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 848.027074ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
885.774302ms
FAIL (2025-06-28 10:41:01 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 885.809523ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
288.025849ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:40:23 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 288.054815ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
888.518886ms
FAIL (2025-06-28 10:39:58 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 888.56176ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
601.010452ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:39:50 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 601.041502ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
308.781334ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:39:16 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 308.824509ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
836.55713ms
FAIL (2025-06-28 10:39:03 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 380]: Upload finished. err: <nil> Jun 28 09:53:55.662078555 (120h42m55.54549217s) [upload=96394]: Starting upload Jun 28 09:53:55.662225645 (120h42m55.545639277s) [upload=96394]: Done starting upload Jun 28 09:53:55.662328429 (120h42m55.545742049s) [upload=96394]: Uploading segments... Jun 28 09:53:55.662428996 (120h42m55.545842624s) [upload=96394]: Got next segment. Inline: true Jun 28 09:53:55.662435365 (120h42m55.545848983s) [upload=96394]: Waiting for error group managing segments... Jun 28 09:53:55.662500955 (120h42m55.545914584s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:53:55.662507603 (120h42m55.54592123s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:53:55.662511185 (120h42m55.545924796s) [upload=96394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:53:55.809411184 (120h42m55.692824812s) [upload=96394]: Done uploading segments... Jun 28 09:53:55.809436124 (120h42m55.692849754s) [upload=96394]: Upload finished. err: <nil> Jun 28 09:54:44.099727656 (120h43m43.983141294s) [upload=96404]: Starting upload Jun 28 09:54:44.099828436 (120h43m43.983242073s) [upload=96404]: Done starting upload Jun 28 09:54:44.099948980 (120h43m43.98336261s) [upload=96404]: Uploading segments... Jun 28 09:54:44.100084042 (120h43m43.983497677s) [upload=96404]: Got next segment. Inline: true Jun 28 09:54:44.100092927 (120h43m43.983506561s) [upload=96404]: Waiting for error group managing segments... Jun 28 09:54:44.100164415 (120h43m43.983578048s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:54:44.100171719 (120h43m43.983585354s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:54:44.100175825 (120h43m43.983589458s) [upload=96404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:54:44.297311637 (120h43m44.18072525s) [upload=96404]: Done uploading segments... Jun 28 09:54:44.297331811 (120h43m44.180745424s) [upload=96404]: Upload finished. err: <nil> Jun 28 09:55:37.910281321 (120h44m37.793694967s) [upload=96416]: Starting upload Jun 28 09:55:37.910384798 (120h44m37.793798433s) [upload=96416]: Done starting upload Jun 28 09:55:37.910470491 (120h44m37.793884117s) [upload=96416]: Uploading segments... Jun 28 09:55:37.910525361 (120h44m37.793938994s) [upload=96416]: Got next segment. Inline: true Jun 28 09:55:37.910530879 (120h44m37.793944505s) [upload=96416]: Waiting for error group managing segments... Jun 28 09:55:37.910602728 (120h44m37.794016355s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:55:37.910609134 (120h44m37.79402276s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:55:37.910612747 (120h44m37.794026373s) [upload=96416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:55:38.065600898 (120h44m37.94901454s) [upload=96416]: Done uploading segments... Jun 28 09:55:38.065624630 (120h44m37.94903826s) [upload=96416]: Upload finished. err: <nil> Jun 28 09:56:22.196441597 (120h45m22.079855231s) [upload=96426]: Starting upload Jun 28 09:56:22.196554834 (120h45m22.079968465s) [upload=96426]: Done starting upload Jun 28 09:56:22.196684143 (120h45m22.08009777s) [upload=96426]: Uploading segments... Jun 28 09:56:22.196803675 (120h45m22.080217311s) [upload=96426]: Got next segment. Inline: true Jun 28 09:56:22.196830025 (120h45m22.080243655s) [upload=96426]: Waiting for error group managing segments... Jun 28 09:56:22.196909003 (120h45m22.080322637s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:22.196916474 (120h45m22.080330105s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:22.196920811 (120h45m22.080334441s) [upload=96426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:22.532059724 (120h45m22.415473352s) [upload=96426]: Done uploading segments... Jun 28 09:56:22.532082757 (120h45m22.415496374s) [upload=96426]: Upload finished. err: <nil> Jun 28 09:56:58.406478883 (120h45m58.289892511s) [upload=96433]: Starting upload Jun 28 09:56:58.406575947 (120h45m58.289989575s) [upload=96433]: Done starting upload Jun 28 09:56:58.406630517 (120h45m58.290044144s) [upload=96433]: Uploading segments... Jun 28 09:56:58.406730124 (120h45m58.290143759s) [upload=96433]: Got next segment. Inline: true Jun 28 09:56:58.406738337 (120h45m58.290151954s) [upload=96433]: Waiting for error group managing segments... Jun 28 09:56:58.406801585 (120h45m58.290215212s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:56:58.406807459 (120h45m58.290221076s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:56:58.406811004 (120h45m58.29022462s) [upload=96433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:56:58.611002494 (120h45m58.494416115s) [upload=96433]: Done uploading segments... Jun 28 09:56:58.611021466 (120h45m58.494435092s) [upload=96433]: Upload finished. err: <nil> Jun 28 09:57:58.920206053 (120h46m58.803619686s) [upload=96448]: Starting upload Jun 28 09:57:58.920273595 (120h46m58.803687213s) [upload=96448]: Done starting upload Jun 28 09:57:58.920338971 (120h46m58.803752587s) [upload=96448]: Uploading segments... Jun 28 09:57:58.920415289 (120h46m58.803828925s) [upload=96448]: Got next segment. Inline: true Jun 28 09:57:58.920421025 (120h46m58.803834652s) [upload=96448]: Waiting for error group managing segments... Jun 28 09:57:58.920504375 (120h46m58.803918012s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:57:58.920512878 (120h46m58.803926514s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:57:58.920520354 (120h46m58.803933987s) [upload=96448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:57:59.078959302 (120h46m58.962372921s) [upload=96448]: Done uploading segments... Jun 28 09:57:59.079010253 (120h46m58.96242388s) [upload=96448]: Upload finished. err: <nil> Jun 28 09:59:08.087348286 (120h48m7.970761914s) [upload=96462]: Starting upload Jun 28 09:59:08.087572011 (120h48m7.970985707s) [upload=96462]: Done starting upload Jun 28 09:59:08.087651977 (120h48m7.971065597s) [upload=96462]: Uploading segments... Jun 28 09:59:08.087750205 (120h48m7.971163831s) [upload=96462]: Got next segment. Inline: true Jun 28 09:59:08.087756875 (120h48m7.971170501s) [upload=96462]: Waiting for error group managing segments... Jun 28 09:59:08.087818433 (120h48m7.971232059s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:08.087824511 (120h48m7.971238138s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:08.087828039 (120h48m7.971241665s) [upload=96462]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:08.275503469 (120h48m8.158917086s) [upload=96462]: Done uploading segments... Jun 28 09:59:08.275522806 (120h48m8.158936419s) [upload=96462]: Upload finished. err: <nil> Jun 28 09:59:33.780128916 (120h48m33.663542542s) [upload=96467]: Starting upload Jun 28 09:59:33.780213116 (120h48m33.663626733s) [upload=96467]: Done starting upload Jun 28 09:59:33.780321019 (120h48m33.663734646s) [upload=96467]: Uploading segments... Jun 28 09:59:33.780387647 (120h48m33.663801273s) [upload=96467]: Got next segment. Inline: true Jun 28 09:59:33.780398250 (120h48m33.663811866s) [upload=96467]: Waiting for error group managing segments... Jun 28 09:59:33.780471591 (120h48m33.663885206s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:33.780477371 (120h48m33.663890996s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:33.780480633 (120h48m33.663894261s) [upload=96467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:33.965449169 (120h48m33.848862796s) [upload=96467]: Done uploading segments... Jun 28 09:59:33.965468151 (120h48m33.848881763s) [upload=96467]: Upload finished. err: <nil> Jun 28 09:59:50.410158799 (120h48m50.293572415s) [upload=96470]: Starting upload Jun 28 09:59:50.410269009 (120h48m50.293682642s) [upload=96470]: Done starting upload Jun 28 09:59:50.410388971 (120h48m50.293802598s) [upload=96470]: Uploading segments... Jun 28 09:59:50.410461032 (120h48m50.293874668s) [upload=96470]: Got next segment. Inline: true Jun 28 09:59:50.410482471 (120h48m50.293896104s) [upload=96470]: Waiting for error group managing segments... Jun 28 09:59:50.410532444 (120h48m50.29394607s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 09:59:50.410538646 (120h48m50.293952272s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 09:59:50.410543533 (120h48m50.293957164s) [upload=96470]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 09:59:50.556925028 (120h48m50.44033865s) [upload=96470]: Done uploading segments... Jun 28 09:59:50.556957325 (120h48m50.440370942s) [upload=96470]: Upload finished. err: <nil> Jun 28 10:01:04.684430767 (120h50m4.567844394s) [upload=96487]: Starting upload Jun 28 10:01:04.684530637 (120h50m4.567944259s) [upload=96487]: Done starting upload Jun 28 10:01:04.684604388 (120h50m4.568018006s) [upload=96487]: Uploading segments... Jun 28 10:01:04.684704754 (120h50m4.568118455s) [upload=96487]: Got next segment. Inline: true Jun 28 10:01:04.684731509 (120h50m4.568145137s) [upload=96487]: Waiting for error group managing segments... Jun 28 10:01:04.684830608 (120h50m4.568244245s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 28 10:01:04.684839796 (120h50m4.56825341s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 28 10:01:04.684843846 (120h50m4.56825746s) [upload=96487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 28 10:01:04.836777290 (120h50m4.720190914s) [upload=96487]: Done uploading segments... Jun 28 10:01:04.836811185 (120h50m4.720224804s) [upload=96487]: Upload finished. err: <nil>
Duration: 836.619704ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
291.416173ms target:
https://us1.storj.io/login
FAIL (2025-06-28 10:38:02 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 291.445971ms
core
satellite
us1
|