Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [........................X....................X.........X....] duration:
2.609476578s
FAIL (2025-08-09 03:50:00 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.609500418s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
6 out of 60 is failed (threshold=3) [.............................................X..XXX.....X.X.] duration:
324.124965ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 03:49:44 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 324.142349ms
edge
gateway
vhost
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
315.65611ms
FAIL (2025-08-09 03:49:38 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 315.700319ms
edge
authservice
http
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.510118123s
FAIL (2025-08-09 03:49:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:37:30.833561496 (10h11m52.792658745s) [upload=10565]: Starting upload Aug 9 03:37:30.833618177 (10h11m52.792715423s) [upload=10565]: Done starting upload Aug 9 03:37:30.833943401 (10h11m52.79304065s) [upload=10565]: Uploading segments... Aug 9 03:37:30.834025401 (10h11m52.793122657s) [upload=10565]: Got next segment. Inline: false Aug 9 03:37:30.834070320 (10h11m52.793167571s) [upload=10565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:37:30.834077339 (10h11m52.793174589s) [upload=10565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 03:37:30.921740356 (10h11m52.880837612s) [upload=10565]: Next segment err: metaclient: Too Many Requests Aug 9 03:37:30.921770756 (10h11m52.880868006s) [upload=10565]: Done uploading segments... Aug 9 03:37:30.921792467 (10h11m52.880889718s) [upload=10565]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.510160444s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........................X....................X.........X...] duration:
2.701324509s
FAIL (2025-08-09 03:49:17 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.701396165s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................X............X..............] duration:
919.395471ms
FAIL (2025-08-09 03:48:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:38:21.391404361 (10h12m43.350501607s) [upload=10580]: Starting upload Aug 9 03:38:21.391499574 (10h12m43.350596824s) [upload=10580]: Done starting upload Aug 9 03:38:21.391580214 (10h12m43.35067745s) [upload=10580]: Uploading segments... Aug 9 03:38:21.391626103 (10h12m43.350723357s) [upload=10580]: Got next segment. Inline: true Aug 9 03:38:21.391640756 (10h12m43.350738001s) [upload=10580]: Waiting for error group managing segments... Aug 9 03:38:21.391684974 (10h12m43.350782221s) [upload=10580]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:38:21.391714671 (10h12m43.350811918s) [upload=10580]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 03:38:21.391718801 (10h12m43.35081605s) [upload=10580]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 03:38:21.563255973 (10h12m43.522353225s) [upload=10580]: Done uploading segments... Aug 9 03:38:21.563291106 (10h12m43.522388342s) [upload=10580]: Upload finished. err: metaclient: Too Many Requests
Duration: 919.443033ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................X...................X......] duration:
1.137919342s
FAIL (2025-08-09 03:48:59 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 1.137936315s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.36627487s
FAIL (2025-08-09 03:48:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:37:30.833561496 (10h11m52.792658745s) [upload=10565]: Starting upload Aug 9 03:37:30.833618177 (10h11m52.792715423s) [upload=10565]: Done starting upload Aug 9 03:37:30.833943401 (10h11m52.79304065s) [upload=10565]: Uploading segments... Aug 9 03:37:30.834025401 (10h11m52.793122657s) [upload=10565]: Got next segment. Inline: false Aug 9 03:37:30.834070320 (10h11m52.793167571s) [upload=10565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:37:30.834077339 (10h11m52.793174589s) [upload=10565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 03:37:30.921740356 (10h11m52.880837612s) [upload=10565]: Next segment err: metaclient: Too Many Requests Aug 9 03:37:30.921770756 (10h11m52.880868006s) [upload=10565]: Done uploading segments... Aug 9 03:37:30.921792467 (10h11m52.880889718s) [upload=10565]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.366301531s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........................X....................X.........X..] duration:
2.869290577s
FAIL (2025-08-09 03:48:52 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.869324458s
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
342.787767ms
FAIL (2025-08-09 03:48:49 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 342.914693ms
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................X...................X.....] duration:
5.953605724s
FAIL (2025-08-09 03:48:37 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 5.953630258s
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
315.436022ms
FAIL (2025-08-09 03:48:29 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 315.466523ms
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........................X....................X.........X.] duration:
2.562489292s
FAIL (2025-08-09 03:48:28 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.562513745s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................X............X.............] duration:
855.050002ms
FAIL (2025-08-09 03:48:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:38:21.391404361 (10h12m43.350501607s) [upload=10580]: Starting upload Aug 9 03:38:21.391499574 (10h12m43.350596824s) [upload=10580]: Done starting upload Aug 9 03:38:21.391580214 (10h12m43.35067745s) [upload=10580]: Uploading segments... Aug 9 03:38:21.391626103 (10h12m43.350723357s) [upload=10580]: Got next segment. Inline: true Aug 9 03:38:21.391640756 (10h12m43.350738001s) [upload=10580]: Waiting for error group managing segments... Aug 9 03:38:21.391684974 (10h12m43.350782221s) [upload=10580]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:38:21.391714671 (10h12m43.350811918s) [upload=10580]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 03:38:21.391718801 (10h12m43.35081605s) [upload=10580]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 03:38:21.563255973 (10h12m43.522353225s) [upload=10580]: Done uploading segments... Aug 9 03:38:21.563291106 (10h12m43.522388342s) [upload=10580]: Upload finished. err: metaclient: Too Many Requests
Duration: 855.084525ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.428100398s
FAIL (2025-08-09 03:48:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:37:30.833561496 (10h11m52.792658745s) [upload=10565]: Starting upload Aug 9 03:37:30.833618177 (10h11m52.792715423s) [upload=10565]: Done starting upload Aug 9 03:37:30.833943401 (10h11m52.79304065s) [upload=10565]: Uploading segments... Aug 9 03:37:30.834025401 (10h11m52.793122657s) [upload=10565]: Got next segment. Inline: false Aug 9 03:37:30.834070320 (10h11m52.793167571s) [upload=10565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:37:30.834077339 (10h11m52.793174589s) [upload=10565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 03:37:30.921740356 (10h11m52.880837612s) [upload=10565]: Next segment err: metaclient: Too Many Requests Aug 9 03:37:30.921770756 (10h11m52.880868006s) [upload=10565]: Done uploading segments... Aug 9 03:37:30.921792467 (10h11m52.880889718s) [upload=10565]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.428136752s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [............................X....................X.........X] duration:
30.00143284s
FAIL (2025-08-09 03:47:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001458609s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................X...................X....] duration:
6.011712893s
FAIL (2025-08-09 03:47:49 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 6.011773763s
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
318.572023ms
FAIL (2025-08-09 03:47:38 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 318.649365ms
edge
authservice
http
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X............................................X..............] duration:
2.34629376s
FAIL (2025-08-09 03:47:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:37:30.833561496 (10h11m52.792658745s) [upload=10565]: Starting upload Aug 9 03:37:30.833618177 (10h11m52.792715423s) [upload=10565]: Done starting upload Aug 9 03:37:30.833943401 (10h11m52.79304065s) [upload=10565]: Uploading segments... Aug 9 03:37:30.834025401 (10h11m52.793122657s) [upload=10565]: Got next segment. Inline: false Aug 9 03:37:30.834070320 (10h11m52.793167571s) [upload=10565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:37:30.834077339 (10h11m52.793174589s) [upload=10565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 03:37:30.921740356 (10h11m52.880837612s) [upload=10565]: Next segment err: metaclient: Too Many Requests Aug 9 03:37:30.921770756 (10h11m52.880868006s) [upload=10565]: Done uploading segments... Aug 9 03:37:30.921792467 (10h11m52.880889718s) [upload=10565]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.346326711s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................X............X............] duration:
855.183711ms
FAIL (2025-08-09 03:47:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:38:21.391404361 (10h12m43.350501607s) [upload=10580]: Starting upload Aug 9 03:38:21.391499574 (10h12m43.350596824s) [upload=10580]: Done starting upload Aug 9 03:38:21.391580214 (10h12m43.35067745s) [upload=10580]: Uploading segments... Aug 9 03:38:21.391626103 (10h12m43.350723357s) [upload=10580]: Got next segment. Inline: true Aug 9 03:38:21.391640756 (10h12m43.350738001s) [upload=10580]: Waiting for error group managing segments... Aug 9 03:38:21.391684974 (10h12m43.350782221s) [upload=10580]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:38:21.391714671 (10h12m43.350811918s) [upload=10580]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 03:38:21.391718801 (10h12m43.35081605s) [upload=10580]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 03:38:21.563255973 (10h12m43.522353225s) [upload=10580]: Done uploading segments... Aug 9 03:38:21.563291106 (10h12m43.522388342s) [upload=10580]: Upload finished. err: metaclient: Too Many Requests
Duration: 855.213811ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................................X...................X...] duration:
1.191866994s
FAIL (2025-08-09 03:47:18 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 1.191893776s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X...................X..] duration:
1.083932627s
FAIL (2025-08-09 03:47:00 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 1.083952722s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................X....................X.........] duration:
2.599805589s
FAIL (2025-08-09 03:46:56 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.599829105s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X............................................X.............] duration:
2.384316369s
FAIL (2025-08-09 03:46:48 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:37:30.833561496 (10h11m52.792658745s) [upload=10565]: Starting upload Aug 9 03:37:30.833618177 (10h11m52.792715423s) [upload=10565]: Done starting upload Aug 9 03:37:30.833943401 (10h11m52.79304065s) [upload=10565]: Uploading segments... Aug 9 03:37:30.834025401 (10h11m52.793122657s) [upload=10565]: Got next segment. Inline: false Aug 9 03:37:30.834070320 (10h11m52.793167571s) [upload=10565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:37:30.834077339 (10h11m52.793174589s) [upload=10565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 03:37:30.921740356 (10h11m52.880837612s) [upload=10565]: Next segment err: metaclient: Too Many Requests Aug 9 03:37:30.921770756 (10h11m52.880868006s) [upload=10565]: Done uploading segments... Aug 9 03:37:30.921792467 (10h11m52.880889718s) [upload=10565]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.384350187s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................................X...................X.] duration:
1.027186184s
FAIL (2025-08-09 03:46:45 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 1.027210466s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
5 out of 60 is failed (threshold=3) [...............................................X..XXX.....X.] duration:
289.951853ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 03:46:38 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 289.9665ms
edge
gateway
vhost
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
343.644815ms
FAIL (2025-08-09 03:46:38 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 343.675786ms
edge
authservice
http
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X.X............................................X............] duration:
2.543435701s
FAIL (2025-08-09 03:46:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:37:30.833561496 (10h11m52.792658745s) [upload=10565]: Starting upload Aug 9 03:37:30.833618177 (10h11m52.792715423s) [upload=10565]: Done starting upload Aug 9 03:37:30.833943401 (10h11m52.79304065s) [upload=10565]: Uploading segments... Aug 9 03:37:30.834025401 (10h11m52.793122657s) [upload=10565]: Got next segment. Inline: false Aug 9 03:37:30.834070320 (10h11m52.793167571s) [upload=10565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:37:30.834077339 (10h11m52.793174589s) [upload=10565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 03:37:30.921740356 (10h11m52.880837612s) [upload=10565]: Next segment err: metaclient: Too Many Requests Aug 9 03:37:30.921770756 (10h11m52.880868006s) [upload=10565]: Done uploading segments... Aug 9 03:37:30.921792467 (10h11m52.880889718s) [upload=10565]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.543465162s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................X............X...........] duration:
879.622035ms
FAIL (2025-08-09 03:46:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:38:21.391404361 (10h12m43.350501607s) [upload=10580]: Starting upload Aug 9 03:38:21.391499574 (10h12m43.350596824s) [upload=10580]: Done starting upload Aug 9 03:38:21.391580214 (10h12m43.35067745s) [upload=10580]: Uploading segments... Aug 9 03:38:21.391626103 (10h12m43.350723357s) [upload=10580]: Got next segment. Inline: true Aug 9 03:38:21.391640756 (10h12m43.350738001s) [upload=10580]: Waiting for error group managing segments... Aug 9 03:38:21.391684974 (10h12m43.350782221s) [upload=10580]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:38:21.391714671 (10h12m43.350811918s) [upload=10580]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 03:38:21.391718801 (10h12m43.35081605s) [upload=10580]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 03:38:21.563255973 (10h12m43.522353225s) [upload=10580]: Done uploading segments... Aug 9 03:38:21.563291106 (10h12m43.522388342s) [upload=10580]: Upload finished. err: metaclient: Too Many Requests
Duration: 879.726843ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X...................X] duration:
10.098277828s
FAIL (2025-08-09 03:46:13 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 10.098309945s
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.734907714s
FAIL (2025-08-09 03:46:07 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2.734947046s
edge
authservice
http
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X.X............................................X...........] duration:
2.520509831s
FAIL (2025-08-09 03:45:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:37:30.833561496 (10h11m52.792658745s) [upload=10565]: Starting upload Aug 9 03:37:30.833618177 (10h11m52.792715423s) [upload=10565]: Done starting upload Aug 9 03:37:30.833943401 (10h11m52.79304065s) [upload=10565]: Uploading segments... Aug 9 03:37:30.834025401 (10h11m52.793122657s) [upload=10565]: Got next segment. Inline: false Aug 9 03:37:30.834070320 (10h11m52.793167571s) [upload=10565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:37:30.834077339 (10h11m52.793174589s) [upload=10565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 03:37:30.921740356 (10h11m52.880837612s) [upload=10565]: Next segment err: metaclient: Too Many Requests Aug 9 03:37:30.921770756 (10h11m52.880868006s) [upload=10565]: Done uploading segments... Aug 9 03:37:30.921792467 (10h11m52.880889718s) [upload=10565]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.520552018s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
1.38654188s
FAIL (2025-08-09 03:45:42 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.386560765s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................X....................X........] duration:
2.663324218s
FAIL (2025-08-09 03:45:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.663353114s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................................X............X..........] duration:
919.422334ms
FAIL (2025-08-09 03:45:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:38:21.391404361 (10h12m43.350501607s) [upload=10580]: Starting upload Aug 9 03:38:21.391499574 (10h12m43.350596824s) [upload=10580]: Done starting upload Aug 9 03:38:21.391580214 (10h12m43.35067745s) [upload=10580]: Uploading segments... Aug 9 03:38:21.391626103 (10h12m43.350723357s) [upload=10580]: Got next segment. Inline: true Aug 9 03:38:21.391640756 (10h12m43.350738001s) [upload=10580]: Waiting for error group managing segments... Aug 9 03:38:21.391684974 (10h12m43.350782221s) [upload=10580]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:38:21.391714671 (10h12m43.350811918s) [upload=10580]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 03:38:21.391718801 (10h12m43.35081605s) [upload=10580]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 03:38:21.563255973 (10h12m43.522353225s) [upload=10580]: Done uploading segments... Aug 9 03:38:21.563291106 (10h12m43.522388342s) [upload=10580]: Upload finished. err: metaclient: Too Many Requests
Duration: 919.452134ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X.X............................................X..........] duration:
2.509393791s
FAIL (2025-08-09 03:45:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:37:30.833561496 (10h11m52.792658745s) [upload=10565]: Starting upload Aug 9 03:37:30.833618177 (10h11m52.792715423s) [upload=10565]: Done starting upload Aug 9 03:37:30.833943401 (10h11m52.79304065s) [upload=10565]: Uploading segments... Aug 9 03:37:30.834025401 (10h11m52.793122657s) [upload=10565]: Got next segment. Inline: false Aug 9 03:37:30.834070320 (10h11m52.793167571s) [upload=10565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:37:30.834077339 (10h11m52.793174589s) [upload=10565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 03:37:30.921740356 (10h11m52.880837612s) [upload=10565]: Next segment err: metaclient: Too Many Requests Aug 9 03:37:30.921770756 (10h11m52.880868006s) [upload=10565]: Done uploading segments... Aug 9 03:37:30.921792467 (10h11m52.880889718s) [upload=10565]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.509423034s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................X....................X.......] duration:
2.712594142s
FAIL (2025-08-09 03:45:17 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.712622654s
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
315.320596ms
FAIL (2025-08-09 03:44:50 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 315.346415ms
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
1.49287864s
FAIL (2025-08-09 03:44:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.492901839s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X.X............................................X.........] duration:
2.339682816s
FAIL (2025-08-09 03:44:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:37:30.833561496 (10h11m52.792658745s) [upload=10565]: Starting upload Aug 9 03:37:30.833618177 (10h11m52.792715423s) [upload=10565]: Done starting upload Aug 9 03:37:30.833943401 (10h11m52.79304065s) [upload=10565]: Uploading segments... Aug 9 03:37:30.834025401 (10h11m52.793122657s) [upload=10565]: Got next segment. Inline: false Aug 9 03:37:30.834070320 (10h11m52.793167571s) [upload=10565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:37:30.834077339 (10h11m52.793174589s) [upload=10565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 03:37:30.921740356 (10h11m52.880837612s) [upload=10565]: Next segment err: metaclient: Too Many Requests Aug 9 03:37:30.921770756 (10h11m52.880868006s) [upload=10565]: Done uploading segments... Aug 9 03:37:30.921792467 (10h11m52.880889718s) [upload=10565]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.339715857s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X....................................X............X.........] duration:
833.337283ms
FAIL (2025-08-09 03:44:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:38:21.391404361 (10h12m43.350501607s) [upload=10580]: Starting upload Aug 9 03:38:21.391499574 (10h12m43.350596824s) [upload=10580]: Done starting upload Aug 9 03:38:21.391580214 (10h12m43.35067745s) [upload=10580]: Uploading segments... Aug 9 03:38:21.391626103 (10h12m43.350723357s) [upload=10580]: Got next segment. Inline: true Aug 9 03:38:21.391640756 (10h12m43.350738001s) [upload=10580]: Waiting for error group managing segments... Aug 9 03:38:21.391684974 (10h12m43.350782221s) [upload=10580]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:38:21.391714671 (10h12m43.350811918s) [upload=10580]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 03:38:21.391718801 (10h12m43.35081605s) [upload=10580]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 03:38:21.563255973 (10h12m43.522353225s) [upload=10580]: Done uploading segments... Aug 9 03:38:21.563291106 (10h12m43.522388342s) [upload=10580]: Upload finished. err: metaclient: Too Many Requests
Duration: 833.411489ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
332.274344ms
FAIL (2025-08-09 03:44:19 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 332.304954ms
edge
authservice
http
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X....................................X............X........] duration:
1.053304836s
FAIL (2025-08-09 03:44:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:38:21.391404361 (10h12m43.350501607s) [upload=10580]: Starting upload Aug 9 03:38:21.391499574 (10h12m43.350596824s) [upload=10580]: Done starting upload Aug 9 03:38:21.391580214 (10h12m43.35067745s) [upload=10580]: Uploading segments... Aug 9 03:38:21.391626103 (10h12m43.350723357s) [upload=10580]: Got next segment. Inline: true Aug 9 03:38:21.391640756 (10h12m43.350738001s) [upload=10580]: Waiting for error group managing segments... Aug 9 03:38:21.391684974 (10h12m43.350782221s) [upload=10580]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:38:21.391714671 (10h12m43.350811918s) [upload=10580]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 03:38:21.391718801 (10h12m43.35081605s) [upload=10580]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 03:38:21.563255973 (10h12m43.522353225s) [upload=10580]: Done uploading segments... Aug 9 03:38:21.563291106 (10h12m43.522388342s) [upload=10580]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.053350272s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X.X............................................X........] duration:
2.347357478s
FAIL (2025-08-09 03:44:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:37:30.833561496 (10h11m52.792658745s) [upload=10565]: Starting upload Aug 9 03:37:30.833618177 (10h11m52.792715423s) [upload=10565]: Done starting upload Aug 9 03:37:30.833943401 (10h11m52.79304065s) [upload=10565]: Uploading segments... Aug 9 03:37:30.834025401 (10h11m52.793122657s) [upload=10565]: Got next segment. Inline: false Aug 9 03:37:30.834070320 (10h11m52.793167571s) [upload=10565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:37:30.834077339 (10h11m52.793174589s) [upload=10565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 03:37:30.921740356 (10h11m52.880837612s) [upload=10565]: Next segment err: metaclient: Too Many Requests Aug 9 03:37:30.921770756 (10h11m52.880868006s) [upload=10565]: Done uploading segments... Aug 9 03:37:30.921792467 (10h11m52.880889718s) [upload=10565]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.347390842s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................X....................X......] duration:
2.746634609s
FAIL (2025-08-09 03:44:04 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.746657403s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
1.049761928s
FAIL (2025-08-09 03:44:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.049822183s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
4 out of 60 is failed (threshold=3) [.................................................X..XXX.....] duration:
340.705861ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 03:43:55 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 340.735474ms
edge
gateway
vhost
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
471.564009ms
FAIL (2025-08-09 03:43:48 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 471.590645ms
edge
authservice
http
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X.X............................................X.......] duration:
2.371423763s
FAIL (2025-08-09 03:43:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:37:30.833561496 (10h11m52.792658745s) [upload=10565]: Starting upload Aug 9 03:37:30.833618177 (10h11m52.792715423s) [upload=10565]: Done starting upload Aug 9 03:37:30.833943401 (10h11m52.79304065s) [upload=10565]: Uploading segments... Aug 9 03:37:30.834025401 (10h11m52.793122657s) [upload=10565]: Got next segment. Inline: false Aug 9 03:37:30.834070320 (10h11m52.793167571s) [upload=10565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:37:30.834077339 (10h11m52.793174589s) [upload=10565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 03:37:30.921740356 (10h11m52.880837612s) [upload=10565]: Next segment err: metaclient: Too Many Requests Aug 9 03:37:30.921770756 (10h11m52.880868006s) [upload=10565]: Done uploading segments... Aug 9 03:37:30.921792467 (10h11m52.880889718s) [upload=10565]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.371454496s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X....................................X............X.......] duration:
827.473639ms
FAIL (2025-08-09 03:43:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:38:21.391404361 (10h12m43.350501607s) [upload=10580]: Starting upload Aug 9 03:38:21.391499574 (10h12m43.350596824s) [upload=10580]: Done starting upload Aug 9 03:38:21.391580214 (10h12m43.35067745s) [upload=10580]: Uploading segments... Aug 9 03:38:21.391626103 (10h12m43.350723357s) [upload=10580]: Got next segment. Inline: true Aug 9 03:38:21.391640756 (10h12m43.350738001s) [upload=10580]: Waiting for error group managing segments... Aug 9 03:38:21.391684974 (10h12m43.350782221s) [upload=10580]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:38:21.391714671 (10h12m43.350811918s) [upload=10580]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 03:38:21.391718801 (10h12m43.35081605s) [upload=10580]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 03:38:21.563255973 (10h12m43.522353225s) [upload=10580]: Done uploading segments... Aug 9 03:38:21.563291106 (10h12m43.522388342s) [upload=10580]: Upload finished. err: metaclient: Too Many Requests
Duration: 827.50957ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|