Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
3.136662386s
FAIL (2025-08-19 14:23:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 13:58:14.764744419 (260h32m36.723841671s) [upload=271267]: Starting upload Aug 19 13:58:14.764817415 (260h32m36.723914647s) [upload=271267]: Done starting upload Aug 19 13:58:14.764907693 (260h32m36.724004943s) [upload=271267]: Uploading segments... Aug 19 13:58:14.765217616 (260h32m36.724314861s) [upload=271267]: Got next segment. Inline: false Aug 19 13:58:14.765325191 (260h32m36.724422444s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:58:14.765333751 (260h32m36.724430997s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 13:58:14.853411642 (260h32m36.812508896s) [upload=271267]: Next segment err: metaclient: Too Many Requests Aug 19 13:58:14.853441384 (260h32m36.812538638s) [upload=271267]: Done uploading segments... Aug 19 13:58:14.853478187 (260h32m36.812575421s) [upload=271267]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.136717285s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X...............................................X........] duration:
908.20696ms
FAIL (2025-08-19 14:23:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 886b59da0a1013cb11a6998a56d98dabb7686c13481f2442886754bf7d3d6872 != before 607b9658f53e3428b7e5f39b2ae1186b85e93fb43c436f42fa35d808dba6890e ======LOGS====== Aug 19 14:16:56.306325753 (260h51m18.265423009s) [upload=271590]: Starting upload Aug 19 14:16:56.306436584 (260h51m18.265533839s) [upload=271590]: Done starting upload Aug 19 14:16:56.306554972 (260h51m18.265652218s) [upload=271590]: Uploading segments... Aug 19 14:16:56.306634008 (260h51m18.265731266s) [upload=271590]: Got next segment. Inline: true Aug 19 14:16:56.306641079 (260h51m18.265738336s) [upload=271590]: Waiting for error group managing segments... Aug 19 14:16:56.306720898 (260h51m18.265818129s) [upload=271590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 14:16:56.306727116 (260h51m18.265824365s) [upload=271590]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 14:16:56.306731102 (260h51m18.265828348s) [upload=271590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 14:16:57.422928925 (260h51m19.382026191s) [upload=271590]: Done uploading segments... Aug 19 14:16:57.422955968 (260h51m19.382053221s) [upload=271590]: Upload finished. err: <nil>
Duration: 908.303592ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X...............................................X.......] duration:
958.935327ms
FAIL (2025-08-19 14:23:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 886b59da0a1013cb11a6998a56d98dabb7686c13481f2442886754bf7d3d6872 != before 607b9658f53e3428b7e5f39b2ae1186b85e93fb43c436f42fa35d808dba6890e ======LOGS====== Aug 19 14:16:56.306325753 (260h51m18.265423009s) [upload=271590]: Starting upload Aug 19 14:16:56.306436584 (260h51m18.265533839s) [upload=271590]: Done starting upload Aug 19 14:16:56.306554972 (260h51m18.265652218s) [upload=271590]: Uploading segments... Aug 19 14:16:56.306634008 (260h51m18.265731266s) [upload=271590]: Got next segment. Inline: true Aug 19 14:16:56.306641079 (260h51m18.265738336s) [upload=271590]: Waiting for error group managing segments... Aug 19 14:16:56.306720898 (260h51m18.265818129s) [upload=271590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 14:16:56.306727116 (260h51m18.265824365s) [upload=271590]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 14:16:56.306731102 (260h51m18.265828348s) [upload=271590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 14:16:57.422928925 (260h51m19.382026191s) [upload=271590]: Done uploading segments... Aug 19 14:16:57.422955968 (260h51m19.382053221s) [upload=271590]: Upload finished. err: <nil>
Duration: 959.019186ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
2.698824543s
FAIL (2025-08-19 14:23:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 13:58:14.764744419 (260h32m36.723841671s) [upload=271267]: Starting upload Aug 19 13:58:14.764817415 (260h32m36.723914647s) [upload=271267]: Done starting upload Aug 19 13:58:14.764907693 (260h32m36.724004943s) [upload=271267]: Uploading segments... Aug 19 13:58:14.765217616 (260h32m36.724314861s) [upload=271267]: Got next segment. Inline: false Aug 19 13:58:14.765325191 (260h32m36.724422444s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:58:14.765333751 (260h32m36.724430997s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 13:58:14.853411642 (260h32m36.812508896s) [upload=271267]: Next segment err: metaclient: Too Many Requests Aug 19 13:58:14.853441384 (260h32m36.812538638s) [upload=271267]: Done uploading segments... Aug 19 13:58:14.853478187 (260h32m36.812575421s) [upload=271267]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.698864354s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X...............................................X......] duration:
933.28596ms
FAIL (2025-08-19 14:22:02 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 886b59da0a1013cb11a6998a56d98dabb7686c13481f2442886754bf7d3d6872 != before 607b9658f53e3428b7e5f39b2ae1186b85e93fb43c436f42fa35d808dba6890e ======LOGS====== Aug 19 14:16:56.306325753 (260h51m18.265423009s) [upload=271590]: Starting upload Aug 19 14:16:56.306436584 (260h51m18.265533839s) [upload=271590]: Done starting upload Aug 19 14:16:56.306554972 (260h51m18.265652218s) [upload=271590]: Uploading segments... Aug 19 14:16:56.306634008 (260h51m18.265731266s) [upload=271590]: Got next segment. Inline: true Aug 19 14:16:56.306641079 (260h51m18.265738336s) [upload=271590]: Waiting for error group managing segments... Aug 19 14:16:56.306720898 (260h51m18.265818129s) [upload=271590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 14:16:56.306727116 (260h51m18.265824365s) [upload=271590]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 14:16:56.306731102 (260h51m18.265828348s) [upload=271590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 14:16:57.422928925 (260h51m19.382026191s) [upload=271590]: Done uploading segments... Aug 19 14:16:57.422955968 (260h51m19.382053221s) [upload=271590]: Upload finished. err: <nil>
Duration: 933.323525ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
2.496308135s
FAIL (2025-08-19 14:21:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 13:58:14.764744419 (260h32m36.723841671s) [upload=271267]: Starting upload Aug 19 13:58:14.764817415 (260h32m36.723914647s) [upload=271267]: Done starting upload Aug 19 13:58:14.764907693 (260h32m36.724004943s) [upload=271267]: Uploading segments... Aug 19 13:58:14.765217616 (260h32m36.724314861s) [upload=271267]: Got next segment. Inline: false Aug 19 13:58:14.765325191 (260h32m36.724422444s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:58:14.765333751 (260h32m36.724430997s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 13:58:14.853411642 (260h32m36.812508896s) [upload=271267]: Next segment err: metaclient: Too Many Requests Aug 19 13:58:14.853441384 (260h32m36.812538638s) [upload=271267]: Done uploading segments... Aug 19 13:58:14.853478187 (260h32m36.812575421s) [upload=271267]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.496335673s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X...............................................X.....] duration:
853.066067ms
FAIL (2025-08-19 14:21:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 886b59da0a1013cb11a6998a56d98dabb7686c13481f2442886754bf7d3d6872 != before 607b9658f53e3428b7e5f39b2ae1186b85e93fb43c436f42fa35d808dba6890e ======LOGS====== Aug 19 14:16:56.306325753 (260h51m18.265423009s) [upload=271590]: Starting upload Aug 19 14:16:56.306436584 (260h51m18.265533839s) [upload=271590]: Done starting upload Aug 19 14:16:56.306554972 (260h51m18.265652218s) [upload=271590]: Uploading segments... Aug 19 14:16:56.306634008 (260h51m18.265731266s) [upload=271590]: Got next segment. Inline: true Aug 19 14:16:56.306641079 (260h51m18.265738336s) [upload=271590]: Waiting for error group managing segments... Aug 19 14:16:56.306720898 (260h51m18.265818129s) [upload=271590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 14:16:56.306727116 (260h51m18.265824365s) [upload=271590]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 14:16:56.306731102 (260h51m18.265828348s) [upload=271590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 14:16:57.422928925 (260h51m19.382026191s) [upload=271590]: Done uploading segments... Aug 19 14:16:57.422955968 (260h51m19.382053221s) [upload=271590]: Upload finished. err: <nil>
Duration: 853.114441ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
2.866070988s
FAIL (2025-08-19 14:20:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 13:58:14.764744419 (260h32m36.723841671s) [upload=271267]: Starting upload Aug 19 13:58:14.764817415 (260h32m36.723914647s) [upload=271267]: Done starting upload Aug 19 13:58:14.764907693 (260h32m36.724004943s) [upload=271267]: Uploading segments... Aug 19 13:58:14.765217616 (260h32m36.724314861s) [upload=271267]: Got next segment. Inline: false Aug 19 13:58:14.765325191 (260h32m36.724422444s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:58:14.765333751 (260h32m36.724430997s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 13:58:14.853411642 (260h32m36.812508896s) [upload=271267]: Next segment err: metaclient: Too Many Requests Aug 19 13:58:14.853441384 (260h32m36.812538638s) [upload=271267]: Done uploading segments... Aug 19 13:58:14.853478187 (260h32m36.812575421s) [upload=271267]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.866109313s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X...............................................X....] duration:
1.304278664s
FAIL (2025-08-19 14:20:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 886b59da0a1013cb11a6998a56d98dabb7686c13481f2442886754bf7d3d6872 != before 607b9658f53e3428b7e5f39b2ae1186b85e93fb43c436f42fa35d808dba6890e ======LOGS====== Aug 19 14:16:56.306325753 (260h51m18.265423009s) [upload=271590]: Starting upload Aug 19 14:16:56.306436584 (260h51m18.265533839s) [upload=271590]: Done starting upload Aug 19 14:16:56.306554972 (260h51m18.265652218s) [upload=271590]: Uploading segments... Aug 19 14:16:56.306634008 (260h51m18.265731266s) [upload=271590]: Got next segment. Inline: true Aug 19 14:16:56.306641079 (260h51m18.265738336s) [upload=271590]: Waiting for error group managing segments... Aug 19 14:16:56.306720898 (260h51m18.265818129s) [upload=271590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 14:16:56.306727116 (260h51m18.265824365s) [upload=271590]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 14:16:56.306731102 (260h51m18.265828348s) [upload=271590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 14:16:57.422928925 (260h51m19.382026191s) [upload=271590]: Done uploading segments... Aug 19 14:16:57.422955968 (260h51m19.382053221s) [upload=271590]: Upload finished. err: <nil>
Duration: 1.304335953s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
3.093980843s
FAIL (2025-08-19 14:20:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 13:58:14.764744419 (260h32m36.723841671s) [upload=271267]: Starting upload Aug 19 13:58:14.764817415 (260h32m36.723914647s) [upload=271267]: Done starting upload Aug 19 13:58:14.764907693 (260h32m36.724004943s) [upload=271267]: Uploading segments... Aug 19 13:58:14.765217616 (260h32m36.724314861s) [upload=271267]: Got next segment. Inline: false Aug 19 13:58:14.765325191 (260h32m36.724422444s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:58:14.765333751 (260h32m36.724430997s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 13:58:14.853411642 (260h32m36.812508896s) [upload=271267]: Next segment err: metaclient: Too Many Requests Aug 19 13:58:14.853441384 (260h32m36.812538638s) [upload=271267]: Done uploading segments... Aug 19 13:58:14.853478187 (260h32m36.812575421s) [upload=271267]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.094089498s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X...............................................X...] duration:
1.101875903s
FAIL (2025-08-19 14:19:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 886b59da0a1013cb11a6998a56d98dabb7686c13481f2442886754bf7d3d6872 != before 607b9658f53e3428b7e5f39b2ae1186b85e93fb43c436f42fa35d808dba6890e ======LOGS====== Aug 19 14:16:56.306325753 (260h51m18.265423009s) [upload=271590]: Starting upload Aug 19 14:16:56.306436584 (260h51m18.265533839s) [upload=271590]: Done starting upload Aug 19 14:16:56.306554972 (260h51m18.265652218s) [upload=271590]: Uploading segments... Aug 19 14:16:56.306634008 (260h51m18.265731266s) [upload=271590]: Got next segment. Inline: true Aug 19 14:16:56.306641079 (260h51m18.265738336s) [upload=271590]: Waiting for error group managing segments... Aug 19 14:16:56.306720898 (260h51m18.265818129s) [upload=271590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 14:16:56.306727116 (260h51m18.265824365s) [upload=271590]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 14:16:56.306731102 (260h51m18.265828348s) [upload=271590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 14:16:57.422928925 (260h51m19.382026191s) [upload=271590]: Done uploading segments... Aug 19 14:16:57.422955968 (260h51m19.382053221s) [upload=271590]: Upload finished. err: <nil>
Duration: 1.101911836s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.813062955s
FAIL (2025-08-19 14:19:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 13:58:14.764744419 (260h32m36.723841671s) [upload=271267]: Starting upload Aug 19 13:58:14.764817415 (260h32m36.723914647s) [upload=271267]: Done starting upload Aug 19 13:58:14.764907693 (260h32m36.724004943s) [upload=271267]: Uploading segments... Aug 19 13:58:14.765217616 (260h32m36.724314861s) [upload=271267]: Got next segment. Inline: false Aug 19 13:58:14.765325191 (260h32m36.724422444s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:58:14.765333751 (260h32m36.724430997s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 13:58:14.853411642 (260h32m36.812508896s) [upload=271267]: Next segment err: metaclient: Too Many Requests Aug 19 13:58:14.853441384 (260h32m36.812538638s) [upload=271267]: Done uploading segments... Aug 19 13:58:14.853478187 (260h32m36.812575421s) [upload=271267]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.813102961s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.849196593s
FAIL (2025-08-19 14:18:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 13:58:14.764744419 (260h32m36.723841671s) [upload=271267]: Starting upload Aug 19 13:58:14.764817415 (260h32m36.723914647s) [upload=271267]: Done starting upload Aug 19 13:58:14.764907693 (260h32m36.724004943s) [upload=271267]: Uploading segments... Aug 19 13:58:14.765217616 (260h32m36.724314861s) [upload=271267]: Got next segment. Inline: false Aug 19 13:58:14.765325191 (260h32m36.724422444s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:58:14.765333751 (260h32m36.724430997s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 13:58:14.853411642 (260h32m36.812508896s) [upload=271267]: Next segment err: metaclient: Too Many Requests Aug 19 13:58:14.853441384 (260h32m36.812538638s) [upload=271267]: Done uploading segments... Aug 19 13:58:14.853478187 (260h32m36.812575421s) [upload=271267]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.849287948s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........X...............................................X..] duration:
1.183824834s
FAIL (2025-08-19 14:18:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 886b59da0a1013cb11a6998a56d98dabb7686c13481f2442886754bf7d3d6872 != before 607b9658f53e3428b7e5f39b2ae1186b85e93fb43c436f42fa35d808dba6890e ======LOGS====== Aug 19 14:16:56.306325753 (260h51m18.265423009s) [upload=271590]: Starting upload Aug 19 14:16:56.306436584 (260h51m18.265533839s) [upload=271590]: Done starting upload Aug 19 14:16:56.306554972 (260h51m18.265652218s) [upload=271590]: Uploading segments... Aug 19 14:16:56.306634008 (260h51m18.265731266s) [upload=271590]: Got next segment. Inline: true Aug 19 14:16:56.306641079 (260h51m18.265738336s) [upload=271590]: Waiting for error group managing segments... Aug 19 14:16:56.306720898 (260h51m18.265818129s) [upload=271590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 14:16:56.306727116 (260h51m18.265824365s) [upload=271590]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 14:16:56.306731102 (260h51m18.265828348s) [upload=271590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 14:16:57.422928925 (260h51m19.382026191s) [upload=271590]: Done uploading segments... Aug 19 14:16:57.422955968 (260h51m19.382053221s) [upload=271590]: Upload finished. err: <nil>
Duration: 1.183858855s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.646737135s
FAIL (2025-08-19 14:18:02 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 13:58:14.764744419 (260h32m36.723841671s) [upload=271267]: Starting upload Aug 19 13:58:14.764817415 (260h32m36.723914647s) [upload=271267]: Done starting upload Aug 19 13:58:14.764907693 (260h32m36.724004943s) [upload=271267]: Uploading segments... Aug 19 13:58:14.765217616 (260h32m36.724314861s) [upload=271267]: Got next segment. Inline: false Aug 19 13:58:14.765325191 (260h32m36.724422444s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:58:14.765333751 (260h32m36.724430997s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 13:58:14.853411642 (260h32m36.812508896s) [upload=271267]: Next segment err: metaclient: Too Many Requests Aug 19 13:58:14.853441384 (260h32m36.812538638s) [upload=271267]: Done uploading segments... Aug 19 13:58:14.853478187 (260h32m36.812575421s) [upload=271267]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.6468271s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.646567338s
FAIL (2025-08-19 14:17:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 13:58:14.764744419 (260h32m36.723841671s) [upload=271267]: Starting upload Aug 19 13:58:14.764817415 (260h32m36.723914647s) [upload=271267]: Done starting upload Aug 19 13:58:14.764907693 (260h32m36.724004943s) [upload=271267]: Uploading segments... Aug 19 13:58:14.765217616 (260h32m36.724314861s) [upload=271267]: Got next segment. Inline: false Aug 19 13:58:14.765325191 (260h32m36.724422444s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:58:14.765333751 (260h32m36.724430997s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 13:58:14.853411642 (260h32m36.812508896s) [upload=271267]: Next segment err: metaclient: Too Many Requests Aug 19 13:58:14.853441384 (260h32m36.812538638s) [upload=271267]: Done uploading segments... Aug 19 13:58:14.853478187 (260h32m36.812575421s) [upload=271267]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.646608578s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........X...............................................X.] duration:
926.518456ms
FAIL (2025-08-19 14:17:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 886b59da0a1013cb11a6998a56d98dabb7686c13481f2442886754bf7d3d6872 != before 607b9658f53e3428b7e5f39b2ae1186b85e93fb43c436f42fa35d808dba6890e ======LOGS====== Aug 19 14:16:56.306325753 (260h51m18.265423009s) [upload=271590]: Starting upload Aug 19 14:16:56.306436584 (260h51m18.265533839s) [upload=271590]: Done starting upload Aug 19 14:16:56.306554972 (260h51m18.265652218s) [upload=271590]: Uploading segments... Aug 19 14:16:56.306634008 (260h51m18.265731266s) [upload=271590]: Got next segment. Inline: true Aug 19 14:16:56.306641079 (260h51m18.265738336s) [upload=271590]: Waiting for error group managing segments... Aug 19 14:16:56.306720898 (260h51m18.265818129s) [upload=271590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 14:16:56.306727116 (260h51m18.265824365s) [upload=271590]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 14:16:56.306731102 (260h51m18.265828348s) [upload=271590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 14:16:57.422928925 (260h51m19.382026191s) [upload=271590]: Done uploading segments... Aug 19 14:16:57.422955968 (260h51m19.382053221s) [upload=271590]: Upload finished. err: <nil>
Duration: 926.558322ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........X...............................................X] duration:
1.715792264s
FAIL (2025-08-19 14:16:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 886b59da0a1013cb11a6998a56d98dabb7686c13481f2442886754bf7d3d6872 != before 607b9658f53e3428b7e5f39b2ae1186b85e93fb43c436f42fa35d808dba6890e ======LOGS====== Aug 19 14:16:56.306325753 (260h51m18.265423009s) [upload=271590]: Starting upload Aug 19 14:16:56.306436584 (260h51m18.265533839s) [upload=271590]: Done starting upload Aug 19 14:16:56.306554972 (260h51m18.265652218s) [upload=271590]: Uploading segments... Aug 19 14:16:56.306634008 (260h51m18.265731266s) [upload=271590]: Got next segment. Inline: true Aug 19 14:16:56.306641079 (260h51m18.265738336s) [upload=271590]: Waiting for error group managing segments... Aug 19 14:16:56.306720898 (260h51m18.265818129s) [upload=271590]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 14:16:56.306727116 (260h51m18.265824365s) [upload=271590]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 14:16:56.306731102 (260h51m18.265828348s) [upload=271590]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 14:16:57.422928925 (260h51m19.382026191s) [upload=271590]: Done uploading segments... Aug 19 14:16:57.422955968 (260h51m19.382053221s) [upload=271590]: Upload finished. err: <nil>
Duration: 1.715884416s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.848674407s
FAIL (2025-08-19 14:16:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 13:58:14.764744419 (260h32m36.723841671s) [upload=271267]: Starting upload Aug 19 13:58:14.764817415 (260h32m36.723914647s) [upload=271267]: Done starting upload Aug 19 13:58:14.764907693 (260h32m36.724004943s) [upload=271267]: Uploading segments... Aug 19 13:58:14.765217616 (260h32m36.724314861s) [upload=271267]: Got next segment. Inline: false Aug 19 13:58:14.765325191 (260h32m36.724422444s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:58:14.765333751 (260h32m36.724430997s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 13:58:14.853411642 (260h32m36.812508896s) [upload=271267]: Next segment err: metaclient: Too Many Requests Aug 19 13:58:14.853441384 (260h32m36.812538638s) [upload=271267]: Done uploading segments... Aug 19 13:58:14.853478187 (260h32m36.812575421s) [upload=271267]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.848713799s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
1.107973646s
FAIL (2025-08-19 14:15:53 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 13:40:10.415906910 (260h14m32.375004147s) [upload=270951]: Starting upload Aug 19 13:40:10.415971241 (260h14m32.375068498s) [upload=270951]: Done starting upload Aug 19 13:40:10.416090833 (260h14m32.375188078s) [upload=270951]: Uploading segments... Aug 19 13:40:10.416178437 (260h14m32.375275693s) [upload=270951]: Got next segment. Inline: true Aug 19 13:40:10.416185943 (260h14m32.37528318s) [upload=270951]: Waiting for error group managing segments... Aug 19 13:40:10.416243504 (260h14m32.375340752s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:40:10.416250078 (260h14m32.375347326s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 13:40:10.416254191 (260h14m32.375351438s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 13:40:10.724028528 (260h14m32.683125774s) [upload=270951]: Done uploading segments... Aug 19 13:40:10.724050091 (260h14m32.683147339s) [upload=270951]: Upload finished. err: <nil>
Duration: 1.10800689s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.64382621s
FAIL (2025-08-19 14:15:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 13:58:14.764744419 (260h32m36.723841671s) [upload=271267]: Starting upload Aug 19 13:58:14.764817415 (260h32m36.723914647s) [upload=271267]: Done starting upload Aug 19 13:58:14.764907693 (260h32m36.724004943s) [upload=271267]: Uploading segments... Aug 19 13:58:14.765217616 (260h32m36.724314861s) [upload=271267]: Got next segment. Inline: false Aug 19 13:58:14.765325191 (260h32m36.724422444s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:58:14.765333751 (260h32m36.724430997s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 13:58:14.853411642 (260h32m36.812508896s) [upload=271267]: Next segment err: metaclient: Too Many Requests Aug 19 13:58:14.853441384 (260h32m36.812538638s) [upload=271267]: Done uploading segments... Aug 19 13:58:14.853478187 (260h32m36.812575421s) [upload=271267]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.643911971s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
4.01557993s
FAIL (2025-08-19 14:15:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 13:58:14.764744419 (260h32m36.723841671s) [upload=271267]: Starting upload Aug 19 13:58:14.764817415 (260h32m36.723914647s) [upload=271267]: Done starting upload Aug 19 13:58:14.764907693 (260h32m36.724004943s) [upload=271267]: Uploading segments... Aug 19 13:58:14.765217616 (260h32m36.724314861s) [upload=271267]: Got next segment. Inline: false Aug 19 13:58:14.765325191 (260h32m36.724422444s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:58:14.765333751 (260h32m36.724430997s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 13:58:14.853411642 (260h32m36.812508896s) [upload=271267]: Next segment err: metaclient: Too Many Requests Aug 19 13:58:14.853441384 (260h32m36.812538638s) [upload=271267]: Done uploading segments... Aug 19 13:58:14.853478187 (260h32m36.812575421s) [upload=271267]: Upload finished. err: metaclient: Too Many Requests
Duration: 4.015699928s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X....................................X......................] duration:
2.520865778s
FAIL (2025-08-19 14:14:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 13:58:14.764744419 (260h32m36.723841671s) [upload=271267]: Starting upload Aug 19 13:58:14.764817415 (260h32m36.723914647s) [upload=271267]: Done starting upload Aug 19 13:58:14.764907693 (260h32m36.724004943s) [upload=271267]: Uploading segments... Aug 19 13:58:14.765217616 (260h32m36.724314861s) [upload=271267]: Got next segment. Inline: false Aug 19 13:58:14.765325191 (260h32m36.724422444s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:58:14.765333751 (260h32m36.724430997s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 13:58:14.853411642 (260h32m36.812508896s) [upload=271267]: Next segment err: metaclient: Too Many Requests Aug 19 13:58:14.853441384 (260h32m36.812538638s) [upload=271267]: Done uploading segments... Aug 19 13:58:14.853478187 (260h32m36.812575421s) [upload=271267]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.520968712s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
883.806451ms
FAIL (2025-08-19 14:14:44 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 13:40:10.415906910 (260h14m32.375004147s) [upload=270951]: Starting upload Aug 19 13:40:10.415971241 (260h14m32.375068498s) [upload=270951]: Done starting upload Aug 19 13:40:10.416090833 (260h14m32.375188078s) [upload=270951]: Uploading segments... Aug 19 13:40:10.416178437 (260h14m32.375275693s) [upload=270951]: Got next segment. Inline: true Aug 19 13:40:10.416185943 (260h14m32.37528318s) [upload=270951]: Waiting for error group managing segments... Aug 19 13:40:10.416243504 (260h14m32.375340752s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:40:10.416250078 (260h14m32.375347326s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 13:40:10.416254191 (260h14m32.375351438s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 13:40:10.724028528 (260h14m32.683125774s) [upload=270951]: Done uploading segments... Aug 19 13:40:10.724050091 (260h14m32.683147339s) [upload=270951]: Upload finished. err: <nil>
Duration: 883.834963ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X....................................X.....................] duration:
2.728955657s
FAIL (2025-08-19 14:14:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 13:58:14.764744419 (260h32m36.723841671s) [upload=271267]: Starting upload Aug 19 13:58:14.764817415 (260h32m36.723914647s) [upload=271267]: Done starting upload Aug 19 13:58:14.764907693 (260h32m36.724004943s) [upload=271267]: Uploading segments... Aug 19 13:58:14.765217616 (260h32m36.724314861s) [upload=271267]: Got next segment. Inline: false Aug 19 13:58:14.765325191 (260h32m36.724422444s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:58:14.765333751 (260h32m36.724430997s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 13:58:14.853411642 (260h32m36.812508896s) [upload=271267]: Next segment err: metaclient: Too Many Requests Aug 19 13:58:14.853441384 (260h32m36.812538638s) [upload=271267]: Done uploading segments... Aug 19 13:58:14.853478187 (260h32m36.812575421s) [upload=271267]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.729075118s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
865.715329ms
FAIL (2025-08-19 14:14:02 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 13:40:10.415906910 (260h14m32.375004147s) [upload=270951]: Starting upload Aug 19 13:40:10.415971241 (260h14m32.375068498s) [upload=270951]: Done starting upload Aug 19 13:40:10.416090833 (260h14m32.375188078s) [upload=270951]: Uploading segments... Aug 19 13:40:10.416178437 (260h14m32.375275693s) [upload=270951]: Got next segment. Inline: true Aug 19 13:40:10.416185943 (260h14m32.37528318s) [upload=270951]: Waiting for error group managing segments... Aug 19 13:40:10.416243504 (260h14m32.375340752s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:40:10.416250078 (260h14m32.375347326s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 13:40:10.416254191 (260h14m32.375351438s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 13:40:10.724028528 (260h14m32.683125774s) [upload=270951]: Done uploading segments... Aug 19 13:40:10.724050091 (260h14m32.683147339s) [upload=270951]: Upload finished. err: <nil>
Duration: 865.750435ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X....................................X....................] duration:
2.848960405s
FAIL (2025-08-19 14:13:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 13:58:14.764744419 (260h32m36.723841671s) [upload=271267]: Starting upload Aug 19 13:58:14.764817415 (260h32m36.723914647s) [upload=271267]: Done starting upload Aug 19 13:58:14.764907693 (260h32m36.724004943s) [upload=271267]: Uploading segments... Aug 19 13:58:14.765217616 (260h32m36.724314861s) [upload=271267]: Got next segment. Inline: false Aug 19 13:58:14.765325191 (260h32m36.724422444s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:58:14.765333751 (260h32m36.724430997s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 13:58:14.853411642 (260h32m36.812508896s) [upload=271267]: Next segment err: metaclient: Too Many Requests Aug 19 13:58:14.853441384 (260h32m36.812538638s) [upload=271267]: Done uploading segments... Aug 19 13:58:14.853478187 (260h32m36.812575421s) [upload=271267]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.848998011s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
940.208898ms
FAIL (2025-08-19 14:13:38 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 13:40:10.415906910 (260h14m32.375004147s) [upload=270951]: Starting upload Aug 19 13:40:10.415971241 (260h14m32.375068498s) [upload=270951]: Done starting upload Aug 19 13:40:10.416090833 (260h14m32.375188078s) [upload=270951]: Uploading segments... Aug 19 13:40:10.416178437 (260h14m32.375275693s) [upload=270951]: Got next segment. Inline: true Aug 19 13:40:10.416185943 (260h14m32.37528318s) [upload=270951]: Waiting for error group managing segments... Aug 19 13:40:10.416243504 (260h14m32.375340752s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:40:10.416250078 (260h14m32.375347326s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 13:40:10.416254191 (260h14m32.375351438s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 13:40:10.724028528 (260h14m32.683125774s) [upload=270951]: Done uploading segments... Aug 19 13:40:10.724050091 (260h14m32.683147339s) [upload=270951]: Upload finished. err: <nil>
Duration: 940.236567ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
1.022598533s
FAIL (2025-08-19 14:12:55 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 13:40:10.415906910 (260h14m32.375004147s) [upload=270951]: Starting upload Aug 19 13:40:10.415971241 (260h14m32.375068498s) [upload=270951]: Done starting upload Aug 19 13:40:10.416090833 (260h14m32.375188078s) [upload=270951]: Uploading segments... Aug 19 13:40:10.416178437 (260h14m32.375275693s) [upload=270951]: Got next segment. Inline: true Aug 19 13:40:10.416185943 (260h14m32.37528318s) [upload=270951]: Waiting for error group managing segments... Aug 19 13:40:10.416243504 (260h14m32.375340752s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:40:10.416250078 (260h14m32.375347326s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 13:40:10.416254191 (260h14m32.375351438s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 13:40:10.724028528 (260h14m32.683125774s) [upload=270951]: Done uploading segments... Aug 19 13:40:10.724050091 (260h14m32.683147339s) [upload=270951]: Upload finished. err: <nil>
Duration: 1.022641549s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X....................................X...................] duration:
2.848572112s
FAIL (2025-08-19 14:12:54 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 13:58:14.764744419 (260h32m36.723841671s) [upload=271267]: Starting upload Aug 19 13:58:14.764817415 (260h32m36.723914647s) [upload=271267]: Done starting upload Aug 19 13:58:14.764907693 (260h32m36.724004943s) [upload=271267]: Uploading segments... Aug 19 13:58:14.765217616 (260h32m36.724314861s) [upload=271267]: Got next segment. Inline: false Aug 19 13:58:14.765325191 (260h32m36.724422444s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:58:14.765333751 (260h32m36.724430997s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 13:58:14.853411642 (260h32m36.812508896s) [upload=271267]: Next segment err: metaclient: Too Many Requests Aug 19 13:58:14.853441384 (260h32m36.812538638s) [upload=271267]: Done uploading segments... Aug 19 13:58:14.853478187 (260h32m36.812575421s) [upload=271267]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.848608961s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
1.249568159s
FAIL (2025-08-19 14:12:26 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 13:40:10.415906910 (260h14m32.375004147s) [upload=270951]: Starting upload Aug 19 13:40:10.415971241 (260h14m32.375068498s) [upload=270951]: Done starting upload Aug 19 13:40:10.416090833 (260h14m32.375188078s) [upload=270951]: Uploading segments... Aug 19 13:40:10.416178437 (260h14m32.375275693s) [upload=270951]: Got next segment. Inline: true Aug 19 13:40:10.416185943 (260h14m32.37528318s) [upload=270951]: Waiting for error group managing segments... Aug 19 13:40:10.416243504 (260h14m32.375340752s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:40:10.416250078 (260h14m32.375347326s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 13:40:10.416254191 (260h14m32.375351438s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 13:40:10.724028528 (260h14m32.683125774s) [upload=270951]: Done uploading segments... Aug 19 13:40:10.724050091 (260h14m32.683147339s) [upload=270951]: Upload finished. err: <nil>
Duration: 1.249601597s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X....................................X..................] duration:
2.486954866s
FAIL (2025-08-19 14:12:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 13:58:14.764744419 (260h32m36.723841671s) [upload=271267]: Starting upload Aug 19 13:58:14.764817415 (260h32m36.723914647s) [upload=271267]: Done starting upload Aug 19 13:58:14.764907693 (260h32m36.724004943s) [upload=271267]: Uploading segments... Aug 19 13:58:14.765217616 (260h32m36.724314861s) [upload=271267]: Got next segment. Inline: false Aug 19 13:58:14.765325191 (260h32m36.724422444s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:58:14.765333751 (260h32m36.724430997s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 13:58:14.853411642 (260h32m36.812508896s) [upload=271267]: Next segment err: metaclient: Too Many Requests Aug 19 13:58:14.853441384 (260h32m36.812538638s) [upload=271267]: Done uploading segments... Aug 19 13:58:14.853478187 (260h32m36.812575421s) [upload=271267]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.486982537s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
855.134146ms
FAIL (2025-08-19 14:11:31 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 13:40:10.415906910 (260h14m32.375004147s) [upload=270951]: Starting upload Aug 19 13:40:10.415971241 (260h14m32.375068498s) [upload=270951]: Done starting upload Aug 19 13:40:10.416090833 (260h14m32.375188078s) [upload=270951]: Uploading segments... Aug 19 13:40:10.416178437 (260h14m32.375275693s) [upload=270951]: Got next segment. Inline: true Aug 19 13:40:10.416185943 (260h14m32.37528318s) [upload=270951]: Waiting for error group managing segments... Aug 19 13:40:10.416243504 (260h14m32.375340752s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:40:10.416250078 (260h14m32.375347326s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 13:40:10.416254191 (260h14m32.375351438s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 13:40:10.724028528 (260h14m32.683125774s) [upload=270951]: Done uploading segments... Aug 19 13:40:10.724050091 (260h14m32.683147339s) [upload=270951]: Upload finished. err: <nil>
Duration: 855.163651ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X....................................X.................] duration:
2.66309766s
FAIL (2025-08-19 14:11:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 13:58:14.764744419 (260h32m36.723841671s) [upload=271267]: Starting upload Aug 19 13:58:14.764817415 (260h32m36.723914647s) [upload=271267]: Done starting upload Aug 19 13:58:14.764907693 (260h32m36.724004943s) [upload=271267]: Uploading segments... Aug 19 13:58:14.765217616 (260h32m36.724314861s) [upload=271267]: Got next segment. Inline: false Aug 19 13:58:14.765325191 (260h32m36.724422444s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:58:14.765333751 (260h32m36.724430997s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 13:58:14.853411642 (260h32m36.812508896s) [upload=271267]: Next segment err: metaclient: Too Many Requests Aug 19 13:58:14.853441384 (260h32m36.812538638s) [upload=271267]: Done uploading segments... Aug 19 13:58:14.853478187 (260h32m36.812575421s) [upload=271267]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.663126486s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
952.085528ms
FAIL (2025-08-19 14:10:25 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 13:40:10.415906910 (260h14m32.375004147s) [upload=270951]: Starting upload Aug 19 13:40:10.415971241 (260h14m32.375068498s) [upload=270951]: Done starting upload Aug 19 13:40:10.416090833 (260h14m32.375188078s) [upload=270951]: Uploading segments... Aug 19 13:40:10.416178437 (260h14m32.375275693s) [upload=270951]: Got next segment. Inline: true Aug 19 13:40:10.416185943 (260h14m32.37528318s) [upload=270951]: Waiting for error group managing segments... Aug 19 13:40:10.416243504 (260h14m32.375340752s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:40:10.416250078 (260h14m32.375347326s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 13:40:10.416254191 (260h14m32.375351438s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 13:40:10.724028528 (260h14m32.683125774s) [upload=270951]: Done uploading segments... Aug 19 13:40:10.724050091 (260h14m32.683147339s) [upload=270951]: Upload finished. err: <nil>
Duration: 952.113311ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X....................................X................] duration:
2.568198892s
FAIL (2025-08-19 14:10:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 13:58:14.764744419 (260h32m36.723841671s) [upload=271267]: Starting upload Aug 19 13:58:14.764817415 (260h32m36.723914647s) [upload=271267]: Done starting upload Aug 19 13:58:14.764907693 (260h32m36.724004943s) [upload=271267]: Uploading segments... Aug 19 13:58:14.765217616 (260h32m36.724314861s) [upload=271267]: Got next segment. Inline: false Aug 19 13:58:14.765325191 (260h32m36.724422444s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:58:14.765333751 (260h32m36.724430997s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 13:58:14.853411642 (260h32m36.812508896s) [upload=271267]: Next segment err: metaclient: Too Many Requests Aug 19 13:58:14.853441384 (260h32m36.812538638s) [upload=271267]: Done uploading segments... Aug 19 13:58:14.853478187 (260h32m36.812575421s) [upload=271267]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.568237318s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
874.613588ms
FAIL (2025-08-19 14:10:04 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 13:40:10.415906910 (260h14m32.375004147s) [upload=270951]: Starting upload Aug 19 13:40:10.415971241 (260h14m32.375068498s) [upload=270951]: Done starting upload Aug 19 13:40:10.416090833 (260h14m32.375188078s) [upload=270951]: Uploading segments... Aug 19 13:40:10.416178437 (260h14m32.375275693s) [upload=270951]: Got next segment. Inline: true Aug 19 13:40:10.416185943 (260h14m32.37528318s) [upload=270951]: Waiting for error group managing segments... Aug 19 13:40:10.416243504 (260h14m32.375340752s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:40:10.416250078 (260h14m32.375347326s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 13:40:10.416254191 (260h14m32.375351438s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 13:40:10.724028528 (260h14m32.683125774s) [upload=270951]: Done uploading segments... Aug 19 13:40:10.724050091 (260h14m32.683147339s) [upload=270951]: Upload finished. err: <nil>
Duration: 874.65412ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X....................................X...............] duration:
3.173840202s
FAIL (2025-08-19 14:09:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 13:58:14.764744419 (260h32m36.723841671s) [upload=271267]: Starting upload Aug 19 13:58:14.764817415 (260h32m36.723914647s) [upload=271267]: Done starting upload Aug 19 13:58:14.764907693 (260h32m36.724004943s) [upload=271267]: Uploading segments... Aug 19 13:58:14.765217616 (260h32m36.724314861s) [upload=271267]: Got next segment. Inline: false Aug 19 13:58:14.765325191 (260h32m36.724422444s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:58:14.765333751 (260h32m36.724430997s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 13:58:14.853411642 (260h32m36.812508896s) [upload=271267]: Next segment err: metaclient: Too Many Requests Aug 19 13:58:14.853441384 (260h32m36.812538638s) [upload=271267]: Done uploading segments... Aug 19 13:58:14.853478187 (260h32m36.812575421s) [upload=271267]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.17388314s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
844.712988ms
FAIL (2025-08-19 14:09:29 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 13:40:10.415906910 (260h14m32.375004147s) [upload=270951]: Starting upload Aug 19 13:40:10.415971241 (260h14m32.375068498s) [upload=270951]: Done starting upload Aug 19 13:40:10.416090833 (260h14m32.375188078s) [upload=270951]: Uploading segments... Aug 19 13:40:10.416178437 (260h14m32.375275693s) [upload=270951]: Got next segment. Inline: true Aug 19 13:40:10.416185943 (260h14m32.37528318s) [upload=270951]: Waiting for error group managing segments... Aug 19 13:40:10.416243504 (260h14m32.375340752s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:40:10.416250078 (260h14m32.375347326s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 13:40:10.416254191 (260h14m32.375351438s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 13:40:10.724028528 (260h14m32.683125774s) [upload=270951]: Done uploading segments... Aug 19 13:40:10.724050091 (260h14m32.683147339s) [upload=270951]: Upload finished. err: <nil>
Duration: 844.742269ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X....................................X..............] duration:
3.093690366s
FAIL (2025-08-19 14:09:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 13:58:14.764744419 (260h32m36.723841671s) [upload=271267]: Starting upload Aug 19 13:58:14.764817415 (260h32m36.723914647s) [upload=271267]: Done starting upload Aug 19 13:58:14.764907693 (260h32m36.724004943s) [upload=271267]: Uploading segments... Aug 19 13:58:14.765217616 (260h32m36.724314861s) [upload=271267]: Got next segment. Inline: false Aug 19 13:58:14.765325191 (260h32m36.724422444s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:58:14.765333751 (260h32m36.724430997s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 13:58:14.853411642 (260h32m36.812508896s) [upload=271267]: Next segment err: metaclient: Too Many Requests Aug 19 13:58:14.853441384 (260h32m36.812538638s) [upload=271267]: Done uploading segments... Aug 19 13:58:14.853478187 (260h32m36.812575421s) [upload=271267]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.093720368s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
877.430181ms
FAIL (2025-08-19 14:08:49 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 13:40:10.415906910 (260h14m32.375004147s) [upload=270951]: Starting upload Aug 19 13:40:10.415971241 (260h14m32.375068498s) [upload=270951]: Done starting upload Aug 19 13:40:10.416090833 (260h14m32.375188078s) [upload=270951]: Uploading segments... Aug 19 13:40:10.416178437 (260h14m32.375275693s) [upload=270951]: Got next segment. Inline: true Aug 19 13:40:10.416185943 (260h14m32.37528318s) [upload=270951]: Waiting for error group managing segments... Aug 19 13:40:10.416243504 (260h14m32.375340752s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:40:10.416250078 (260h14m32.375347326s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 13:40:10.416254191 (260h14m32.375351438s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 13:40:10.724028528 (260h14m32.683125774s) [upload=270951]: Done uploading segments... Aug 19 13:40:10.724050091 (260h14m32.683147339s) [upload=270951]: Upload finished. err: <nil>
Duration: 877.476221ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X....................................X.............] duration:
2.92981524s
FAIL (2025-08-19 14:08:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 13:58:14.764744419 (260h32m36.723841671s) [upload=271267]: Starting upload Aug 19 13:58:14.764817415 (260h32m36.723914647s) [upload=271267]: Done starting upload Aug 19 13:58:14.764907693 (260h32m36.724004943s) [upload=271267]: Uploading segments... Aug 19 13:58:14.765217616 (260h32m36.724314861s) [upload=271267]: Got next segment. Inline: false Aug 19 13:58:14.765325191 (260h32m36.724422444s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:58:14.765333751 (260h32m36.724430997s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 13:58:14.853411642 (260h32m36.812508896s) [upload=271267]: Next segment err: metaclient: Too Many Requests Aug 19 13:58:14.853441384 (260h32m36.812538638s) [upload=271267]: Done uploading segments... Aug 19 13:58:14.853478187 (260h32m36.812575421s) [upload=271267]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.92985164s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
899.25643ms
FAIL (2025-08-19 14:08:28 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 13:40:10.415906910 (260h14m32.375004147s) [upload=270951]: Starting upload Aug 19 13:40:10.415971241 (260h14m32.375068498s) [upload=270951]: Done starting upload Aug 19 13:40:10.416090833 (260h14m32.375188078s) [upload=270951]: Uploading segments... Aug 19 13:40:10.416178437 (260h14m32.375275693s) [upload=270951]: Got next segment. Inline: true Aug 19 13:40:10.416185943 (260h14m32.37528318s) [upload=270951]: Waiting for error group managing segments... Aug 19 13:40:10.416243504 (260h14m32.375340752s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:40:10.416250078 (260h14m32.375347326s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 13:40:10.416254191 (260h14m32.375351438s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 13:40:10.724028528 (260h14m32.683125774s) [upload=270951]: Done uploading segments... Aug 19 13:40:10.724050091 (260h14m32.683147339s) [upload=270951]: Upload finished. err: <nil>
Duration: 899.307247ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
892.354343ms
FAIL (2025-08-19 14:07:44 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 13:40:10.415906910 (260h14m32.375004147s) [upload=270951]: Starting upload Aug 19 13:40:10.415971241 (260h14m32.375068498s) [upload=270951]: Done starting upload Aug 19 13:40:10.416090833 (260h14m32.375188078s) [upload=270951]: Uploading segments... Aug 19 13:40:10.416178437 (260h14m32.375275693s) [upload=270951]: Got next segment. Inline: true Aug 19 13:40:10.416185943 (260h14m32.37528318s) [upload=270951]: Waiting for error group managing segments... Aug 19 13:40:10.416243504 (260h14m32.375340752s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:40:10.416250078 (260h14m32.375347326s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 13:40:10.416254191 (260h14m32.375351438s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 13:40:10.724028528 (260h14m32.683125774s) [upload=270951]: Done uploading segments... Aug 19 13:40:10.724050091 (260h14m32.683147339s) [upload=270951]: Upload finished. err: <nil>
Duration: 892.386173ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X....................................X............] duration:
2.537025462s
FAIL (2025-08-19 14:07:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 13:58:14.764744419 (260h32m36.723841671s) [upload=271267]: Starting upload Aug 19 13:58:14.764817415 (260h32m36.723914647s) [upload=271267]: Done starting upload Aug 19 13:58:14.764907693 (260h32m36.724004943s) [upload=271267]: Uploading segments... Aug 19 13:58:14.765217616 (260h32m36.724314861s) [upload=271267]: Got next segment. Inline: false Aug 19 13:58:14.765325191 (260h32m36.724422444s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:58:14.765333751 (260h32m36.724430997s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 13:58:14.853411642 (260h32m36.812508896s) [upload=271267]: Next segment err: metaclient: Too Many Requests Aug 19 13:58:14.853441384 (260h32m36.812538638s) [upload=271267]: Done uploading segments... Aug 19 13:58:14.853478187 (260h32m36.812575421s) [upload=271267]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.537065106s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
1.15450823s
FAIL (2025-08-19 14:07:13 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 13:40:10.415906910 (260h14m32.375004147s) [upload=270951]: Starting upload Aug 19 13:40:10.415971241 (260h14m32.375068498s) [upload=270951]: Done starting upload Aug 19 13:40:10.416090833 (260h14m32.375188078s) [upload=270951]: Uploading segments... Aug 19 13:40:10.416178437 (260h14m32.375275693s) [upload=270951]: Got next segment. Inline: true Aug 19 13:40:10.416185943 (260h14m32.37528318s) [upload=270951]: Waiting for error group managing segments... Aug 19 13:40:10.416243504 (260h14m32.375340752s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:40:10.416250078 (260h14m32.375347326s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 13:40:10.416254191 (260h14m32.375351438s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 13:40:10.724028528 (260h14m32.683125774s) [upload=270951]: Done uploading segments... Aug 19 13:40:10.724050091 (260h14m32.683147339s) [upload=270951]: Upload finished. err: <nil>
Duration: 1.15461685s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X....................................X...........] duration:
2.771330763s
FAIL (2025-08-19 14:07:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 13:58:14.764744419 (260h32m36.723841671s) [upload=271267]: Starting upload Aug 19 13:58:14.764817415 (260h32m36.723914647s) [upload=271267]: Done starting upload Aug 19 13:58:14.764907693 (260h32m36.724004943s) [upload=271267]: Uploading segments... Aug 19 13:58:14.765217616 (260h32m36.724314861s) [upload=271267]: Got next segment. Inline: false Aug 19 13:58:14.765325191 (260h32m36.724422444s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:58:14.765333751 (260h32m36.724430997s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 13:58:14.853411642 (260h32m36.812508896s) [upload=271267]: Next segment err: metaclient: Too Many Requests Aug 19 13:58:14.853441384 (260h32m36.812538638s) [upload=271267]: Done uploading segments... Aug 19 13:58:14.853478187 (260h32m36.812575421s) [upload=271267]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.771448329s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
985.565488ms
FAIL (2025-08-19 14:06:48 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 13:40:10.415906910 (260h14m32.375004147s) [upload=270951]: Starting upload Aug 19 13:40:10.415971241 (260h14m32.375068498s) [upload=270951]: Done starting upload Aug 19 13:40:10.416090833 (260h14m32.375188078s) [upload=270951]: Uploading segments... Aug 19 13:40:10.416178437 (260h14m32.375275693s) [upload=270951]: Got next segment. Inline: true Aug 19 13:40:10.416185943 (260h14m32.37528318s) [upload=270951]: Waiting for error group managing segments... Aug 19 13:40:10.416243504 (260h14m32.375340752s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:40:10.416250078 (260h14m32.375347326s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 13:40:10.416254191 (260h14m32.375351438s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 13:40:10.724028528 (260h14m32.683125774s) [upload=270951]: Done uploading segments... Aug 19 13:40:10.724050091 (260h14m32.683147339s) [upload=270951]: Upload finished. err: <nil>
Duration: 985.793867ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X....................................X..........] duration:
2.60185292s
FAIL (2025-08-19 14:05:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 13:58:14.764744419 (260h32m36.723841671s) [upload=271267]: Starting upload Aug 19 13:58:14.764817415 (260h32m36.723914647s) [upload=271267]: Done starting upload Aug 19 13:58:14.764907693 (260h32m36.724004943s) [upload=271267]: Uploading segments... Aug 19 13:58:14.765217616 (260h32m36.724314861s) [upload=271267]: Got next segment. Inline: false Aug 19 13:58:14.765325191 (260h32m36.724422444s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:58:14.765333751 (260h32m36.724430997s) [upload=271267]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 13:58:14.853411642 (260h32m36.812508896s) [upload=271267]: Next segment err: metaclient: Too Many Requests Aug 19 13:58:14.853441384 (260h32m36.812538638s) [upload=271267]: Done uploading segments... Aug 19 13:58:14.853478187 (260h32m36.812575421s) [upload=271267]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.601891907s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
1.016128356s
FAIL (2025-08-19 14:05:50 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 13:40:10.415906910 (260h14m32.375004147s) [upload=270951]: Starting upload Aug 19 13:40:10.415971241 (260h14m32.375068498s) [upload=270951]: Done starting upload Aug 19 13:40:10.416090833 (260h14m32.375188078s) [upload=270951]: Uploading segments... Aug 19 13:40:10.416178437 (260h14m32.375275693s) [upload=270951]: Got next segment. Inline: true Aug 19 13:40:10.416185943 (260h14m32.37528318s) [upload=270951]: Waiting for error group managing segments... Aug 19 13:40:10.416243504 (260h14m32.375340752s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 13:40:10.416250078 (260h14m32.375347326s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 13:40:10.416254191 (260h14m32.375351438s) [upload=270951]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 13:40:10.724028528 (260h14m32.683125774s) [upload=270951]: Done uploading segments... Aug 19 13:40:10.724050091 (260h14m32.683147339s) [upload=270951]: Upload finished. err: <nil>
Duration: 1.016163121s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|