Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [X........................X................X...X....X........] duration:
1.061546377s
FAIL (2025-08-15 05:47:40 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 15 05:41:17.973094544 (156h15m39.9321918s) [upload=162771]: Starting upload
Aug 15 05:41:17.973187079 (156h15m39.932284327s) [upload=162771]: Done starting upload
Aug 15 05:41:17.973328467 (156h15m39.932425715s) [upload=162771]: Uploading segments...
Aug 15 05:41:17.973524236 (156h15m39.932621492s) [upload=162771]: Got next segment. Inline: true
Aug 15 05:41:17.973533693 (156h15m39.932630951s) [upload=162771]: Waiting for error group managing segments...
Aug 15 05:41:17.973634025 (156h15m39.932731276s) [upload=162771]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 05:41:17.973645960 (156h15m39.932743216s) [upload=162771]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 15 05:41:17.973649752 (156h15m39.932747006s) [upload=162771]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 05:41:18.130840326 (156h15m40.089937581s) [upload=162771]: Done uploading segments...
Aug 15 05:41:18.130868126 (156h15m40.089965363s) [upload=162771]: Upload finished. err: <nil>
Duration: 1.06157814s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.X........................X................X...X....X.......] duration:
1.314157242s
FAIL (2025-08-15 05:47:14 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 15 05:41:17.973094544 (156h15m39.9321918s) [upload=162771]: Starting upload
Aug 15 05:41:17.973187079 (156h15m39.932284327s) [upload=162771]: Done starting upload
Aug 15 05:41:17.973328467 (156h15m39.932425715s) [upload=162771]: Uploading segments...
Aug 15 05:41:17.973524236 (156h15m39.932621492s) [upload=162771]: Got next segment. Inline: true
Aug 15 05:41:17.973533693 (156h15m39.932630951s) [upload=162771]: Waiting for error group managing segments...
Aug 15 05:41:17.973634025 (156h15m39.932731276s) [upload=162771]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 05:41:17.973645960 (156h15m39.932743216s) [upload=162771]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 15 05:41:17.973649752 (156h15m39.932747006s) [upload=162771]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 05:41:18.130840326 (156h15m40.089937581s) [upload=162771]: Done uploading segments...
Aug 15 05:41:18.130868126 (156h15m40.089965363s) [upload=162771]: Upload finished. err: <nil>
Duration: 1.314185277s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X...........X...........................X..........] duration:
2.323539593s
FAIL (2025-08-15 05:46:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:37:49.974492824 (156h12m11.933590061s) [upload=162712]: Starting upload Aug 15 05:37:49.974548863 (156h12m11.9336461s) [upload=162712]: Done starting upload Aug 15 05:37:49.974635931 (156h12m11.933733164s) [upload=162712]: Uploading segments... Aug 15 05:37:49.974977863 (156h12m11.934075115s) [upload=162712]: Got next segment. Inline: false Aug 15 05:37:49.975035565 (156h12m11.934132818s) [upload=162712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:37:49.975043007 (156h12m11.934140255s) [upload=162712]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 05:37:50.083571813 (156h12m12.04266906s) [upload=162712]: Next segment err: metaclient: Too Many Requests Aug 15 05:37:50.083622350 (156h12m12.042719595s) [upload=162712]: Done uploading segments... Aug 15 05:37:50.083685229 (156h12m12.042782475s) [upload=162712]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.323617744s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..X........................X................X...X....X......] duration:
806.854283ms
FAIL (2025-08-15 05:46:29 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 15 05:41:17.973094544 (156h15m39.9321918s) [upload=162771]: Starting upload
Aug 15 05:41:17.973187079 (156h15m39.932284327s) [upload=162771]: Done starting upload
Aug 15 05:41:17.973328467 (156h15m39.932425715s) [upload=162771]: Uploading segments...
Aug 15 05:41:17.973524236 (156h15m39.932621492s) [upload=162771]: Got next segment. Inline: true
Aug 15 05:41:17.973533693 (156h15m39.932630951s) [upload=162771]: Waiting for error group managing segments...
Aug 15 05:41:17.973634025 (156h15m39.932731276s) [upload=162771]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 05:41:17.973645960 (156h15m39.932743216s) [upload=162771]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 15 05:41:17.973649752 (156h15m39.932747006s) [upload=162771]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 05:41:18.130840326 (156h15m40.089937581s) [upload=162771]: Done uploading segments...
Aug 15 05:41:18.130868126 (156h15m40.089965363s) [upload=162771]: Upload finished. err: <nil>
Duration: 806.897649ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X...........X...........................X.........] duration:
2.394967989s
FAIL (2025-08-15 05:46:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:37:49.974492824 (156h12m11.933590061s) [upload=162712]: Starting upload Aug 15 05:37:49.974548863 (156h12m11.9336461s) [upload=162712]: Done starting upload Aug 15 05:37:49.974635931 (156h12m11.933733164s) [upload=162712]: Uploading segments... Aug 15 05:37:49.974977863 (156h12m11.934075115s) [upload=162712]: Got next segment. Inline: false Aug 15 05:37:49.975035565 (156h12m11.934132818s) [upload=162712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:37:49.975043007 (156h12m11.934140255s) [upload=162712]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 05:37:50.083571813 (156h12m12.04266906s) [upload=162712]: Next segment err: metaclient: Too Many Requests Aug 15 05:37:50.083622350 (156h12m12.042719595s) [upload=162712]: Done uploading segments... Aug 15 05:37:50.083685229 (156h12m12.042782475s) [upload=162712]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.395079809s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...X........................X................X...X....X.....] duration:
2.343076535s
FAIL (2025-08-15 05:45:39 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 15 05:41:17.973094544 (156h15m39.9321918s) [upload=162771]: Starting upload
Aug 15 05:41:17.973187079 (156h15m39.932284327s) [upload=162771]: Done starting upload
Aug 15 05:41:17.973328467 (156h15m39.932425715s) [upload=162771]: Uploading segments...
Aug 15 05:41:17.973524236 (156h15m39.932621492s) [upload=162771]: Got next segment. Inline: true
Aug 15 05:41:17.973533693 (156h15m39.932630951s) [upload=162771]: Waiting for error group managing segments...
Aug 15 05:41:17.973634025 (156h15m39.932731276s) [upload=162771]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 05:41:17.973645960 (156h15m39.932743216s) [upload=162771]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 15 05:41:17.973649752 (156h15m39.932747006s) [upload=162771]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 05:41:18.130840326 (156h15m40.089937581s) [upload=162771]: Done uploading segments...
Aug 15 05:41:18.130868126 (156h15m40.089965363s) [upload=162771]: Upload finished. err: <nil>
Duration: 2.343109614s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X...........X...........................X........] duration:
2.717374694s
FAIL (2025-08-15 05:45:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:37:49.974492824 (156h12m11.933590061s) [upload=162712]: Starting upload Aug 15 05:37:49.974548863 (156h12m11.9336461s) [upload=162712]: Done starting upload Aug 15 05:37:49.974635931 (156h12m11.933733164s) [upload=162712]: Uploading segments... Aug 15 05:37:49.974977863 (156h12m11.934075115s) [upload=162712]: Got next segment. Inline: false Aug 15 05:37:49.975035565 (156h12m11.934132818s) [upload=162712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:37:49.975043007 (156h12m11.934140255s) [upload=162712]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 05:37:50.083571813 (156h12m12.04266906s) [upload=162712]: Next segment err: metaclient: Too Many Requests Aug 15 05:37:50.083622350 (156h12m12.042719595s) [upload=162712]: Done uploading segments... Aug 15 05:37:50.083685229 (156h12m12.042782475s) [upload=162712]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.717474084s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [....X........................X................X...X....X....] duration:
1.058561819s
FAIL (2025-08-15 05:44:36 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 15 05:41:17.973094544 (156h15m39.9321918s) [upload=162771]: Starting upload
Aug 15 05:41:17.973187079 (156h15m39.932284327s) [upload=162771]: Done starting upload
Aug 15 05:41:17.973328467 (156h15m39.932425715s) [upload=162771]: Uploading segments...
Aug 15 05:41:17.973524236 (156h15m39.932621492s) [upload=162771]: Got next segment. Inline: true
Aug 15 05:41:17.973533693 (156h15m39.932630951s) [upload=162771]: Waiting for error group managing segments...
Aug 15 05:41:17.973634025 (156h15m39.932731276s) [upload=162771]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 05:41:17.973645960 (156h15m39.932743216s) [upload=162771]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 15 05:41:17.973649752 (156h15m39.932747006s) [upload=162771]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 05:41:18.130840326 (156h15m40.089937581s) [upload=162771]: Done uploading segments...
Aug 15 05:41:18.130868126 (156h15m40.089965363s) [upload=162771]: Upload finished. err: <nil>
Duration: 1.058601937s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X...........X...........................X.......] duration:
2.548616222s
FAIL (2025-08-15 05:44:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:37:49.974492824 (156h12m11.933590061s) [upload=162712]: Starting upload Aug 15 05:37:49.974548863 (156h12m11.9336461s) [upload=162712]: Done starting upload Aug 15 05:37:49.974635931 (156h12m11.933733164s) [upload=162712]: Uploading segments... Aug 15 05:37:49.974977863 (156h12m11.934075115s) [upload=162712]: Got next segment. Inline: false Aug 15 05:37:49.975035565 (156h12m11.934132818s) [upload=162712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:37:49.975043007 (156h12m11.934140255s) [upload=162712]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 05:37:50.083571813 (156h12m12.04266906s) [upload=162712]: Next segment err: metaclient: Too Many Requests Aug 15 05:37:50.083622350 (156h12m12.042719595s) [upload=162712]: Done uploading segments... Aug 15 05:37:50.083685229 (156h12m12.042782475s) [upload=162712]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.548648173s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.....X........................X................X...X....X...] duration:
807.130857ms
FAIL (2025-08-15 05:43:26 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 15 05:41:17.973094544 (156h15m39.9321918s) [upload=162771]: Starting upload
Aug 15 05:41:17.973187079 (156h15m39.932284327s) [upload=162771]: Done starting upload
Aug 15 05:41:17.973328467 (156h15m39.932425715s) [upload=162771]: Uploading segments...
Aug 15 05:41:17.973524236 (156h15m39.932621492s) [upload=162771]: Got next segment. Inline: true
Aug 15 05:41:17.973533693 (156h15m39.932630951s) [upload=162771]: Waiting for error group managing segments...
Aug 15 05:41:17.973634025 (156h15m39.932731276s) [upload=162771]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 05:41:17.973645960 (156h15m39.932743216s) [upload=162771]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 15 05:41:17.973649752 (156h15m39.932747006s) [upload=162771]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 05:41:18.130840326 (156h15m40.089937581s) [upload=162771]: Done uploading segments...
Aug 15 05:41:18.130868126 (156h15m40.089965363s) [upload=162771]: Upload finished. err: <nil>
Duration: 807.16519ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X...........X...........................X......] duration:
2.406906514s
FAIL (2025-08-15 05:43:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:37:49.974492824 (156h12m11.933590061s) [upload=162712]: Starting upload Aug 15 05:37:49.974548863 (156h12m11.9336461s) [upload=162712]: Done starting upload Aug 15 05:37:49.974635931 (156h12m11.933733164s) [upload=162712]: Uploading segments... Aug 15 05:37:49.974977863 (156h12m11.934075115s) [upload=162712]: Got next segment. Inline: false Aug 15 05:37:49.975035565 (156h12m11.934132818s) [upload=162712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:37:49.975043007 (156h12m11.934140255s) [upload=162712]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 05:37:50.083571813 (156h12m12.04266906s) [upload=162712]: Next segment err: metaclient: Too Many Requests Aug 15 05:37:50.083622350 (156h12m12.042719595s) [upload=162712]: Done uploading segments... Aug 15 05:37:50.083685229 (156h12m12.042782475s) [upload=162712]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.406942328s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [......X........................X................X...X....X..] duration:
826.747572ms
FAIL (2025-08-15 05:42:43 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 15 05:41:17.973094544 (156h15m39.9321918s) [upload=162771]: Starting upload
Aug 15 05:41:17.973187079 (156h15m39.932284327s) [upload=162771]: Done starting upload
Aug 15 05:41:17.973328467 (156h15m39.932425715s) [upload=162771]: Uploading segments...
Aug 15 05:41:17.973524236 (156h15m39.932621492s) [upload=162771]: Got next segment. Inline: true
Aug 15 05:41:17.973533693 (156h15m39.932630951s) [upload=162771]: Waiting for error group managing segments...
Aug 15 05:41:17.973634025 (156h15m39.932731276s) [upload=162771]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 05:41:17.973645960 (156h15m39.932743216s) [upload=162771]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 15 05:41:17.973649752 (156h15m39.932747006s) [upload=162771]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 05:41:18.130840326 (156h15m40.089937581s) [upload=162771]: Done uploading segments...
Aug 15 05:41:18.130868126 (156h15m40.089965363s) [upload=162771]: Upload finished. err: <nil>
Duration: 826.874414ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X...........X...........................X.....] duration:
2.437542897s
FAIL (2025-08-15 05:42:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:37:49.974492824 (156h12m11.933590061s) [upload=162712]: Starting upload Aug 15 05:37:49.974548863 (156h12m11.9336461s) [upload=162712]: Done starting upload Aug 15 05:37:49.974635931 (156h12m11.933733164s) [upload=162712]: Uploading segments... Aug 15 05:37:49.974977863 (156h12m11.934075115s) [upload=162712]: Got next segment. Inline: false Aug 15 05:37:49.975035565 (156h12m11.934132818s) [upload=162712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:37:49.975043007 (156h12m11.934140255s) [upload=162712]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 05:37:50.083571813 (156h12m12.04266906s) [upload=162712]: Next segment err: metaclient: Too Many Requests Aug 15 05:37:50.083622350 (156h12m12.042719595s) [upload=162712]: Done uploading segments... Aug 15 05:37:50.083685229 (156h12m12.042782475s) [upload=162712]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.437638234s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.......X........................X................X...X....X.] duration:
823.947284ms
FAIL (2025-08-15 05:41:54 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 15 05:41:17.973094544 (156h15m39.9321918s) [upload=162771]: Starting upload
Aug 15 05:41:17.973187079 (156h15m39.932284327s) [upload=162771]: Done starting upload
Aug 15 05:41:17.973328467 (156h15m39.932425715s) [upload=162771]: Uploading segments...
Aug 15 05:41:17.973524236 (156h15m39.932621492s) [upload=162771]: Got next segment. Inline: true
Aug 15 05:41:17.973533693 (156h15m39.932630951s) [upload=162771]: Waiting for error group managing segments...
Aug 15 05:41:17.973634025 (156h15m39.932731276s) [upload=162771]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 05:41:17.973645960 (156h15m39.932743216s) [upload=162771]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 15 05:41:17.973649752 (156h15m39.932747006s) [upload=162771]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 05:41:18.130840326 (156h15m40.089937581s) [upload=162771]: Done uploading segments...
Aug 15 05:41:18.130868126 (156h15m40.089965363s) [upload=162771]: Upload finished. err: <nil>
Duration: 823.984875ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [........X........................X................X...X....X] duration:
726.6079ms
FAIL (2025-08-15 05:41:18 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 15 05:41:17.973094544 (156h15m39.9321918s) [upload=162771]: Starting upload
Aug 15 05:41:17.973187079 (156h15m39.932284327s) [upload=162771]: Done starting upload
Aug 15 05:41:17.973328467 (156h15m39.932425715s) [upload=162771]: Uploading segments...
Aug 15 05:41:17.973524236 (156h15m39.932621492s) [upload=162771]: Got next segment. Inline: true
Aug 15 05:41:17.973533693 (156h15m39.932630951s) [upload=162771]: Waiting for error group managing segments...
Aug 15 05:41:17.973634025 (156h15m39.932731276s) [upload=162771]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 05:41:17.973645960 (156h15m39.932743216s) [upload=162771]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 15 05:41:17.973649752 (156h15m39.932747006s) [upload=162771]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 05:41:18.130840326 (156h15m40.089937581s) [upload=162771]: Done uploading segments...
Aug 15 05:41:18.130868126 (156h15m40.089965363s) [upload=162771]: Upload finished. err: <nil>
Duration: 726.650062ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X...........X...........................X....] duration:
2.92816528s
FAIL (2025-08-15 05:41:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:37:49.974492824 (156h12m11.933590061s) [upload=162712]: Starting upload Aug 15 05:37:49.974548863 (156h12m11.9336461s) [upload=162712]: Done starting upload Aug 15 05:37:49.974635931 (156h12m11.933733164s) [upload=162712]: Uploading segments... Aug 15 05:37:49.974977863 (156h12m11.934075115s) [upload=162712]: Got next segment. Inline: false Aug 15 05:37:49.975035565 (156h12m11.934132818s) [upload=162712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:37:49.975043007 (156h12m11.934140255s) [upload=162712]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 05:37:50.083571813 (156h12m12.04266906s) [upload=162712]: Next segment err: metaclient: Too Many Requests Aug 15 05:37:50.083622350 (156h12m12.042719595s) [upload=162712]: Done uploading segments... Aug 15 05:37:50.083685229 (156h12m12.042782475s) [upload=162712]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.928202555s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................X...........X...........................X...] duration:
2.609550543s
FAIL (2025-08-15 05:40:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:37:49.974492824 (156h12m11.933590061s) [upload=162712]: Starting upload Aug 15 05:37:49.974548863 (156h12m11.9336461s) [upload=162712]: Done starting upload Aug 15 05:37:49.974635931 (156h12m11.933733164s) [upload=162712]: Uploading segments... Aug 15 05:37:49.974977863 (156h12m11.934075115s) [upload=162712]: Got next segment. Inline: false Aug 15 05:37:49.975035565 (156h12m11.934132818s) [upload=162712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:37:49.975043007 (156h12m11.934140255s) [upload=162712]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 05:37:50.083571813 (156h12m12.04266906s) [upload=162712]: Next segment err: metaclient: Too Many Requests Aug 15 05:37:50.083622350 (156h12m12.042719595s) [upload=162712]: Done uploading segments... Aug 15 05:37:50.083685229 (156h12m12.042782475s) [upload=162712]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.609609707s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........X........................X................X...X....] duration:
815.492656ms
FAIL (2025-08-15 05:40:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 72005addd2d370693dd45fbecd7173d6bc32d762725127cad577c0aedb1b8c6a != before 908f10055e84a9c2a7c89f8a5adbbc738c3fa8c36dcac9e3d83dd55fd2b559ed ======LOGS====== Aug 15 05:37:08.769980701 (156h11m30.72907795s) [upload=162703]: Starting upload Aug 15 05:37:08.770064846 (156h11m30.729162082s) [upload=162703]: Done starting upload Aug 15 05:37:08.770162816 (156h11m30.72926005s) [upload=162703]: Uploading segments... Aug 15 05:37:08.770219471 (156h11m30.729316725s) [upload=162703]: Got next segment. Inline: true Aug 15 05:37:08.770224963 (156h11m30.729322202s) [upload=162703]: Waiting for error group managing segments... Aug 15 05:37:08.770282388 (156h11m30.729379629s) [upload=162703]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:37:08.770289341 (156h11m30.72938659s) [upload=162703]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 05:37:08.770301853 (156h11m30.729399094s) [upload=162703]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 05:37:08.920196826 (156h11m30.879294084s) [upload=162703]: Done uploading segments... Aug 15 05:37:08.920222568 (156h11m30.879319803s) [upload=162703]: Upload finished. err: <nil>
Duration: 815.577298ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X...........X...........................X..] duration:
2.5325102s
FAIL (2025-08-15 05:39:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:37:49.974492824 (156h12m11.933590061s) [upload=162712]: Starting upload Aug 15 05:37:49.974548863 (156h12m11.9336461s) [upload=162712]: Done starting upload Aug 15 05:37:49.974635931 (156h12m11.933733164s) [upload=162712]: Uploading segments... Aug 15 05:37:49.974977863 (156h12m11.934075115s) [upload=162712]: Got next segment. Inline: false Aug 15 05:37:49.975035565 (156h12m11.934132818s) [upload=162712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:37:49.975043007 (156h12m11.934140255s) [upload=162712]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 05:37:50.083571813 (156h12m12.04266906s) [upload=162712]: Next segment err: metaclient: Too Many Requests Aug 15 05:37:50.083622350 (156h12m12.042719595s) [upload=162712]: Done uploading segments... Aug 15 05:37:50.083685229 (156h12m12.042782475s) [upload=162712]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.532545369s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........X........................X................X...X...] duration:
816.482504ms
FAIL (2025-08-15 05:39:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 72005addd2d370693dd45fbecd7173d6bc32d762725127cad577c0aedb1b8c6a != before 908f10055e84a9c2a7c89f8a5adbbc738c3fa8c36dcac9e3d83dd55fd2b559ed ======LOGS====== Aug 15 05:37:08.769980701 (156h11m30.72907795s) [upload=162703]: Starting upload Aug 15 05:37:08.770064846 (156h11m30.729162082s) [upload=162703]: Done starting upload Aug 15 05:37:08.770162816 (156h11m30.72926005s) [upload=162703]: Uploading segments... Aug 15 05:37:08.770219471 (156h11m30.729316725s) [upload=162703]: Got next segment. Inline: true Aug 15 05:37:08.770224963 (156h11m30.729322202s) [upload=162703]: Waiting for error group managing segments... Aug 15 05:37:08.770282388 (156h11m30.729379629s) [upload=162703]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:37:08.770289341 (156h11m30.72938659s) [upload=162703]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 05:37:08.770301853 (156h11m30.729399094s) [upload=162703]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 05:37:08.920196826 (156h11m30.879294084s) [upload=162703]: Done uploading segments... Aug 15 05:37:08.920222568 (156h11m30.879319803s) [upload=162703]: Upload finished. err: <nil>
Duration: 816.519957ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [X..........X........................X................X...X..] duration:
831.765085ms
FAIL (2025-08-15 05:39:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 72005addd2d370693dd45fbecd7173d6bc32d762725127cad577c0aedb1b8c6a != before 908f10055e84a9c2a7c89f8a5adbbc738c3fa8c36dcac9e3d83dd55fd2b559ed ======LOGS====== Aug 15 05:37:08.769980701 (156h11m30.72907795s) [upload=162703]: Starting upload Aug 15 05:37:08.770064846 (156h11m30.729162082s) [upload=162703]: Done starting upload Aug 15 05:37:08.770162816 (156h11m30.72926005s) [upload=162703]: Uploading segments... Aug 15 05:37:08.770219471 (156h11m30.729316725s) [upload=162703]: Got next segment. Inline: true Aug 15 05:37:08.770224963 (156h11m30.729322202s) [upload=162703]: Waiting for error group managing segments... Aug 15 05:37:08.770282388 (156h11m30.729379629s) [upload=162703]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:37:08.770289341 (156h11m30.72938659s) [upload=162703]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 05:37:08.770301853 (156h11m30.729399094s) [upload=162703]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 05:37:08.920196826 (156h11m30.879294084s) [upload=162703]: Done uploading segments... Aug 15 05:37:08.920222568 (156h11m30.879319803s) [upload=162703]: Upload finished. err: <nil>
Duration: 831.78487ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................X...........X...........................X.] duration:
2.52787646s
FAIL (2025-08-15 05:38:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:37:49.974492824 (156h12m11.933590061s) [upload=162712]: Starting upload Aug 15 05:37:49.974548863 (156h12m11.9336461s) [upload=162712]: Done starting upload Aug 15 05:37:49.974635931 (156h12m11.933733164s) [upload=162712]: Uploading segments... Aug 15 05:37:49.974977863 (156h12m11.934075115s) [upload=162712]: Got next segment. Inline: false Aug 15 05:37:49.975035565 (156h12m11.934132818s) [upload=162712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:37:49.975043007 (156h12m11.934140255s) [upload=162712]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 05:37:50.083571813 (156h12m12.04266906s) [upload=162712]: Next segment err: metaclient: Too Many Requests Aug 15 05:37:50.083622350 (156h12m12.042719595s) [upload=162712]: Done uploading segments... Aug 15 05:37:50.083685229 (156h12m12.042782475s) [upload=162712]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.527910886s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X..................X...........X...........................X] duration:
419.163141ms
FAIL (2025-08-15 05:37:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:37:49.974492824 (156h12m11.933590061s) [upload=162712]: Starting upload Aug 15 05:37:49.974548863 (156h12m11.9336461s) [upload=162712]: Done starting upload Aug 15 05:37:49.974635931 (156h12m11.933733164s) [upload=162712]: Uploading segments... Aug 15 05:37:49.974977863 (156h12m11.934075115s) [upload=162712]: Got next segment. Inline: false Aug 15 05:37:49.975035565 (156h12m11.934132818s) [upload=162712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:37:49.975043007 (156h12m11.934140255s) [upload=162712]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 05:37:50.083571813 (156h12m12.04266906s) [upload=162712]: Next segment err: metaclient: Too Many Requests Aug 15 05:37:50.083622350 (156h12m12.042719595s) [upload=162712]: Done uploading segments... Aug 15 05:37:50.083685229 (156h12m12.042782475s) [upload=162712]: Upload finished. err: metaclient: Too Many Requests
Duration: 419.188933ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.X..........X........................X................X...X.] duration:
832.634048ms
FAIL (2025-08-15 05:37:48 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 72005addd2d370693dd45fbecd7173d6bc32d762725127cad577c0aedb1b8c6a != before 908f10055e84a9c2a7c89f8a5adbbc738c3fa8c36dcac9e3d83dd55fd2b559ed ======LOGS====== Aug 15 05:37:08.769980701 (156h11m30.72907795s) [upload=162703]: Starting upload Aug 15 05:37:08.770064846 (156h11m30.729162082s) [upload=162703]: Done starting upload Aug 15 05:37:08.770162816 (156h11m30.72926005s) [upload=162703]: Uploading segments... Aug 15 05:37:08.770219471 (156h11m30.729316725s) [upload=162703]: Got next segment. Inline: true Aug 15 05:37:08.770224963 (156h11m30.729322202s) [upload=162703]: Waiting for error group managing segments... Aug 15 05:37:08.770282388 (156h11m30.729379629s) [upload=162703]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:37:08.770289341 (156h11m30.72938659s) [upload=162703]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 05:37:08.770301853 (156h11m30.729399094s) [upload=162703]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 05:37:08.920196826 (156h11m30.879294084s) [upload=162703]: Done uploading segments... Aug 15 05:37:08.920222568 (156h11m30.879319803s) [upload=162703]: Upload finished. err: <nil>
Duration: 832.668306ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X..................X...........X...........................] duration:
2.404238257s
FAIL (2025-08-15 05:37:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:18:32.471716944 (155h52m54.430814197s) [upload=162376]: Starting upload Aug 15 05:18:32.471867265 (155h52m54.430964519s) [upload=162376]: Done starting upload Aug 15 05:18:32.472234351 (155h52m54.431331598s) [upload=162376]: Uploading segments... Aug 15 05:18:32.472371542 (155h52m54.4314688s) [upload=162376]: Got next segment. Inline: false Aug 15 05:18:32.472627486 (155h52m54.431724731s) [upload=162376]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:18:32.472638400 (155h52m54.431735654s) [upload=162376]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 05:18:32.562300039 (155h52m54.521397294s) [upload=162376]: Next segment err: metaclient: Too Many Requests Aug 15 05:18:32.562323034 (155h52m54.521420287s) [upload=162376]: Done uploading segments... Aug 15 05:18:32.562356729 (155h52m54.521453976s) [upload=162376]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.4042712s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..X..........X........................X................X...X] duration:
719.611879ms
FAIL (2025-08-15 05:37:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 72005addd2d370693dd45fbecd7173d6bc32d762725127cad577c0aedb1b8c6a != before 908f10055e84a9c2a7c89f8a5adbbc738c3fa8c36dcac9e3d83dd55fd2b559ed ======LOGS====== Aug 15 05:37:08.769980701 (156h11m30.72907795s) [upload=162703]: Starting upload Aug 15 05:37:08.770064846 (156h11m30.729162082s) [upload=162703]: Done starting upload Aug 15 05:37:08.770162816 (156h11m30.72926005s) [upload=162703]: Uploading segments... Aug 15 05:37:08.770219471 (156h11m30.729316725s) [upload=162703]: Got next segment. Inline: true Aug 15 05:37:08.770224963 (156h11m30.729322202s) [upload=162703]: Waiting for error group managing segments... Aug 15 05:37:08.770282388 (156h11m30.729379629s) [upload=162703]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:37:08.770289341 (156h11m30.72938659s) [upload=162703]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 05:37:08.770301853 (156h11m30.729399094s) [upload=162703]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 05:37:08.920196826 (156h11m30.879294084s) [upload=162703]: Done uploading segments... Aug 15 05:37:08.920222568 (156h11m30.879319803s) [upload=162703]: Upload finished. err: <nil>
Duration: 719.666494ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X..................X...........X..........................] duration:
2.344257068s
FAIL (2025-08-15 05:36:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:18:32.471716944 (155h52m54.430814197s) [upload=162376]: Starting upload Aug 15 05:18:32.471867265 (155h52m54.430964519s) [upload=162376]: Done starting upload Aug 15 05:18:32.472234351 (155h52m54.431331598s) [upload=162376]: Uploading segments... Aug 15 05:18:32.472371542 (155h52m54.4314688s) [upload=162376]: Got next segment. Inline: false Aug 15 05:18:32.472627486 (155h52m54.431724731s) [upload=162376]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:18:32.472638400 (155h52m54.431735654s) [upload=162376]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 05:18:32.562300039 (155h52m54.521397294s) [upload=162376]: Next segment err: metaclient: Too Many Requests Aug 15 05:18:32.562323034 (155h52m54.521420287s) [upload=162376]: Done uploading segments... Aug 15 05:18:32.562356729 (155h52m54.521453976s) [upload=162376]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.34428596s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X..................X...........X.........................] duration:
2.776463539s
FAIL (2025-08-15 05:36:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:18:32.471716944 (155h52m54.430814197s) [upload=162376]: Starting upload Aug 15 05:18:32.471867265 (155h52m54.430964519s) [upload=162376]: Done starting upload Aug 15 05:18:32.472234351 (155h52m54.431331598s) [upload=162376]: Uploading segments... Aug 15 05:18:32.472371542 (155h52m54.4314688s) [upload=162376]: Got next segment. Inline: false Aug 15 05:18:32.472627486 (155h52m54.431724731s) [upload=162376]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:18:32.472638400 (155h52m54.431735654s) [upload=162376]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 05:18:32.562300039 (155h52m54.521397294s) [upload=162376]: Next segment err: metaclient: Too Many Requests Aug 15 05:18:32.562323034 (155h52m54.521420287s) [upload=162376]: Done uploading segments... Aug 15 05:18:32.562356729 (155h52m54.521453976s) [upload=162376]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.776493231s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...X..........X........................X................X...] duration:
851.058309ms
FAIL (2025-08-15 05:35:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:33:15.368445275 (156h7m37.32754252s) [upload=162637]: Starting upload Aug 15 05:33:15.368510943 (156h7m37.327608194s) [upload=162637]: Done starting upload Aug 15 05:33:15.368596801 (156h7m37.327694053s) [upload=162637]: Uploading segments... Aug 15 05:33:15.368665437 (156h7m37.327762691s) [upload=162637]: Got next segment. Inline: true Aug 15 05:33:15.368671100 (156h7m37.327768345s) [upload=162637]: Waiting for error group managing segments... Aug 15 05:33:15.368753206 (156h7m37.327850462s) [upload=162637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:33:15.368760695 (156h7m37.327857951s) [upload=162637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 05:33:15.368764401 (156h7m37.327861647s) [upload=162637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 05:33:15.461113747 (156h7m37.420210994s) [upload=162637]: Done uploading segments... Aug 15 05:33:15.461132511 (156h7m37.420229756s) [upload=162637]: Upload finished. err: metaclient: Too Many Requests
Duration: 851.087019ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X..................X...........X........................] duration:
2.353319493s
FAIL (2025-08-15 05:35:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:18:32.471716944 (155h52m54.430814197s) [upload=162376]: Starting upload Aug 15 05:18:32.471867265 (155h52m54.430964519s) [upload=162376]: Done starting upload Aug 15 05:18:32.472234351 (155h52m54.431331598s) [upload=162376]: Uploading segments... Aug 15 05:18:32.472371542 (155h52m54.4314688s) [upload=162376]: Got next segment. Inline: false Aug 15 05:18:32.472627486 (155h52m54.431724731s) [upload=162376]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:18:32.472638400 (155h52m54.431735654s) [upload=162376]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 05:18:32.562300039 (155h52m54.521397294s) [upload=162376]: Next segment err: metaclient: Too Many Requests Aug 15 05:18:32.562323034 (155h52m54.521420287s) [upload=162376]: Done uploading segments... Aug 15 05:18:32.562356729 (155h52m54.521453976s) [upload=162376]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.353352956s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X..................X...........X.......................] duration:
2.457450104s
FAIL (2025-08-15 05:35:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:18:32.471716944 (155h52m54.430814197s) [upload=162376]: Starting upload Aug 15 05:18:32.471867265 (155h52m54.430964519s) [upload=162376]: Done starting upload Aug 15 05:18:32.472234351 (155h52m54.431331598s) [upload=162376]: Uploading segments... Aug 15 05:18:32.472371542 (155h52m54.4314688s) [upload=162376]: Got next segment. Inline: false Aug 15 05:18:32.472627486 (155h52m54.431724731s) [upload=162376]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:18:32.472638400 (155h52m54.431735654s) [upload=162376]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 05:18:32.562300039 (155h52m54.521397294s) [upload=162376]: Next segment err: metaclient: Too Many Requests Aug 15 05:18:32.562323034 (155h52m54.521420287s) [upload=162376]: Done uploading segments... Aug 15 05:18:32.562356729 (155h52m54.521453976s) [upload=162376]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.457483542s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....X..........X........................X................X..] duration:
1.038391933s
FAIL (2025-08-15 05:34:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:33:15.368445275 (156h7m37.32754252s) [upload=162637]: Starting upload Aug 15 05:33:15.368510943 (156h7m37.327608194s) [upload=162637]: Done starting upload Aug 15 05:33:15.368596801 (156h7m37.327694053s) [upload=162637]: Uploading segments... Aug 15 05:33:15.368665437 (156h7m37.327762691s) [upload=162637]: Got next segment. Inline: true Aug 15 05:33:15.368671100 (156h7m37.327768345s) [upload=162637]: Waiting for error group managing segments... Aug 15 05:33:15.368753206 (156h7m37.327850462s) [upload=162637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:33:15.368760695 (156h7m37.327857951s) [upload=162637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 05:33:15.368764401 (156h7m37.327861647s) [upload=162637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 05:33:15.461113747 (156h7m37.420210994s) [upload=162637]: Done uploading segments... Aug 15 05:33:15.461132511 (156h7m37.420229756s) [upload=162637]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.038488179s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X..................X...........X......................] duration:
2.433119043s
FAIL (2025-08-15 05:34:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:18:32.471716944 (155h52m54.430814197s) [upload=162376]: Starting upload Aug 15 05:18:32.471867265 (155h52m54.430964519s) [upload=162376]: Done starting upload Aug 15 05:18:32.472234351 (155h52m54.431331598s) [upload=162376]: Uploading segments... Aug 15 05:18:32.472371542 (155h52m54.4314688s) [upload=162376]: Got next segment. Inline: false Aug 15 05:18:32.472627486 (155h52m54.431724731s) [upload=162376]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:18:32.472638400 (155h52m54.431735654s) [upload=162376]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 05:18:32.562300039 (155h52m54.521397294s) [upload=162376]: Next segment err: metaclient: Too Many Requests Aug 15 05:18:32.562323034 (155h52m54.521420287s) [upload=162376]: Done uploading segments... Aug 15 05:18:32.562356729 (155h52m54.521453976s) [upload=162376]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.433165576s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....X..........X........................X................X.] duration:
869.234523ms
FAIL (2025-08-15 05:33:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:33:15.368445275 (156h7m37.32754252s) [upload=162637]: Starting upload Aug 15 05:33:15.368510943 (156h7m37.327608194s) [upload=162637]: Done starting upload Aug 15 05:33:15.368596801 (156h7m37.327694053s) [upload=162637]: Uploading segments... Aug 15 05:33:15.368665437 (156h7m37.327762691s) [upload=162637]: Got next segment. Inline: true Aug 15 05:33:15.368671100 (156h7m37.327768345s) [upload=162637]: Waiting for error group managing segments... Aug 15 05:33:15.368753206 (156h7m37.327850462s) [upload=162637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:33:15.368760695 (156h7m37.327857951s) [upload=162637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 05:33:15.368764401 (156h7m37.327861647s) [upload=162637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 05:33:15.461113747 (156h7m37.420210994s) [upload=162637]: Done uploading segments... Aug 15 05:33:15.461132511 (156h7m37.420229756s) [upload=162637]: Upload finished. err: metaclient: Too Many Requests
Duration: 869.267453ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X..................X...........X.....................] duration:
2.391888549s
FAIL (2025-08-15 05:33:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:18:32.471716944 (155h52m54.430814197s) [upload=162376]: Starting upload Aug 15 05:18:32.471867265 (155h52m54.430964519s) [upload=162376]: Done starting upload Aug 15 05:18:32.472234351 (155h52m54.431331598s) [upload=162376]: Uploading segments... Aug 15 05:18:32.472371542 (155h52m54.4314688s) [upload=162376]: Got next segment. Inline: false Aug 15 05:18:32.472627486 (155h52m54.431724731s) [upload=162376]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:18:32.472638400 (155h52m54.431735654s) [upload=162376]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 05:18:32.562300039 (155h52m54.521397294s) [upload=162376]: Next segment err: metaclient: Too Many Requests Aug 15 05:18:32.562323034 (155h52m54.521420287s) [upload=162376]: Done uploading segments... Aug 15 05:18:32.562356729 (155h52m54.521453976s) [upload=162376]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.391921605s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......X..........X........................X................X] duration:
363.769883ms
FAIL (2025-08-15 05:33:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:33:15.368445275 (156h7m37.32754252s) [upload=162637]: Starting upload Aug 15 05:33:15.368510943 (156h7m37.327608194s) [upload=162637]: Done starting upload Aug 15 05:33:15.368596801 (156h7m37.327694053s) [upload=162637]: Uploading segments... Aug 15 05:33:15.368665437 (156h7m37.327762691s) [upload=162637]: Got next segment. Inline: true Aug 15 05:33:15.368671100 (156h7m37.327768345s) [upload=162637]: Waiting for error group managing segments... Aug 15 05:33:15.368753206 (156h7m37.327850462s) [upload=162637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:33:15.368760695 (156h7m37.327857951s) [upload=162637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 05:33:15.368764401 (156h7m37.327861647s) [upload=162637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 05:33:15.461113747 (156h7m37.420210994s) [upload=162637]: Done uploading segments... Aug 15 05:33:15.461132511 (156h7m37.420229756s) [upload=162637]: Upload finished. err: metaclient: Too Many Requests
Duration: 363.811653ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X..........X........................X................] duration:
851.38807ms
FAIL (2025-08-15 05:32:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:19:33.817643626 (155h53m55.776740861s) [upload=162394]: Starting upload Aug 15 05:19:33.817705399 (155h53m55.776802644s) [upload=162394]: Done starting upload Aug 15 05:19:33.817806135 (155h53m55.776903372s) [upload=162394]: Uploading segments... Aug 15 05:19:33.817866095 (155h53m55.776963346s) [upload=162394]: Got next segment. Inline: true Aug 15 05:19:33.817871374 (155h53m55.776968609s) [upload=162394]: Waiting for error group managing segments... Aug 15 05:19:33.817949541 (155h53m55.777046786s) [upload=162394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:19:33.817955225 (155h53m55.777052471s) [upload=162394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 05:19:33.817959220 (155h53m55.777056465s) [upload=162394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 05:19:33.907513382 (155h53m55.866610647s) [upload=162394]: Done uploading segments... Aug 15 05:19:33.907531373 (155h53m55.866628642s) [upload=162394]: Upload finished. err: metaclient: Too Many Requests
Duration: 851.454178ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X..................X...........X....................] duration:
2.489266161s
FAIL (2025-08-15 05:32:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:18:32.471716944 (155h52m54.430814197s) [upload=162376]: Starting upload Aug 15 05:18:32.471867265 (155h52m54.430964519s) [upload=162376]: Done starting upload Aug 15 05:18:32.472234351 (155h52m54.431331598s) [upload=162376]: Uploading segments... Aug 15 05:18:32.472371542 (155h52m54.4314688s) [upload=162376]: Got next segment. Inline: false Aug 15 05:18:32.472627486 (155h52m54.431724731s) [upload=162376]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:18:32.472638400 (155h52m54.431735654s) [upload=162376]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 05:18:32.562300039 (155h52m54.521397294s) [upload=162376]: Next segment err: metaclient: Too Many Requests Aug 15 05:18:32.562323034 (155h52m54.521420287s) [upload=162376]: Done uploading segments... Aug 15 05:18:32.562356729 (155h52m54.521453976s) [upload=162376]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.489297736s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X..........X........................X...............] duration:
857.226992ms
FAIL (2025-08-15 05:32:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:19:33.817643626 (155h53m55.776740861s) [upload=162394]: Starting upload Aug 15 05:19:33.817705399 (155h53m55.776802644s) [upload=162394]: Done starting upload Aug 15 05:19:33.817806135 (155h53m55.776903372s) [upload=162394]: Uploading segments... Aug 15 05:19:33.817866095 (155h53m55.776963346s) [upload=162394]: Got next segment. Inline: true Aug 15 05:19:33.817871374 (155h53m55.776968609s) [upload=162394]: Waiting for error group managing segments... Aug 15 05:19:33.817949541 (155h53m55.777046786s) [upload=162394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:19:33.817955225 (155h53m55.777052471s) [upload=162394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 05:19:33.817959220 (155h53m55.777056465s) [upload=162394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 05:19:33.907513382 (155h53m55.866610647s) [upload=162394]: Done uploading segments... Aug 15 05:19:33.907531373 (155h53m55.866628642s) [upload=162394]: Upload finished. err: metaclient: Too Many Requests
Duration: 857.312229ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X..................X...........X...................] duration:
2.454283643s
FAIL (2025-08-15 05:31:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:18:32.471716944 (155h52m54.430814197s) [upload=162376]: Starting upload Aug 15 05:18:32.471867265 (155h52m54.430964519s) [upload=162376]: Done starting upload Aug 15 05:18:32.472234351 (155h52m54.431331598s) [upload=162376]: Uploading segments... Aug 15 05:18:32.472371542 (155h52m54.4314688s) [upload=162376]: Got next segment. Inline: false Aug 15 05:18:32.472627486 (155h52m54.431724731s) [upload=162376]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:18:32.472638400 (155h52m54.431735654s) [upload=162376]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 05:18:32.562300039 (155h52m54.521397294s) [upload=162376]: Next segment err: metaclient: Too Many Requests Aug 15 05:18:32.562323034 (155h52m54.521420287s) [upload=162376]: Done uploading segments... Aug 15 05:18:32.562356729 (155h52m54.521453976s) [upload=162376]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.454315769s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X..........X........................X..............] duration:
827.914194ms
FAIL (2025-08-15 05:31:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:19:33.817643626 (155h53m55.776740861s) [upload=162394]: Starting upload Aug 15 05:19:33.817705399 (155h53m55.776802644s) [upload=162394]: Done starting upload Aug 15 05:19:33.817806135 (155h53m55.776903372s) [upload=162394]: Uploading segments... Aug 15 05:19:33.817866095 (155h53m55.776963346s) [upload=162394]: Got next segment. Inline: true Aug 15 05:19:33.817871374 (155h53m55.776968609s) [upload=162394]: Waiting for error group managing segments... Aug 15 05:19:33.817949541 (155h53m55.777046786s) [upload=162394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:19:33.817955225 (155h53m55.777052471s) [upload=162394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 05:19:33.817959220 (155h53m55.777056465s) [upload=162394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 05:19:33.907513382 (155h53m55.866610647s) [upload=162394]: Done uploading segments... Aug 15 05:19:33.907531373 (155h53m55.866628642s) [upload=162394]: Upload finished. err: metaclient: Too Many Requests
Duration: 827.963851ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X..................X...........X..................] duration:
2.476549603s
FAIL (2025-08-15 05:30:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:18:32.471716944 (155h52m54.430814197s) [upload=162376]: Starting upload Aug 15 05:18:32.471867265 (155h52m54.430964519s) [upload=162376]: Done starting upload Aug 15 05:18:32.472234351 (155h52m54.431331598s) [upload=162376]: Uploading segments... Aug 15 05:18:32.472371542 (155h52m54.4314688s) [upload=162376]: Got next segment. Inline: false Aug 15 05:18:32.472627486 (155h52m54.431724731s) [upload=162376]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:18:32.472638400 (155h52m54.431735654s) [upload=162376]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 05:18:32.562300039 (155h52m54.521397294s) [upload=162376]: Next segment err: metaclient: Too Many Requests Aug 15 05:18:32.562323034 (155h52m54.521420287s) [upload=162376]: Done uploading segments... Aug 15 05:18:32.562356729 (155h52m54.521453976s) [upload=162376]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.476586188s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X..........X........................X.............] duration:
820.68199ms
FAIL (2025-08-15 05:30:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:19:33.817643626 (155h53m55.776740861s) [upload=162394]: Starting upload Aug 15 05:19:33.817705399 (155h53m55.776802644s) [upload=162394]: Done starting upload Aug 15 05:19:33.817806135 (155h53m55.776903372s) [upload=162394]: Uploading segments... Aug 15 05:19:33.817866095 (155h53m55.776963346s) [upload=162394]: Got next segment. Inline: true Aug 15 05:19:33.817871374 (155h53m55.776968609s) [upload=162394]: Waiting for error group managing segments... Aug 15 05:19:33.817949541 (155h53m55.777046786s) [upload=162394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:19:33.817955225 (155h53m55.777052471s) [upload=162394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 05:19:33.817959220 (155h53m55.777056465s) [upload=162394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 05:19:33.907513382 (155h53m55.866610647s) [upload=162394]: Done uploading segments... Aug 15 05:19:33.907531373 (155h53m55.866628642s) [upload=162394]: Upload finished. err: metaclient: Too Many Requests
Duration: 820.713427ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X..................X...........X.................] duration:
2.415083528s
FAIL (2025-08-15 05:30:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:18:32.471716944 (155h52m54.430814197s) [upload=162376]: Starting upload Aug 15 05:18:32.471867265 (155h52m54.430964519s) [upload=162376]: Done starting upload Aug 15 05:18:32.472234351 (155h52m54.431331598s) [upload=162376]: Uploading segments... Aug 15 05:18:32.472371542 (155h52m54.4314688s) [upload=162376]: Got next segment. Inline: false Aug 15 05:18:32.472627486 (155h52m54.431724731s) [upload=162376]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:18:32.472638400 (155h52m54.431735654s) [upload=162376]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 05:18:32.562300039 (155h52m54.521397294s) [upload=162376]: Next segment err: metaclient: Too Many Requests Aug 15 05:18:32.562323034 (155h52m54.521420287s) [upload=162376]: Done uploading segments... Aug 15 05:18:32.562356729 (155h52m54.521453976s) [upload=162376]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.415119718s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X..........X........................X............] duration:
811.967888ms
FAIL (2025-08-15 05:29:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:19:33.817643626 (155h53m55.776740861s) [upload=162394]: Starting upload Aug 15 05:19:33.817705399 (155h53m55.776802644s) [upload=162394]: Done starting upload Aug 15 05:19:33.817806135 (155h53m55.776903372s) [upload=162394]: Uploading segments... Aug 15 05:19:33.817866095 (155h53m55.776963346s) [upload=162394]: Got next segment. Inline: true Aug 15 05:19:33.817871374 (155h53m55.776968609s) [upload=162394]: Waiting for error group managing segments... Aug 15 05:19:33.817949541 (155h53m55.777046786s) [upload=162394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:19:33.817955225 (155h53m55.777052471s) [upload=162394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 05:19:33.817959220 (155h53m55.777056465s) [upload=162394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 05:19:33.907513382 (155h53m55.866610647s) [upload=162394]: Done uploading segments... Aug 15 05:19:33.907531373 (155h53m55.866628642s) [upload=162394]: Upload finished. err: metaclient: Too Many Requests
Duration: 812.005622ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X..................X...........X................] duration:
2.385790681s
FAIL (2025-08-15 05:29:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:18:32.471716944 (155h52m54.430814197s) [upload=162376]: Starting upload Aug 15 05:18:32.471867265 (155h52m54.430964519s) [upload=162376]: Done starting upload Aug 15 05:18:32.472234351 (155h52m54.431331598s) [upload=162376]: Uploading segments... Aug 15 05:18:32.472371542 (155h52m54.4314688s) [upload=162376]: Got next segment. Inline: false Aug 15 05:18:32.472627486 (155h52m54.431724731s) [upload=162376]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:18:32.472638400 (155h52m54.431735654s) [upload=162376]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 05:18:32.562300039 (155h52m54.521397294s) [upload=162376]: Next segment err: metaclient: Too Many Requests Aug 15 05:18:32.562323034 (155h52m54.521420287s) [upload=162376]: Done uploading segments... Aug 15 05:18:32.562356729 (155h52m54.521453976s) [upload=162376]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.385828767s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X..........X........................X...........] duration:
828.137148ms
FAIL (2025-08-15 05:29:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:19:33.817643626 (155h53m55.776740861s) [upload=162394]: Starting upload Aug 15 05:19:33.817705399 (155h53m55.776802644s) [upload=162394]: Done starting upload Aug 15 05:19:33.817806135 (155h53m55.776903372s) [upload=162394]: Uploading segments... Aug 15 05:19:33.817866095 (155h53m55.776963346s) [upload=162394]: Got next segment. Inline: true Aug 15 05:19:33.817871374 (155h53m55.776968609s) [upload=162394]: Waiting for error group managing segments... Aug 15 05:19:33.817949541 (155h53m55.777046786s) [upload=162394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:19:33.817955225 (155h53m55.777052471s) [upload=162394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 05:19:33.817959220 (155h53m55.777056465s) [upload=162394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 05:19:33.907513382 (155h53m55.866610647s) [upload=162394]: Done uploading segments... Aug 15 05:19:33.907531373 (155h53m55.866628642s) [upload=162394]: Upload finished. err: metaclient: Too Many Requests
Duration: 828.170428ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X..........X........................X..........] duration:
907.725982ms
FAIL (2025-08-15 05:28:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:19:33.817643626 (155h53m55.776740861s) [upload=162394]: Starting upload Aug 15 05:19:33.817705399 (155h53m55.776802644s) [upload=162394]: Done starting upload Aug 15 05:19:33.817806135 (155h53m55.776903372s) [upload=162394]: Uploading segments... Aug 15 05:19:33.817866095 (155h53m55.776963346s) [upload=162394]: Got next segment. Inline: true Aug 15 05:19:33.817871374 (155h53m55.776968609s) [upload=162394]: Waiting for error group managing segments... Aug 15 05:19:33.817949541 (155h53m55.777046786s) [upload=162394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:19:33.817955225 (155h53m55.777052471s) [upload=162394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 05:19:33.817959220 (155h53m55.777056465s) [upload=162394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 05:19:33.907513382 (155h53m55.866610647s) [upload=162394]: Done uploading segments... Aug 15 05:19:33.907531373 (155h53m55.866628642s) [upload=162394]: Upload finished. err: metaclient: Too Many Requests
Duration: 907.755281ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X..................X...........X...............] duration:
2.395612882s
FAIL (2025-08-15 05:28:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:18:32.471716944 (155h52m54.430814197s) [upload=162376]: Starting upload Aug 15 05:18:32.471867265 (155h52m54.430964519s) [upload=162376]: Done starting upload Aug 15 05:18:32.472234351 (155h52m54.431331598s) [upload=162376]: Uploading segments... Aug 15 05:18:32.472371542 (155h52m54.4314688s) [upload=162376]: Got next segment. Inline: false Aug 15 05:18:32.472627486 (155h52m54.431724731s) [upload=162376]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:18:32.472638400 (155h52m54.431735654s) [upload=162376]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 05:18:32.562300039 (155h52m54.521397294s) [upload=162376]: Next segment err: metaclient: Too Many Requests Aug 15 05:18:32.562323034 (155h52m54.521420287s) [upload=162376]: Done uploading segments... Aug 15 05:18:32.562356729 (155h52m54.521453976s) [upload=162376]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.395648151s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X..........X........................X.........] duration:
809.382394ms
FAIL (2025-08-15 05:27:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:19:33.817643626 (155h53m55.776740861s) [upload=162394]: Starting upload Aug 15 05:19:33.817705399 (155h53m55.776802644s) [upload=162394]: Done starting upload Aug 15 05:19:33.817806135 (155h53m55.776903372s) [upload=162394]: Uploading segments... Aug 15 05:19:33.817866095 (155h53m55.776963346s) [upload=162394]: Got next segment. Inline: true Aug 15 05:19:33.817871374 (155h53m55.776968609s) [upload=162394]: Waiting for error group managing segments... Aug 15 05:19:33.817949541 (155h53m55.777046786s) [upload=162394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 05:19:33.817955225 (155h53m55.777052471s) [upload=162394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 05:19:33.817959220 (155h53m55.777056465s) [upload=162394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 05:19:33.907513382 (155h53m55.866610647s) [upload=162394]: Done uploading segments... Aug 15 05:19:33.907531373 (155h53m55.866628642s) [upload=162394]: Upload finished. err: metaclient: Too Many Requests
Duration: 809.444257ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|