Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X........................X...........X........] duration:
1.060555312s
FAIL (2025-08-13 05:48:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after d4c51954a64fe3ef71f6bf0916535fdd675fafe11617beb1d511d97b701a55b3 != before c4267d41f7e7de77d1cf5d156960c5455ab78c83e55d8124a2c8fb52af027b97 ======LOGS====== Aug 13 05:41:43.537544619 (108h16m5.496641875s) [upload=112773]: Starting upload Aug 13 05:41:43.537616671 (108h16m5.496713923s) [upload=112773]: Done starting upload Aug 13 05:41:43.537692992 (108h16m5.496790241s) [upload=112773]: Uploading segments... Aug 13 05:41:43.537749395 (108h16m5.496846651s) [upload=112773]: Got next segment. Inline: true Aug 13 05:41:43.537755773 (108h16m5.49685303s) [upload=112773]: Waiting for error group managing segments... Aug 13 05:41:43.537806554 (108h16m5.496903809s) [upload=112773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 05:41:43.537813057 (108h16m5.496910312s) [upload=112773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 05:41:43.537819673 (108h16m5.496916928s) [upload=112773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 05:41:43.724636689 (108h16m5.683733935s) [upload=112773]: Done uploading segments... Aug 13 05:41:43.724658376 (108h16m5.683755615s) [upload=112773]: Upload finished. err: <nil>
Duration: 1.060603928s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.361831771s
FAIL (2025-08-13 05:47:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:59:27.894872480 (107h33m49.853969725s) [upload=112041]: Starting upload Aug 13 04:59:27.894929712 (107h33m49.854026959s) [upload=112041]: Done starting upload Aug 13 04:59:27.895220077 (107h33m49.854317309s) [upload=112041]: Uploading segments... Aug 13 04:59:27.895277369 (107h33m49.854374614s) [upload=112041]: Got next segment. Inline: false Aug 13 04:59:27.895306541 (107h33m49.854403786s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:59:27.895321172 (107h33m49.854418417s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 04:59:27.984877246 (107h33m49.943974494s) [upload=112041]: Next segment err: metaclient: Too Many Requests Aug 13 04:59:27.984898814 (107h33m49.943996049s) [upload=112041]: Done uploading segments... Aug 13 04:59:27.984924856 (107h33m49.944022105s) [upload=112041]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.361864961s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X........................X...........X.......] duration:
829.517326ms
FAIL (2025-08-13 05:47:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after d4c51954a64fe3ef71f6bf0916535fdd675fafe11617beb1d511d97b701a55b3 != before c4267d41f7e7de77d1cf5d156960c5455ab78c83e55d8124a2c8fb52af027b97 ======LOGS====== Aug 13 05:41:43.537544619 (108h16m5.496641875s) [upload=112773]: Starting upload Aug 13 05:41:43.537616671 (108h16m5.496713923s) [upload=112773]: Done starting upload Aug 13 05:41:43.537692992 (108h16m5.496790241s) [upload=112773]: Uploading segments... Aug 13 05:41:43.537749395 (108h16m5.496846651s) [upload=112773]: Got next segment. Inline: true Aug 13 05:41:43.537755773 (108h16m5.49685303s) [upload=112773]: Waiting for error group managing segments... Aug 13 05:41:43.537806554 (108h16m5.496903809s) [upload=112773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 05:41:43.537813057 (108h16m5.496910312s) [upload=112773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 05:41:43.537819673 (108h16m5.496916928s) [upload=112773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 05:41:43.724636689 (108h16m5.683733935s) [upload=112773]: Done uploading segments... Aug 13 05:41:43.724658376 (108h16m5.683755615s) [upload=112773]: Upload finished. err: <nil>
Duration: 829.554821ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................] duration:
2.463128473s
FAIL (2025-08-13 05:46:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:59:27.894872480 (107h33m49.853969725s) [upload=112041]: Starting upload Aug 13 04:59:27.894929712 (107h33m49.854026959s) [upload=112041]: Done starting upload Aug 13 04:59:27.895220077 (107h33m49.854317309s) [upload=112041]: Uploading segments... Aug 13 04:59:27.895277369 (107h33m49.854374614s) [upload=112041]: Got next segment. Inline: false Aug 13 04:59:27.895306541 (107h33m49.854403786s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:59:27.895321172 (107h33m49.854418417s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 04:59:27.984877246 (107h33m49.943974494s) [upload=112041]: Next segment err: metaclient: Too Many Requests Aug 13 04:59:27.984898814 (107h33m49.943996049s) [upload=112041]: Done uploading segments... Aug 13 04:59:27.984924856 (107h33m49.944022105s) [upload=112041]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.463160498s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X........................X...........X......] duration:
825.716118ms
FAIL (2025-08-13 05:46:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after d4c51954a64fe3ef71f6bf0916535fdd675fafe11617beb1d511d97b701a55b3 != before c4267d41f7e7de77d1cf5d156960c5455ab78c83e55d8124a2c8fb52af027b97 ======LOGS====== Aug 13 05:41:43.537544619 (108h16m5.496641875s) [upload=112773]: Starting upload Aug 13 05:41:43.537616671 (108h16m5.496713923s) [upload=112773]: Done starting upload Aug 13 05:41:43.537692992 (108h16m5.496790241s) [upload=112773]: Uploading segments... Aug 13 05:41:43.537749395 (108h16m5.496846651s) [upload=112773]: Got next segment. Inline: true Aug 13 05:41:43.537755773 (108h16m5.49685303s) [upload=112773]: Waiting for error group managing segments... Aug 13 05:41:43.537806554 (108h16m5.496903809s) [upload=112773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 05:41:43.537813057 (108h16m5.496910312s) [upload=112773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 05:41:43.537819673 (108h16m5.496916928s) [upload=112773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 05:41:43.724636689 (108h16m5.683733935s) [upload=112773]: Done uploading segments... Aug 13 05:41:43.724658376 (108h16m5.683755615s) [upload=112773]: Upload finished. err: <nil>
Duration: 825.746464ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X........................X...........X.....] duration:
935.758377ms
FAIL (2025-08-13 05:46:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after d4c51954a64fe3ef71f6bf0916535fdd675fafe11617beb1d511d97b701a55b3 != before c4267d41f7e7de77d1cf5d156960c5455ab78c83e55d8124a2c8fb52af027b97 ======LOGS====== Aug 13 05:41:43.537544619 (108h16m5.496641875s) [upload=112773]: Starting upload Aug 13 05:41:43.537616671 (108h16m5.496713923s) [upload=112773]: Done starting upload Aug 13 05:41:43.537692992 (108h16m5.496790241s) [upload=112773]: Uploading segments... Aug 13 05:41:43.537749395 (108h16m5.496846651s) [upload=112773]: Got next segment. Inline: true Aug 13 05:41:43.537755773 (108h16m5.49685303s) [upload=112773]: Waiting for error group managing segments... Aug 13 05:41:43.537806554 (108h16m5.496903809s) [upload=112773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 05:41:43.537813057 (108h16m5.496910312s) [upload=112773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 05:41:43.537819673 (108h16m5.496916928s) [upload=112773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 05:41:43.724636689 (108h16m5.683733935s) [upload=112773]: Done uploading segments... Aug 13 05:41:43.724658376 (108h16m5.683755615s) [upload=112773]: Upload finished. err: <nil>
Duration: 935.809784ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.XX.........................................................] duration:
2.409479768s
FAIL (2025-08-13 05:45:54 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:59:27.894872480 (107h33m49.853969725s) [upload=112041]: Starting upload Aug 13 04:59:27.894929712 (107h33m49.854026959s) [upload=112041]: Done starting upload Aug 13 04:59:27.895220077 (107h33m49.854317309s) [upload=112041]: Uploading segments... Aug 13 04:59:27.895277369 (107h33m49.854374614s) [upload=112041]: Got next segment. Inline: false Aug 13 04:59:27.895306541 (107h33m49.854403786s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:59:27.895321172 (107h33m49.854418417s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 04:59:27.984877246 (107h33m49.943974494s) [upload=112041]: Next segment err: metaclient: Too Many Requests Aug 13 04:59:27.984898814 (107h33m49.943996049s) [upload=112041]: Done uploading segments... Aug 13 04:59:27.984924856 (107h33m49.944022105s) [upload=112041]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.409509513s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................X........................X...........X....] duration:
1.000601026s
FAIL (2025-08-13 05:45:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after d4c51954a64fe3ef71f6bf0916535fdd675fafe11617beb1d511d97b701a55b3 != before c4267d41f7e7de77d1cf5d156960c5455ab78c83e55d8124a2c8fb52af027b97 ======LOGS====== Aug 13 05:41:43.537544619 (108h16m5.496641875s) [upload=112773]: Starting upload Aug 13 05:41:43.537616671 (108h16m5.496713923s) [upload=112773]: Done starting upload Aug 13 05:41:43.537692992 (108h16m5.496790241s) [upload=112773]: Uploading segments... Aug 13 05:41:43.537749395 (108h16m5.496846651s) [upload=112773]: Got next segment. Inline: true Aug 13 05:41:43.537755773 (108h16m5.49685303s) [upload=112773]: Waiting for error group managing segments... Aug 13 05:41:43.537806554 (108h16m5.496903809s) [upload=112773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 05:41:43.537813057 (108h16m5.496910312s) [upload=112773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 05:41:43.537819673 (108h16m5.496916928s) [upload=112773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 05:41:43.724636689 (108h16m5.683733935s) [upload=112773]: Done uploading segments... Aug 13 05:41:43.724658376 (108h16m5.683755615s) [upload=112773]: Upload finished. err: <nil>
Duration: 1.000639699s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X.XX........................................................] duration:
2.709718697s
FAIL (2025-08-13 05:45:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:59:27.894872480 (107h33m49.853969725s) [upload=112041]: Starting upload Aug 13 04:59:27.894929712 (107h33m49.854026959s) [upload=112041]: Done starting upload Aug 13 04:59:27.895220077 (107h33m49.854317309s) [upload=112041]: Uploading segments... Aug 13 04:59:27.895277369 (107h33m49.854374614s) [upload=112041]: Got next segment. Inline: false Aug 13 04:59:27.895306541 (107h33m49.854403786s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:59:27.895321172 (107h33m49.854418417s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 04:59:27.984877246 (107h33m49.943974494s) [upload=112041]: Next segment err: metaclient: Too Many Requests Aug 13 04:59:27.984898814 (107h33m49.943996049s) [upload=112041]: Done uploading segments... Aug 13 04:59:27.984924856 (107h33m49.944022105s) [upload=112041]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.709758731s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X.XX.......................................................] duration:
2.274831897s
FAIL (2025-08-13 05:44:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:59:27.894872480 (107h33m49.853969725s) [upload=112041]: Starting upload Aug 13 04:59:27.894929712 (107h33m49.854026959s) [upload=112041]: Done starting upload Aug 13 04:59:27.895220077 (107h33m49.854317309s) [upload=112041]: Uploading segments... Aug 13 04:59:27.895277369 (107h33m49.854374614s) [upload=112041]: Got next segment. Inline: false Aug 13 04:59:27.895306541 (107h33m49.854403786s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:59:27.895321172 (107h33m49.854418417s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 04:59:27.984877246 (107h33m49.943974494s) [upload=112041]: Next segment err: metaclient: Too Many Requests Aug 13 04:59:27.984898814 (107h33m49.943996049s) [upload=112041]: Done uploading segments... Aug 13 04:59:27.984924856 (107h33m49.944022105s) [upload=112041]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.274868276s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................X........................X...........X...] duration:
1.093498775s
FAIL (2025-08-13 05:44:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after d4c51954a64fe3ef71f6bf0916535fdd675fafe11617beb1d511d97b701a55b3 != before c4267d41f7e7de77d1cf5d156960c5455ab78c83e55d8124a2c8fb52af027b97 ======LOGS====== Aug 13 05:41:43.537544619 (108h16m5.496641875s) [upload=112773]: Starting upload Aug 13 05:41:43.537616671 (108h16m5.496713923s) [upload=112773]: Done starting upload Aug 13 05:41:43.537692992 (108h16m5.496790241s) [upload=112773]: Uploading segments... Aug 13 05:41:43.537749395 (108h16m5.496846651s) [upload=112773]: Got next segment. Inline: true Aug 13 05:41:43.537755773 (108h16m5.49685303s) [upload=112773]: Waiting for error group managing segments... Aug 13 05:41:43.537806554 (108h16m5.496903809s) [upload=112773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 05:41:43.537813057 (108h16m5.496910312s) [upload=112773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 05:41:43.537819673 (108h16m5.496916928s) [upload=112773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 05:41:43.724636689 (108h16m5.683733935s) [upload=112773]: Done uploading segments... Aug 13 05:41:43.724658376 (108h16m5.683755615s) [upload=112773]: Upload finished. err: <nil>
Duration: 1.093536628s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X.XX......................................................] duration:
2.382016755s
FAIL (2025-08-13 05:44:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:59:27.894872480 (107h33m49.853969725s) [upload=112041]: Starting upload Aug 13 04:59:27.894929712 (107h33m49.854026959s) [upload=112041]: Done starting upload Aug 13 04:59:27.895220077 (107h33m49.854317309s) [upload=112041]: Uploading segments... Aug 13 04:59:27.895277369 (107h33m49.854374614s) [upload=112041]: Got next segment. Inline: false Aug 13 04:59:27.895306541 (107h33m49.854403786s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:59:27.895321172 (107h33m49.854418417s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 04:59:27.984877246 (107h33m49.943974494s) [upload=112041]: Next segment err: metaclient: Too Many Requests Aug 13 04:59:27.984898814 (107h33m49.943996049s) [upload=112041]: Done uploading segments... Aug 13 04:59:27.984924856 (107h33m49.944022105s) [upload=112041]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.382051327s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................X........................X...........X..] duration:
836.488044ms
FAIL (2025-08-13 05:43:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after d4c51954a64fe3ef71f6bf0916535fdd675fafe11617beb1d511d97b701a55b3 != before c4267d41f7e7de77d1cf5d156960c5455ab78c83e55d8124a2c8fb52af027b97 ======LOGS====== Aug 13 05:41:43.537544619 (108h16m5.496641875s) [upload=112773]: Starting upload Aug 13 05:41:43.537616671 (108h16m5.496713923s) [upload=112773]: Done starting upload Aug 13 05:41:43.537692992 (108h16m5.496790241s) [upload=112773]: Uploading segments... Aug 13 05:41:43.537749395 (108h16m5.496846651s) [upload=112773]: Got next segment. Inline: true Aug 13 05:41:43.537755773 (108h16m5.49685303s) [upload=112773]: Waiting for error group managing segments... Aug 13 05:41:43.537806554 (108h16m5.496903809s) [upload=112773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 05:41:43.537813057 (108h16m5.496910312s) [upload=112773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 05:41:43.537819673 (108h16m5.496916928s) [upload=112773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 05:41:43.724636689 (108h16m5.683733935s) [upload=112773]: Done uploading segments... Aug 13 05:41:43.724658376 (108h16m5.683755615s) [upload=112773]: Upload finished. err: <nil>
Duration: 836.51552ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X.XX.....................................................] duration:
2.248766303s
FAIL (2025-08-13 05:42:49 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:59:27.894872480 (107h33m49.853969725s) [upload=112041]: Starting upload Aug 13 04:59:27.894929712 (107h33m49.854026959s) [upload=112041]: Done starting upload Aug 13 04:59:27.895220077 (107h33m49.854317309s) [upload=112041]: Uploading segments... Aug 13 04:59:27.895277369 (107h33m49.854374614s) [upload=112041]: Got next segment. Inline: false Aug 13 04:59:27.895306541 (107h33m49.854403786s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:59:27.895321172 (107h33m49.854418417s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 04:59:27.984877246 (107h33m49.943974494s) [upload=112041]: Next segment err: metaclient: Too Many Requests Aug 13 04:59:27.984898814 (107h33m49.943996049s) [upload=112041]: Done uploading segments... Aug 13 04:59:27.984924856 (107h33m49.944022105s) [upload=112041]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.248799026s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................X........................X...........X.] duration:
1.001094781s
FAIL (2025-08-13 05:42:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after d4c51954a64fe3ef71f6bf0916535fdd675fafe11617beb1d511d97b701a55b3 != before c4267d41f7e7de77d1cf5d156960c5455ab78c83e55d8124a2c8fb52af027b97 ======LOGS====== Aug 13 05:41:43.537544619 (108h16m5.496641875s) [upload=112773]: Starting upload Aug 13 05:41:43.537616671 (108h16m5.496713923s) [upload=112773]: Done starting upload Aug 13 05:41:43.537692992 (108h16m5.496790241s) [upload=112773]: Uploading segments... Aug 13 05:41:43.537749395 (108h16m5.496846651s) [upload=112773]: Got next segment. Inline: true Aug 13 05:41:43.537755773 (108h16m5.49685303s) [upload=112773]: Waiting for error group managing segments... Aug 13 05:41:43.537806554 (108h16m5.496903809s) [upload=112773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 05:41:43.537813057 (108h16m5.496910312s) [upload=112773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 05:41:43.537819673 (108h16m5.496916928s) [upload=112773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 05:41:43.724636689 (108h16m5.683733935s) [upload=112773]: Done uploading segments... Aug 13 05:41:43.724658376 (108h16m5.683755615s) [upload=112773]: Upload finished. err: <nil>
Duration: 1.001122643s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X.XX....................................................] duration:
2.460867887s
FAIL (2025-08-13 05:41:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:59:27.894872480 (107h33m49.853969725s) [upload=112041]: Starting upload Aug 13 04:59:27.894929712 (107h33m49.854026959s) [upload=112041]: Done starting upload Aug 13 04:59:27.895220077 (107h33m49.854317309s) [upload=112041]: Uploading segments... Aug 13 04:59:27.895277369 (107h33m49.854374614s) [upload=112041]: Got next segment. Inline: false Aug 13 04:59:27.895306541 (107h33m49.854403786s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:59:27.895321172 (107h33m49.854418417s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 04:59:27.984877246 (107h33m49.943974494s) [upload=112041]: Next segment err: metaclient: Too Many Requests Aug 13 04:59:27.984898814 (107h33m49.943996049s) [upload=112041]: Done uploading segments... Aug 13 04:59:27.984924856 (107h33m49.944022105s) [upload=112041]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.46090175s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......................X........................X...........X] duration:
772.921435ms
FAIL (2025-08-13 05:41:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after d4c51954a64fe3ef71f6bf0916535fdd675fafe11617beb1d511d97b701a55b3 != before c4267d41f7e7de77d1cf5d156960c5455ab78c83e55d8124a2c8fb52af027b97 ======LOGS====== Aug 13 05:41:43.537544619 (108h16m5.496641875s) [upload=112773]: Starting upload Aug 13 05:41:43.537616671 (108h16m5.496713923s) [upload=112773]: Done starting upload Aug 13 05:41:43.537692992 (108h16m5.496790241s) [upload=112773]: Uploading segments... Aug 13 05:41:43.537749395 (108h16m5.496846651s) [upload=112773]: Got next segment. Inline: true Aug 13 05:41:43.537755773 (108h16m5.49685303s) [upload=112773]: Waiting for error group managing segments... Aug 13 05:41:43.537806554 (108h16m5.496903809s) [upload=112773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 05:41:43.537813057 (108h16m5.496910312s) [upload=112773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 05:41:43.537819673 (108h16m5.496916928s) [upload=112773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 05:41:43.724636689 (108h16m5.683733935s) [upload=112773]: Done uploading segments... Aug 13 05:41:43.724658376 (108h16m5.683755615s) [upload=112773]: Upload finished. err: <nil>
Duration: 772.960435ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X.XX...................................................] duration:
2.319254653s
FAIL (2025-08-13 05:41:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:59:27.894872480 (107h33m49.853969725s) [upload=112041]: Starting upload Aug 13 04:59:27.894929712 (107h33m49.854026959s) [upload=112041]: Done starting upload Aug 13 04:59:27.895220077 (107h33m49.854317309s) [upload=112041]: Uploading segments... Aug 13 04:59:27.895277369 (107h33m49.854374614s) [upload=112041]: Got next segment. Inline: false Aug 13 04:59:27.895306541 (107h33m49.854403786s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:59:27.895321172 (107h33m49.854418417s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 04:59:27.984877246 (107h33m49.943974494s) [upload=112041]: Next segment err: metaclient: Too Many Requests Aug 13 04:59:27.984898814 (107h33m49.943996049s) [upload=112041]: Done uploading segments... Aug 13 04:59:27.984924856 (107h33m49.944022105s) [upload=112041]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.319284806s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X........................X...........] duration:
1.071818189s
FAIL (2025-08-13 05:40:51 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 05:31:49.844136153 (108h6m11.803233391s) [upload=112598]: Starting upload
Aug 13 05:31:49.844184365 (108h6m11.803281618s) [upload=112598]: Done starting upload
Aug 13 05:31:49.844266193 (108h6m11.803363428s) [upload=112598]: Uploading segments...
Aug 13 05:31:49.844383152 (108h6m11.803480388s) [upload=112598]: Got next segment. Inline: true
Aug 13 05:31:49.844389350 (108h6m11.803486594s) [upload=112598]: Waiting for error group managing segments...
Aug 13 05:31:49.844435771 (108h6m11.803533006s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 05:31:49.844440504 (108h6m11.803537749s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 05:31:49.844443953 (108h6m11.803541198s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 05:31:49.994015795 (108h6m11.953113046s) [upload=112598]: Done uploading segments...
Aug 13 05:31:49.994056215 (108h6m11.953153471s) [upload=112598]: Upload finished. err: <nil>
Duration: 1.071842685s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X.XX..................................................] duration:
2.546948012s
FAIL (2025-08-13 05:40:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:59:27.894872480 (107h33m49.853969725s) [upload=112041]: Starting upload Aug 13 04:59:27.894929712 (107h33m49.854026959s) [upload=112041]: Done starting upload Aug 13 04:59:27.895220077 (107h33m49.854317309s) [upload=112041]: Uploading segments... Aug 13 04:59:27.895277369 (107h33m49.854374614s) [upload=112041]: Got next segment. Inline: false Aug 13 04:59:27.895306541 (107h33m49.854403786s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:59:27.895321172 (107h33m49.854418417s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 04:59:27.984877246 (107h33m49.943974494s) [upload=112041]: Next segment err: metaclient: Too Many Requests Aug 13 04:59:27.984898814 (107h33m49.943996049s) [upload=112041]: Done uploading segments... Aug 13 04:59:27.984924856 (107h33m49.944022105s) [upload=112041]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.546976772s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X........................X..........] duration:
810.058126ms
FAIL (2025-08-13 05:39:44 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 05:31:49.844136153 (108h6m11.803233391s) [upload=112598]: Starting upload
Aug 13 05:31:49.844184365 (108h6m11.803281618s) [upload=112598]: Done starting upload
Aug 13 05:31:49.844266193 (108h6m11.803363428s) [upload=112598]: Uploading segments...
Aug 13 05:31:49.844383152 (108h6m11.803480388s) [upload=112598]: Got next segment. Inline: true
Aug 13 05:31:49.844389350 (108h6m11.803486594s) [upload=112598]: Waiting for error group managing segments...
Aug 13 05:31:49.844435771 (108h6m11.803533006s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 05:31:49.844440504 (108h6m11.803537749s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 05:31:49.844443953 (108h6m11.803541198s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 05:31:49.994015795 (108h6m11.953113046s) [upload=112598]: Done uploading segments...
Aug 13 05:31:49.994056215 (108h6m11.953153471s) [upload=112598]: Upload finished. err: <nil>
Duration: 810.075698ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X.XX.................................................] duration:
2.399552925s
FAIL (2025-08-13 05:39:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:59:27.894872480 (107h33m49.853969725s) [upload=112041]: Starting upload Aug 13 04:59:27.894929712 (107h33m49.854026959s) [upload=112041]: Done starting upload Aug 13 04:59:27.895220077 (107h33m49.854317309s) [upload=112041]: Uploading segments... Aug 13 04:59:27.895277369 (107h33m49.854374614s) [upload=112041]: Got next segment. Inline: false Aug 13 04:59:27.895306541 (107h33m49.854403786s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:59:27.895321172 (107h33m49.854418417s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 04:59:27.984877246 (107h33m49.943974494s) [upload=112041]: Next segment err: metaclient: Too Many Requests Aug 13 04:59:27.984898814 (107h33m49.943996049s) [upload=112041]: Done uploading segments... Aug 13 04:59:27.984924856 (107h33m49.944022105s) [upload=112041]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.399618746s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X........................X.........] duration:
812.058397ms
FAIL (2025-08-13 05:39:14 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 05:31:49.844136153 (108h6m11.803233391s) [upload=112598]: Starting upload
Aug 13 05:31:49.844184365 (108h6m11.803281618s) [upload=112598]: Done starting upload
Aug 13 05:31:49.844266193 (108h6m11.803363428s) [upload=112598]: Uploading segments...
Aug 13 05:31:49.844383152 (108h6m11.803480388s) [upload=112598]: Got next segment. Inline: true
Aug 13 05:31:49.844389350 (108h6m11.803486594s) [upload=112598]: Waiting for error group managing segments...
Aug 13 05:31:49.844435771 (108h6m11.803533006s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 05:31:49.844440504 (108h6m11.803537749s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 05:31:49.844443953 (108h6m11.803541198s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 05:31:49.994015795 (108h6m11.953113046s) [upload=112598]: Done uploading segments...
Aug 13 05:31:49.994056215 (108h6m11.953153471s) [upload=112598]: Upload finished. err: <nil>
Duration: 812.089746ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................X........................X........] duration:
1.039203511s
FAIL (2025-08-13 05:38:57 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 05:31:49.844136153 (108h6m11.803233391s) [upload=112598]: Starting upload
Aug 13 05:31:49.844184365 (108h6m11.803281618s) [upload=112598]: Done starting upload
Aug 13 05:31:49.844266193 (108h6m11.803363428s) [upload=112598]: Uploading segments...
Aug 13 05:31:49.844383152 (108h6m11.803480388s) [upload=112598]: Got next segment. Inline: true
Aug 13 05:31:49.844389350 (108h6m11.803486594s) [upload=112598]: Waiting for error group managing segments...
Aug 13 05:31:49.844435771 (108h6m11.803533006s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 05:31:49.844440504 (108h6m11.803537749s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 05:31:49.844443953 (108h6m11.803541198s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 05:31:49.994015795 (108h6m11.953113046s) [upload=112598]: Done uploading segments...
Aug 13 05:31:49.994056215 (108h6m11.953153471s) [upload=112598]: Upload finished. err: <nil>
Duration: 1.039233928s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X.XX................................................] duration:
2.342429969s
FAIL (2025-08-13 05:38:49 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:59:27.894872480 (107h33m49.853969725s) [upload=112041]: Starting upload Aug 13 04:59:27.894929712 (107h33m49.854026959s) [upload=112041]: Done starting upload Aug 13 04:59:27.895220077 (107h33m49.854317309s) [upload=112041]: Uploading segments... Aug 13 04:59:27.895277369 (107h33m49.854374614s) [upload=112041]: Got next segment. Inline: false Aug 13 04:59:27.895306541 (107h33m49.854403786s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:59:27.895321172 (107h33m49.854418417s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 04:59:27.984877246 (107h33m49.943974494s) [upload=112041]: Next segment err: metaclient: Too Many Requests Aug 13 04:59:27.984898814 (107h33m49.943996049s) [upload=112041]: Done uploading segments... Aug 13 04:59:27.984924856 (107h33m49.944022105s) [upload=112041]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.342486654s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X.XX...............................................] duration:
2.382857693s
FAIL (2025-08-13 05:37:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:59:27.894872480 (107h33m49.853969725s) [upload=112041]: Starting upload Aug 13 04:59:27.894929712 (107h33m49.854026959s) [upload=112041]: Done starting upload Aug 13 04:59:27.895220077 (107h33m49.854317309s) [upload=112041]: Uploading segments... Aug 13 04:59:27.895277369 (107h33m49.854374614s) [upload=112041]: Got next segment. Inline: false Aug 13 04:59:27.895306541 (107h33m49.854403786s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:59:27.895321172 (107h33m49.854418417s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 04:59:27.984877246 (107h33m49.943974494s) [upload=112041]: Next segment err: metaclient: Too Many Requests Aug 13 04:59:27.984898814 (107h33m49.943996049s) [upload=112041]: Done uploading segments... Aug 13 04:59:27.984924856 (107h33m49.944022105s) [upload=112041]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.382893732s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................X........................X.......] duration:
887.229555ms
FAIL (2025-08-13 05:37:52 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 05:31:49.844136153 (108h6m11.803233391s) [upload=112598]: Starting upload
Aug 13 05:31:49.844184365 (108h6m11.803281618s) [upload=112598]: Done starting upload
Aug 13 05:31:49.844266193 (108h6m11.803363428s) [upload=112598]: Uploading segments...
Aug 13 05:31:49.844383152 (108h6m11.803480388s) [upload=112598]: Got next segment. Inline: true
Aug 13 05:31:49.844389350 (108h6m11.803486594s) [upload=112598]: Waiting for error group managing segments...
Aug 13 05:31:49.844435771 (108h6m11.803533006s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 05:31:49.844440504 (108h6m11.803537749s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 05:31:49.844443953 (108h6m11.803541198s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 05:31:49.994015795 (108h6m11.953113046s) [upload=112598]: Done uploading segments...
Aug 13 05:31:49.994056215 (108h6m11.953153471s) [upload=112598]: Upload finished. err: <nil>
Duration: 887.268933ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X.XX..............................................] duration:
2.539122986s
FAIL (2025-08-13 05:37:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:59:27.894872480 (107h33m49.853969725s) [upload=112041]: Starting upload Aug 13 04:59:27.894929712 (107h33m49.854026959s) [upload=112041]: Done starting upload Aug 13 04:59:27.895220077 (107h33m49.854317309s) [upload=112041]: Uploading segments... Aug 13 04:59:27.895277369 (107h33m49.854374614s) [upload=112041]: Got next segment. Inline: false Aug 13 04:59:27.895306541 (107h33m49.854403786s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:59:27.895321172 (107h33m49.854418417s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 04:59:27.984877246 (107h33m49.943974494s) [upload=112041]: Next segment err: metaclient: Too Many Requests Aug 13 04:59:27.984898814 (107h33m49.943996049s) [upload=112041]: Done uploading segments... Aug 13 04:59:27.984924856 (107h33m49.944022105s) [upload=112041]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.53915788s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................X........................X......] duration:
825.920316ms
FAIL (2025-08-13 05:37:14 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 05:31:49.844136153 (108h6m11.803233391s) [upload=112598]: Starting upload
Aug 13 05:31:49.844184365 (108h6m11.803281618s) [upload=112598]: Done starting upload
Aug 13 05:31:49.844266193 (108h6m11.803363428s) [upload=112598]: Uploading segments...
Aug 13 05:31:49.844383152 (108h6m11.803480388s) [upload=112598]: Got next segment. Inline: true
Aug 13 05:31:49.844389350 (108h6m11.803486594s) [upload=112598]: Waiting for error group managing segments...
Aug 13 05:31:49.844435771 (108h6m11.803533006s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 05:31:49.844440504 (108h6m11.803537749s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 05:31:49.844443953 (108h6m11.803541198s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 05:31:49.994015795 (108h6m11.953113046s) [upload=112598]: Done uploading segments...
Aug 13 05:31:49.994056215 (108h6m11.953153471s) [upload=112598]: Upload finished. err: <nil>
Duration: 825.950082ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X.XX.............................................] duration:
2.310283313s
FAIL (2025-08-13 05:36:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:59:27.894872480 (107h33m49.853969725s) [upload=112041]: Starting upload Aug 13 04:59:27.894929712 (107h33m49.854026959s) [upload=112041]: Done starting upload Aug 13 04:59:27.895220077 (107h33m49.854317309s) [upload=112041]: Uploading segments... Aug 13 04:59:27.895277369 (107h33m49.854374614s) [upload=112041]: Got next segment. Inline: false Aug 13 04:59:27.895306541 (107h33m49.854403786s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:59:27.895321172 (107h33m49.854418417s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 04:59:27.984877246 (107h33m49.943974494s) [upload=112041]: Next segment err: metaclient: Too Many Requests Aug 13 04:59:27.984898814 (107h33m49.943996049s) [upload=112041]: Done uploading segments... Aug 13 04:59:27.984924856 (107h33m49.944022105s) [upload=112041]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.310334256s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................X........................X.....] duration:
822.667108ms
FAIL (2025-08-13 05:36:10 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 05:31:49.844136153 (108h6m11.803233391s) [upload=112598]: Starting upload
Aug 13 05:31:49.844184365 (108h6m11.803281618s) [upload=112598]: Done starting upload
Aug 13 05:31:49.844266193 (108h6m11.803363428s) [upload=112598]: Uploading segments...
Aug 13 05:31:49.844383152 (108h6m11.803480388s) [upload=112598]: Got next segment. Inline: true
Aug 13 05:31:49.844389350 (108h6m11.803486594s) [upload=112598]: Waiting for error group managing segments...
Aug 13 05:31:49.844435771 (108h6m11.803533006s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 05:31:49.844440504 (108h6m11.803537749s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 05:31:49.844443953 (108h6m11.803541198s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 05:31:49.994015795 (108h6m11.953113046s) [upload=112598]: Done uploading segments...
Aug 13 05:31:49.994056215 (108h6m11.953153471s) [upload=112598]: Upload finished. err: <nil>
Duration: 822.766627ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X.XX............................................] duration:
3.289993511s
FAIL (2025-08-13 05:36:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:59:27.894872480 (107h33m49.853969725s) [upload=112041]: Starting upload Aug 13 04:59:27.894929712 (107h33m49.854026959s) [upload=112041]: Done starting upload Aug 13 04:59:27.895220077 (107h33m49.854317309s) [upload=112041]: Uploading segments... Aug 13 04:59:27.895277369 (107h33m49.854374614s) [upload=112041]: Got next segment. Inline: false Aug 13 04:59:27.895306541 (107h33m49.854403786s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:59:27.895321172 (107h33m49.854418417s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 04:59:27.984877246 (107h33m49.943974494s) [upload=112041]: Next segment err: metaclient: Too Many Requests Aug 13 04:59:27.984898814 (107h33m49.943996049s) [upload=112041]: Done uploading segments... Aug 13 04:59:27.984924856 (107h33m49.944022105s) [upload=112041]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.290092152s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X.XX...........................................] duration:
2.374302086s
FAIL (2025-08-13 05:35:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:59:27.894872480 (107h33m49.853969725s) [upload=112041]: Starting upload Aug 13 04:59:27.894929712 (107h33m49.854026959s) [upload=112041]: Done starting upload Aug 13 04:59:27.895220077 (107h33m49.854317309s) [upload=112041]: Uploading segments... Aug 13 04:59:27.895277369 (107h33m49.854374614s) [upload=112041]: Got next segment. Inline: false Aug 13 04:59:27.895306541 (107h33m49.854403786s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:59:27.895321172 (107h33m49.854418417s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 04:59:27.984877246 (107h33m49.943974494s) [upload=112041]: Next segment err: metaclient: Too Many Requests Aug 13 04:59:27.984898814 (107h33m49.943996049s) [upload=112041]: Done uploading segments... Aug 13 04:59:27.984924856 (107h33m49.944022105s) [upload=112041]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.374346628s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................X........................X....] duration:
870.868322ms
FAIL (2025-08-13 05:35:02 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 05:31:49.844136153 (108h6m11.803233391s) [upload=112598]: Starting upload
Aug 13 05:31:49.844184365 (108h6m11.803281618s) [upload=112598]: Done starting upload
Aug 13 05:31:49.844266193 (108h6m11.803363428s) [upload=112598]: Uploading segments...
Aug 13 05:31:49.844383152 (108h6m11.803480388s) [upload=112598]: Got next segment. Inline: true
Aug 13 05:31:49.844389350 (108h6m11.803486594s) [upload=112598]: Waiting for error group managing segments...
Aug 13 05:31:49.844435771 (108h6m11.803533006s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 05:31:49.844440504 (108h6m11.803537749s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 05:31:49.844443953 (108h6m11.803541198s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 05:31:49.994015795 (108h6m11.953113046s) [upload=112598]: Done uploading segments...
Aug 13 05:31:49.994056215 (108h6m11.953153471s) [upload=112598]: Upload finished. err: <nil>
Duration: 870.985206ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X.XX..........................................] duration:
2.374890092s
FAIL (2025-08-13 05:34:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:59:27.894872480 (107h33m49.853969725s) [upload=112041]: Starting upload Aug 13 04:59:27.894929712 (107h33m49.854026959s) [upload=112041]: Done starting upload Aug 13 04:59:27.895220077 (107h33m49.854317309s) [upload=112041]: Uploading segments... Aug 13 04:59:27.895277369 (107h33m49.854374614s) [upload=112041]: Got next segment. Inline: false Aug 13 04:59:27.895306541 (107h33m49.854403786s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:59:27.895321172 (107h33m49.854418417s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 04:59:27.984877246 (107h33m49.943974494s) [upload=112041]: Next segment err: metaclient: Too Many Requests Aug 13 04:59:27.984898814 (107h33m49.943996049s) [upload=112041]: Done uploading segments... Aug 13 04:59:27.984924856 (107h33m49.944022105s) [upload=112041]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.374922447s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................X........................X...] duration:
829.143107ms
FAIL (2025-08-13 05:34:34 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 05:31:49.844136153 (108h6m11.803233391s) [upload=112598]: Starting upload
Aug 13 05:31:49.844184365 (108h6m11.803281618s) [upload=112598]: Done starting upload
Aug 13 05:31:49.844266193 (108h6m11.803363428s) [upload=112598]: Uploading segments...
Aug 13 05:31:49.844383152 (108h6m11.803480388s) [upload=112598]: Got next segment. Inline: true
Aug 13 05:31:49.844389350 (108h6m11.803486594s) [upload=112598]: Waiting for error group managing segments...
Aug 13 05:31:49.844435771 (108h6m11.803533006s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 05:31:49.844440504 (108h6m11.803537749s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 05:31:49.844443953 (108h6m11.803541198s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 05:31:49.994015795 (108h6m11.953113046s) [upload=112598]: Done uploading segments...
Aug 13 05:31:49.994056215 (108h6m11.953153471s) [upload=112598]: Upload finished. err: <nil>
Duration: 829.176747ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................X........................X..] duration:
1.033813627s
FAIL (2025-08-13 05:34:17 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 05:31:49.844136153 (108h6m11.803233391s) [upload=112598]: Starting upload
Aug 13 05:31:49.844184365 (108h6m11.803281618s) [upload=112598]: Done starting upload
Aug 13 05:31:49.844266193 (108h6m11.803363428s) [upload=112598]: Uploading segments...
Aug 13 05:31:49.844383152 (108h6m11.803480388s) [upload=112598]: Got next segment. Inline: true
Aug 13 05:31:49.844389350 (108h6m11.803486594s) [upload=112598]: Waiting for error group managing segments...
Aug 13 05:31:49.844435771 (108h6m11.803533006s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 05:31:49.844440504 (108h6m11.803537749s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 05:31:49.844443953 (108h6m11.803541198s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 05:31:49.994015795 (108h6m11.953113046s) [upload=112598]: Done uploading segments...
Aug 13 05:31:49.994056215 (108h6m11.953153471s) [upload=112598]: Upload finished. err: <nil>
Duration: 1.033848735s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X.XX.........................................] duration:
2.408702415s
FAIL (2025-08-13 05:34:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:59:27.894872480 (107h33m49.853969725s) [upload=112041]: Starting upload Aug 13 04:59:27.894929712 (107h33m49.854026959s) [upload=112041]: Done starting upload Aug 13 04:59:27.895220077 (107h33m49.854317309s) [upload=112041]: Uploading segments... Aug 13 04:59:27.895277369 (107h33m49.854374614s) [upload=112041]: Got next segment. Inline: false Aug 13 04:59:27.895306541 (107h33m49.854403786s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:59:27.895321172 (107h33m49.854418417s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 04:59:27.984877246 (107h33m49.943974494s) [upload=112041]: Next segment err: metaclient: Too Many Requests Aug 13 04:59:27.984898814 (107h33m49.943996049s) [upload=112041]: Done uploading segments... Aug 13 04:59:27.984924856 (107h33m49.944022105s) [upload=112041]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.408761266s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................X.XX........................................] duration:
2.31193958s
FAIL (2025-08-13 05:33:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:59:27.894872480 (107h33m49.853969725s) [upload=112041]: Starting upload Aug 13 04:59:27.894929712 (107h33m49.854026959s) [upload=112041]: Done starting upload Aug 13 04:59:27.895220077 (107h33m49.854317309s) [upload=112041]: Uploading segments... Aug 13 04:59:27.895277369 (107h33m49.854374614s) [upload=112041]: Got next segment. Inline: false Aug 13 04:59:27.895306541 (107h33m49.854403786s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:59:27.895321172 (107h33m49.854418417s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 04:59:27.984877246 (107h33m49.943974494s) [upload=112041]: Next segment err: metaclient: Too Many Requests Aug 13 04:59:27.984898814 (107h33m49.943996049s) [upload=112041]: Done uploading segments... Aug 13 04:59:27.984924856 (107h33m49.944022105s) [upload=112041]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.311996808s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................X........................X.] duration:
1.108585305s
FAIL (2025-08-13 05:33:02 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 05:31:49.844136153 (108h6m11.803233391s) [upload=112598]: Starting upload
Aug 13 05:31:49.844184365 (108h6m11.803281618s) [upload=112598]: Done starting upload
Aug 13 05:31:49.844266193 (108h6m11.803363428s) [upload=112598]: Uploading segments...
Aug 13 05:31:49.844383152 (108h6m11.803480388s) [upload=112598]: Got next segment. Inline: true
Aug 13 05:31:49.844389350 (108h6m11.803486594s) [upload=112598]: Waiting for error group managing segments...
Aug 13 05:31:49.844435771 (108h6m11.803533006s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 05:31:49.844440504 (108h6m11.803537749s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 05:31:49.844443953 (108h6m11.803541198s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 05:31:49.994015795 (108h6m11.953113046s) [upload=112598]: Done uploading segments...
Aug 13 05:31:49.994056215 (108h6m11.953153471s) [upload=112598]: Upload finished. err: <nil>
Duration: 1.108626425s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X.XX.......................................] duration:
2.371518036s
FAIL (2025-08-13 05:32:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:59:27.894872480 (107h33m49.853969725s) [upload=112041]: Starting upload Aug 13 04:59:27.894929712 (107h33m49.854026959s) [upload=112041]: Done starting upload Aug 13 04:59:27.895220077 (107h33m49.854317309s) [upload=112041]: Uploading segments... Aug 13 04:59:27.895277369 (107h33m49.854374614s) [upload=112041]: Got next segment. Inline: false Aug 13 04:59:27.895306541 (107h33m49.854403786s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:59:27.895321172 (107h33m49.854418417s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 04:59:27.984877246 (107h33m49.943974494s) [upload=112041]: Next segment err: metaclient: Too Many Requests Aug 13 04:59:27.984898814 (107h33m49.943996049s) [upload=112041]: Done uploading segments... Aug 13 04:59:27.984924856 (107h33m49.944022105s) [upload=112041]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.371548336s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................X........................X] duration:
718.676888ms
FAIL (2025-08-13 05:31:50 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 05:31:49.844136153 (108h6m11.803233391s) [upload=112598]: Starting upload
Aug 13 05:31:49.844184365 (108h6m11.803281618s) [upload=112598]: Done starting upload
Aug 13 05:31:49.844266193 (108h6m11.803363428s) [upload=112598]: Uploading segments...
Aug 13 05:31:49.844383152 (108h6m11.803480388s) [upload=112598]: Got next segment. Inline: true
Aug 13 05:31:49.844389350 (108h6m11.803486594s) [upload=112598]: Waiting for error group managing segments...
Aug 13 05:31:49.844435771 (108h6m11.803533006s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 05:31:49.844440504 (108h6m11.803537749s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 05:31:49.844443953 (108h6m11.803541198s) [upload=112598]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 05:31:49.994015795 (108h6m11.953113046s) [upload=112598]: Done uploading segments...
Aug 13 05:31:49.994056215 (108h6m11.953153471s) [upload=112598]: Upload finished. err: <nil>
Duration: 718.707412ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X.................X.XX......................................] duration:
2.669166992s
FAIL (2025-08-13 05:31:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:59:27.894872480 (107h33m49.853969725s) [upload=112041]: Starting upload Aug 13 04:59:27.894929712 (107h33m49.854026959s) [upload=112041]: Done starting upload Aug 13 04:59:27.895220077 (107h33m49.854317309s) [upload=112041]: Uploading segments... Aug 13 04:59:27.895277369 (107h33m49.854374614s) [upload=112041]: Got next segment. Inline: false Aug 13 04:59:27.895306541 (107h33m49.854403786s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:59:27.895321172 (107h33m49.854418417s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 04:59:27.984877246 (107h33m49.943974494s) [upload=112041]: Next segment err: metaclient: Too Many Requests Aug 13 04:59:27.984898814 (107h33m49.943996049s) [upload=112041]: Done uploading segments... Aug 13 04:59:27.984924856 (107h33m49.944022105s) [upload=112041]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.669210299s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
835.514028ms
FAIL (2025-08-13 05:31:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 6beb31f77f54b79c40b38721707898bbf925f20cf0200ad4129fb472e8c51f58 != before 2bcf113319d03ac919f6e4e8f100a51ae990c111cbe53d21476b366d5ef1f851 ======LOGS====== Aug 13 05:13:09.044916248 (107h47m31.004013493s) [upload=112273]: Starting upload Aug 13 05:13:09.044980223 (107h47m31.004077471s) [upload=112273]: Done starting upload Aug 13 05:13:09.045064060 (107h47m31.004161298s) [upload=112273]: Uploading segments... Aug 13 05:13:09.045104608 (107h47m31.004201861s) [upload=112273]: Got next segment. Inline: true Aug 13 05:13:09.045121199 (107h47m31.004218445s) [upload=112273]: Waiting for error group managing segments... Aug 13 05:13:09.045163590 (107h47m31.004260835s) [upload=112273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 05:13:09.045168940 (107h47m31.004266185s) [upload=112273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 05:13:09.045175296 (107h47m31.004272541s) [upload=112273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 05:13:09.190707283 (107h47m31.149804535s) [upload=112273]: Done uploading segments... Aug 13 05:13:09.190733355 (107h47m31.149830598s) [upload=112273]: Upload finished. err: <nil>
Duration: 835.54387ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
837.590065ms
FAIL (2025-08-13 05:30:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 6beb31f77f54b79c40b38721707898bbf925f20cf0200ad4129fb472e8c51f58 != before 2bcf113319d03ac919f6e4e8f100a51ae990c111cbe53d21476b366d5ef1f851 ======LOGS====== Aug 13 05:13:09.044916248 (107h47m31.004013493s) [upload=112273]: Starting upload Aug 13 05:13:09.044980223 (107h47m31.004077471s) [upload=112273]: Done starting upload Aug 13 05:13:09.045064060 (107h47m31.004161298s) [upload=112273]: Uploading segments... Aug 13 05:13:09.045104608 (107h47m31.004201861s) [upload=112273]: Got next segment. Inline: true Aug 13 05:13:09.045121199 (107h47m31.004218445s) [upload=112273]: Waiting for error group managing segments... Aug 13 05:13:09.045163590 (107h47m31.004260835s) [upload=112273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 05:13:09.045168940 (107h47m31.004266185s) [upload=112273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 05:13:09.045175296 (107h47m31.004272541s) [upload=112273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 05:13:09.190707283 (107h47m31.149804535s) [upload=112273]: Done uploading segments... Aug 13 05:13:09.190733355 (107h47m31.149830598s) [upload=112273]: Upload finished. err: <nil>
Duration: 837.62073ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X.................X.XX.....................................] duration:
2.444106008s
FAIL (2025-08-13 05:30:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:59:27.894872480 (107h33m49.853969725s) [upload=112041]: Starting upload Aug 13 04:59:27.894929712 (107h33m49.854026959s) [upload=112041]: Done starting upload Aug 13 04:59:27.895220077 (107h33m49.854317309s) [upload=112041]: Uploading segments... Aug 13 04:59:27.895277369 (107h33m49.854374614s) [upload=112041]: Got next segment. Inline: false Aug 13 04:59:27.895306541 (107h33m49.854403786s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:59:27.895321172 (107h33m49.854418417s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 04:59:27.984877246 (107h33m49.943974494s) [upload=112041]: Next segment err: metaclient: Too Many Requests Aug 13 04:59:27.984898814 (107h33m49.943996049s) [upload=112041]: Done uploading segments... Aug 13 04:59:27.984924856 (107h33m49.944022105s) [upload=112041]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.444143003s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
844.901817ms
FAIL (2025-08-13 05:30:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 6beb31f77f54b79c40b38721707898bbf925f20cf0200ad4129fb472e8c51f58 != before 2bcf113319d03ac919f6e4e8f100a51ae990c111cbe53d21476b366d5ef1f851 ======LOGS====== Aug 13 05:13:09.044916248 (107h47m31.004013493s) [upload=112273]: Starting upload Aug 13 05:13:09.044980223 (107h47m31.004077471s) [upload=112273]: Done starting upload Aug 13 05:13:09.045064060 (107h47m31.004161298s) [upload=112273]: Uploading segments... Aug 13 05:13:09.045104608 (107h47m31.004201861s) [upload=112273]: Got next segment. Inline: true Aug 13 05:13:09.045121199 (107h47m31.004218445s) [upload=112273]: Waiting for error group managing segments... Aug 13 05:13:09.045163590 (107h47m31.004260835s) [upload=112273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 05:13:09.045168940 (107h47m31.004266185s) [upload=112273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 05:13:09.045175296 (107h47m31.004272541s) [upload=112273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 05:13:09.190707283 (107h47m31.149804535s) [upload=112273]: Done uploading segments... Aug 13 05:13:09.190733355 (107h47m31.149830598s) [upload=112273]: Upload finished. err: <nil>
Duration: 844.944731ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X.................X.XX....................................] duration:
2.235333166s
FAIL (2025-08-13 05:30:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:59:27.894872480 (107h33m49.853969725s) [upload=112041]: Starting upload Aug 13 04:59:27.894929712 (107h33m49.854026959s) [upload=112041]: Done starting upload Aug 13 04:59:27.895220077 (107h33m49.854317309s) [upload=112041]: Uploading segments... Aug 13 04:59:27.895277369 (107h33m49.854374614s) [upload=112041]: Got next segment. Inline: false Aug 13 04:59:27.895306541 (107h33m49.854403786s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:59:27.895321172 (107h33m49.854418417s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 04:59:27.984877246 (107h33m49.943974494s) [upload=112041]: Next segment err: metaclient: Too Many Requests Aug 13 04:59:27.984898814 (107h33m49.943996049s) [upload=112041]: Done uploading segments... Aug 13 04:59:27.984924856 (107h33m49.944022105s) [upload=112041]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.235367893s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
824.752658ms
FAIL (2025-08-13 05:29:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 6beb31f77f54b79c40b38721707898bbf925f20cf0200ad4129fb472e8c51f58 != before 2bcf113319d03ac919f6e4e8f100a51ae990c111cbe53d21476b366d5ef1f851 ======LOGS====== Aug 13 05:13:09.044916248 (107h47m31.004013493s) [upload=112273]: Starting upload Aug 13 05:13:09.044980223 (107h47m31.004077471s) [upload=112273]: Done starting upload Aug 13 05:13:09.045064060 (107h47m31.004161298s) [upload=112273]: Uploading segments... Aug 13 05:13:09.045104608 (107h47m31.004201861s) [upload=112273]: Got next segment. Inline: true Aug 13 05:13:09.045121199 (107h47m31.004218445s) [upload=112273]: Waiting for error group managing segments... Aug 13 05:13:09.045163590 (107h47m31.004260835s) [upload=112273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 05:13:09.045168940 (107h47m31.004266185s) [upload=112273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 05:13:09.045175296 (107h47m31.004272541s) [upload=112273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 05:13:09.190707283 (107h47m31.149804535s) [upload=112273]: Done uploading segments... Aug 13 05:13:09.190733355 (107h47m31.149830598s) [upload=112273]: Upload finished. err: <nil>
Duration: 824.776874ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X.................X.XX...................................] duration:
2.555028044s
FAIL (2025-08-13 05:29:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:59:27.894872480 (107h33m49.853969725s) [upload=112041]: Starting upload Aug 13 04:59:27.894929712 (107h33m49.854026959s) [upload=112041]: Done starting upload Aug 13 04:59:27.895220077 (107h33m49.854317309s) [upload=112041]: Uploading segments... Aug 13 04:59:27.895277369 (107h33m49.854374614s) [upload=112041]: Got next segment. Inline: false Aug 13 04:59:27.895306541 (107h33m49.854403786s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:59:27.895321172 (107h33m49.854418417s) [upload=112041]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 04:59:27.984877246 (107h33m49.943974494s) [upload=112041]: Next segment err: metaclient: Too Many Requests Aug 13 04:59:27.984898814 (107h33m49.943996049s) [upload=112041]: Done uploading segments... Aug 13 04:59:27.984924856 (107h33m49.944022105s) [upload=112041]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.55511682s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|