Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X..........................................X..............] duration:
15.854837933s
FAIL (2025-08-15 15:06:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:57:23.138769819 (165h31m45.097867066s) [upload=172397]: Starting upload Aug 15 14:57:23.138833929 (165h31m45.097931165s) [upload=172397]: Done starting upload Aug 15 14:57:23.138911048 (165h31m45.098008287s) [upload=172397]: Uploading segments... Aug 15 14:57:23.138970618 (165h31m45.098067876s) [upload=172397]: Got next segment. Inline: true Aug 15 14:57:23.138978902 (165h31m45.098076159s) [upload=172397]: Waiting for error group managing segments... Aug 15 14:57:23.139049361 (165h31m45.09814663s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:57:23.139055495 (165h31m45.098152779s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 14:57:23.139059490 (165h31m45.098156737s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 14:57:23.229485332 (165h31m45.188582585s) [upload=172397]: Done uploading segments... Aug 15 14:57:23.229537980 (165h31m45.188635235s) [upload=172397]: Upload finished. err: metaclient: Too Many Requests
Duration: 15.854886752s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
5.571047788s
FAIL (2025-08-15 15:06:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:50:10.995812230 (165h24m32.954909512s) [upload=172268]: Starting upload Aug 15 14:50:10.995909348 (165h24m32.955006579s) [upload=172268]: Done starting upload Aug 15 14:50:10.996054384 (165h24m32.955151653s) [upload=172268]: Uploading segments... Aug 15 14:50:10.996503963 (165h24m32.955601199s) [upload=172268]: Got next segment. Inline: false Aug 15 14:50:10.996586671 (165h24m32.955683928s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:50:10.996598273 (165h24m32.955695534s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 14:50:11.165213619 (165h24m33.124310877s) [upload=172268]: Next segment err: metaclient: Too Many Requests Aug 15 14:50:11.165248296 (165h24m33.124345544s) [upload=172268]: Done uploading segments... Aug 15 14:50:11.165281417 (165h24m33.124378671s) [upload=172268]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.571084004s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X..........................................X.............] duration:
15.017430138s
FAIL (2025-08-15 15:05:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:57:23.138769819 (165h31m45.097867066s) [upload=172397]: Starting upload Aug 15 14:57:23.138833929 (165h31m45.097931165s) [upload=172397]: Done starting upload Aug 15 14:57:23.138911048 (165h31m45.098008287s) [upload=172397]: Uploading segments... Aug 15 14:57:23.138970618 (165h31m45.098067876s) [upload=172397]: Got next segment. Inline: true Aug 15 14:57:23.138978902 (165h31m45.098076159s) [upload=172397]: Waiting for error group managing segments... Aug 15 14:57:23.139049361 (165h31m45.09814663s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:57:23.139055495 (165h31m45.098152779s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 14:57:23.139059490 (165h31m45.098156737s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 14:57:23.229485332 (165h31m45.188582585s) [upload=172397]: Done uploading segments... Aug 15 14:57:23.229537980 (165h31m45.188635235s) [upload=172397]: Upload finished. err: metaclient: Too Many Requests
Duration: 15.017468162s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
23.569593226s
FAIL (2025-08-15 15:05:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:50:10.995812230 (165h24m32.954909512s) [upload=172268]: Starting upload Aug 15 14:50:10.995909348 (165h24m32.955006579s) [upload=172268]: Done starting upload Aug 15 14:50:10.996054384 (165h24m32.955151653s) [upload=172268]: Uploading segments... Aug 15 14:50:10.996503963 (165h24m32.955601199s) [upload=172268]: Got next segment. Inline: false Aug 15 14:50:10.996586671 (165h24m32.955683928s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:50:10.996598273 (165h24m32.955695534s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 14:50:11.165213619 (165h24m33.124310877s) [upload=172268]: Next segment err: metaclient: Too Many Requests Aug 15 14:50:11.165248296 (165h24m33.124345544s) [upload=172268]: Done uploading segments... Aug 15 14:50:11.165281417 (165h24m33.124378671s) [upload=172268]: Upload finished. err: metaclient: Too Many Requests
Duration: 23.569624506s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X..........................................X............] duration:
13.591051056s
FAIL (2025-08-15 15:05:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:57:23.138769819 (165h31m45.097867066s) [upload=172397]: Starting upload Aug 15 14:57:23.138833929 (165h31m45.097931165s) [upload=172397]: Done starting upload Aug 15 14:57:23.138911048 (165h31m45.098008287s) [upload=172397]: Uploading segments... Aug 15 14:57:23.138970618 (165h31m45.098067876s) [upload=172397]: Got next segment. Inline: true Aug 15 14:57:23.138978902 (165h31m45.098076159s) [upload=172397]: Waiting for error group managing segments... Aug 15 14:57:23.139049361 (165h31m45.09814663s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:57:23.139055495 (165h31m45.098152779s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 14:57:23.139059490 (165h31m45.098156737s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 14:57:23.229485332 (165h31m45.188582585s) [upload=172397]: Done uploading segments... Aug 15 14:57:23.229537980 (165h31m45.188635235s) [upload=172397]: Upload finished. err: metaclient: Too Many Requests
Duration: 13.591190052s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X..........................................X...........] duration:
5.946038697s
FAIL (2025-08-15 15:04:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:57:23.138769819 (165h31m45.097867066s) [upload=172397]: Starting upload Aug 15 14:57:23.138833929 (165h31m45.097931165s) [upload=172397]: Done starting upload Aug 15 14:57:23.138911048 (165h31m45.098008287s) [upload=172397]: Uploading segments... Aug 15 14:57:23.138970618 (165h31m45.098067876s) [upload=172397]: Got next segment. Inline: true Aug 15 14:57:23.138978902 (165h31m45.098076159s) [upload=172397]: Waiting for error group managing segments... Aug 15 14:57:23.139049361 (165h31m45.09814663s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:57:23.139055495 (165h31m45.098152779s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 14:57:23.139059490 (165h31m45.098156737s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 14:57:23.229485332 (165h31m45.188582585s) [upload=172397]: Done uploading segments... Aug 15 14:57:23.229537980 (165h31m45.188635235s) [upload=172397]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.946096447s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
4.923570961s
FAIL (2025-08-15 15:04:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:50:10.995812230 (165h24m32.954909512s) [upload=172268]: Starting upload Aug 15 14:50:10.995909348 (165h24m32.955006579s) [upload=172268]: Done starting upload Aug 15 14:50:10.996054384 (165h24m32.955151653s) [upload=172268]: Uploading segments... Aug 15 14:50:10.996503963 (165h24m32.955601199s) [upload=172268]: Got next segment. Inline: false Aug 15 14:50:10.996586671 (165h24m32.955683928s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:50:10.996598273 (165h24m32.955695534s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 14:50:11.165213619 (165h24m33.124310877s) [upload=172268]: Next segment err: metaclient: Too Many Requests Aug 15 14:50:11.165248296 (165h24m33.124345544s) [upload=172268]: Done uploading segments... Aug 15 14:50:11.165281417 (165h24m33.124378671s) [upload=172268]: Upload finished. err: metaclient: Too Many Requests
Duration: 4.923609498s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
3.841929173s
FAIL (2025-08-15 15:03:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:50:10.995812230 (165h24m32.954909512s) [upload=172268]: Starting upload Aug 15 14:50:10.995909348 (165h24m32.955006579s) [upload=172268]: Done starting upload Aug 15 14:50:10.996054384 (165h24m32.955151653s) [upload=172268]: Uploading segments... Aug 15 14:50:10.996503963 (165h24m32.955601199s) [upload=172268]: Got next segment. Inline: false Aug 15 14:50:10.996586671 (165h24m32.955683928s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:50:10.996598273 (165h24m32.955695534s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 14:50:11.165213619 (165h24m33.124310877s) [upload=172268]: Next segment err: metaclient: Too Many Requests Aug 15 14:50:11.165248296 (165h24m33.124345544s) [upload=172268]: Done uploading segments... Aug 15 14:50:11.165281417 (165h24m33.124378671s) [upload=172268]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.841968111s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X..........................................X..........] duration:
1.498400105s
FAIL (2025-08-15 15:03:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:57:23.138769819 (165h31m45.097867066s) [upload=172397]: Starting upload Aug 15 14:57:23.138833929 (165h31m45.097931165s) [upload=172397]: Done starting upload Aug 15 14:57:23.138911048 (165h31m45.098008287s) [upload=172397]: Uploading segments... Aug 15 14:57:23.138970618 (165h31m45.098067876s) [upload=172397]: Got next segment. Inline: true Aug 15 14:57:23.138978902 (165h31m45.098076159s) [upload=172397]: Waiting for error group managing segments... Aug 15 14:57:23.139049361 (165h31m45.09814663s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:57:23.139055495 (165h31m45.098152779s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 14:57:23.139059490 (165h31m45.098156737s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 14:57:23.229485332 (165h31m45.188582585s) [upload=172397]: Done uploading segments... Aug 15 14:57:23.229537980 (165h31m45.188635235s) [upload=172397]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.49843739s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X..........................................X.........] duration:
1.84181694s
FAIL (2025-08-15 15:03:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:57:23.138769819 (165h31m45.097867066s) [upload=172397]: Starting upload Aug 15 14:57:23.138833929 (165h31m45.097931165s) [upload=172397]: Done starting upload Aug 15 14:57:23.138911048 (165h31m45.098008287s) [upload=172397]: Uploading segments... Aug 15 14:57:23.138970618 (165h31m45.098067876s) [upload=172397]: Got next segment. Inline: true Aug 15 14:57:23.138978902 (165h31m45.098076159s) [upload=172397]: Waiting for error group managing segments... Aug 15 14:57:23.139049361 (165h31m45.09814663s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:57:23.139055495 (165h31m45.098152779s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 14:57:23.139059490 (165h31m45.098156737s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 14:57:23.229485332 (165h31m45.188582585s) [upload=172397]: Done uploading segments... Aug 15 14:57:23.229537980 (165h31m45.188635235s) [upload=172397]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.841869817s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
3.65987207s
FAIL (2025-08-15 15:02:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:50:10.995812230 (165h24m32.954909512s) [upload=172268]: Starting upload Aug 15 14:50:10.995909348 (165h24m32.955006579s) [upload=172268]: Done starting upload Aug 15 14:50:10.996054384 (165h24m32.955151653s) [upload=172268]: Uploading segments... Aug 15 14:50:10.996503963 (165h24m32.955601199s) [upload=172268]: Got next segment. Inline: false Aug 15 14:50:10.996586671 (165h24m32.955683928s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:50:10.996598273 (165h24m32.955695534s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 14:50:11.165213619 (165h24m33.124310877s) [upload=172268]: Next segment err: metaclient: Too Many Requests Aug 15 14:50:11.165248296 (165h24m33.124345544s) [upload=172268]: Done uploading segments... Aug 15 14:50:11.165281417 (165h24m33.124378671s) [upload=172268]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.659904134s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X..........................................X........] duration:
2.744734086s
FAIL (2025-08-15 15:02:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:57:23.138769819 (165h31m45.097867066s) [upload=172397]: Starting upload Aug 15 14:57:23.138833929 (165h31m45.097931165s) [upload=172397]: Done starting upload Aug 15 14:57:23.138911048 (165h31m45.098008287s) [upload=172397]: Uploading segments... Aug 15 14:57:23.138970618 (165h31m45.098067876s) [upload=172397]: Got next segment. Inline: true Aug 15 14:57:23.138978902 (165h31m45.098076159s) [upload=172397]: Waiting for error group managing segments... Aug 15 14:57:23.139049361 (165h31m45.09814663s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:57:23.139055495 (165h31m45.098152779s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 14:57:23.139059490 (165h31m45.098156737s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 14:57:23.229485332 (165h31m45.188582585s) [upload=172397]: Done uploading segments... Aug 15 14:57:23.229537980 (165h31m45.188635235s) [upload=172397]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.7448134s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
3.525331601s
FAIL (2025-08-15 15:01:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:50:10.995812230 (165h24m32.954909512s) [upload=172268]: Starting upload Aug 15 14:50:10.995909348 (165h24m32.955006579s) [upload=172268]: Done starting upload Aug 15 14:50:10.996054384 (165h24m32.955151653s) [upload=172268]: Uploading segments... Aug 15 14:50:10.996503963 (165h24m32.955601199s) [upload=172268]: Got next segment. Inline: false Aug 15 14:50:10.996586671 (165h24m32.955683928s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:50:10.996598273 (165h24m32.955695534s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 14:50:11.165213619 (165h24m33.124310877s) [upload=172268]: Next segment err: metaclient: Too Many Requests Aug 15 14:50:11.165248296 (165h24m33.124345544s) [upload=172268]: Done uploading segments... Aug 15 14:50:11.165281417 (165h24m33.124378671s) [upload=172268]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.525363119s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........X..........................................X.......] duration:
1.198338292s
FAIL (2025-08-15 15:01:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:57:23.138769819 (165h31m45.097867066s) [upload=172397]: Starting upload Aug 15 14:57:23.138833929 (165h31m45.097931165s) [upload=172397]: Done starting upload Aug 15 14:57:23.138911048 (165h31m45.098008287s) [upload=172397]: Uploading segments... Aug 15 14:57:23.138970618 (165h31m45.098067876s) [upload=172397]: Got next segment. Inline: true Aug 15 14:57:23.138978902 (165h31m45.098076159s) [upload=172397]: Waiting for error group managing segments... Aug 15 14:57:23.139049361 (165h31m45.09814663s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:57:23.139055495 (165h31m45.098152779s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 14:57:23.139059490 (165h31m45.098156737s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 14:57:23.229485332 (165h31m45.188582585s) [upload=172397]: Done uploading segments... Aug 15 14:57:23.229537980 (165h31m45.188635235s) [upload=172397]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.198379762s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
3.803446938s
FAIL (2025-08-15 15:00:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:50:10.995812230 (165h24m32.954909512s) [upload=172268]: Starting upload Aug 15 14:50:10.995909348 (165h24m32.955006579s) [upload=172268]: Done starting upload Aug 15 14:50:10.996054384 (165h24m32.955151653s) [upload=172268]: Uploading segments... Aug 15 14:50:10.996503963 (165h24m32.955601199s) [upload=172268]: Got next segment. Inline: false Aug 15 14:50:10.996586671 (165h24m32.955683928s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:50:10.996598273 (165h24m32.955695534s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 14:50:11.165213619 (165h24m33.124310877s) [upload=172268]: Next segment err: metaclient: Too Many Requests Aug 15 14:50:11.165248296 (165h24m33.124345544s) [upload=172268]: Done uploading segments... Aug 15 14:50:11.165281417 (165h24m33.124378671s) [upload=172268]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.803578709s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........X..........................................X......] duration:
923.90558ms
FAIL (2025-08-15 15:00:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:57:23.138769819 (165h31m45.097867066s) [upload=172397]: Starting upload Aug 15 14:57:23.138833929 (165h31m45.097931165s) [upload=172397]: Done starting upload Aug 15 14:57:23.138911048 (165h31m45.098008287s) [upload=172397]: Uploading segments... Aug 15 14:57:23.138970618 (165h31m45.098067876s) [upload=172397]: Got next segment. Inline: true Aug 15 14:57:23.138978902 (165h31m45.098076159s) [upload=172397]: Waiting for error group managing segments... Aug 15 14:57:23.139049361 (165h31m45.09814663s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:57:23.139055495 (165h31m45.098152779s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 14:57:23.139059490 (165h31m45.098156737s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 14:57:23.229485332 (165h31m45.188582585s) [upload=172397]: Done uploading segments... Aug 15 14:57:23.229537980 (165h31m45.188635235s) [upload=172397]: Upload finished. err: metaclient: Too Many Requests
Duration: 923.939576ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........X..........................................X.....] duration:
1.072810612s
FAIL (2025-08-15 15:00:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:57:23.138769819 (165h31m45.097867066s) [upload=172397]: Starting upload Aug 15 14:57:23.138833929 (165h31m45.097931165s) [upload=172397]: Done starting upload Aug 15 14:57:23.138911048 (165h31m45.098008287s) [upload=172397]: Uploading segments... Aug 15 14:57:23.138970618 (165h31m45.098067876s) [upload=172397]: Got next segment. Inline: true Aug 15 14:57:23.138978902 (165h31m45.098076159s) [upload=172397]: Waiting for error group managing segments... Aug 15 14:57:23.139049361 (165h31m45.09814663s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:57:23.139055495 (165h31m45.098152779s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 14:57:23.139059490 (165h31m45.098156737s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 14:57:23.229485332 (165h31m45.188582585s) [upload=172397]: Done uploading segments... Aug 15 14:57:23.229537980 (165h31m45.188635235s) [upload=172397]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.072928928s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.932296269s
FAIL (2025-08-15 14:59:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:50:10.995812230 (165h24m32.954909512s) [upload=172268]: Starting upload Aug 15 14:50:10.995909348 (165h24m32.955006579s) [upload=172268]: Done starting upload Aug 15 14:50:10.996054384 (165h24m32.955151653s) [upload=172268]: Uploading segments... Aug 15 14:50:10.996503963 (165h24m32.955601199s) [upload=172268]: Got next segment. Inline: false Aug 15 14:50:10.996586671 (165h24m32.955683928s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:50:10.996598273 (165h24m32.955695534s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 14:50:11.165213619 (165h24m33.124310877s) [upload=172268]: Next segment err: metaclient: Too Many Requests Aug 15 14:50:11.165248296 (165h24m33.124345544s) [upload=172268]: Done uploading segments... Aug 15 14:50:11.165281417 (165h24m33.124378671s) [upload=172268]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.932332409s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............X..........................................X....] duration:
910.607611ms
FAIL (2025-08-15 14:59:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:57:23.138769819 (165h31m45.097867066s) [upload=172397]: Starting upload Aug 15 14:57:23.138833929 (165h31m45.097931165s) [upload=172397]: Done starting upload Aug 15 14:57:23.138911048 (165h31m45.098008287s) [upload=172397]: Uploading segments... Aug 15 14:57:23.138970618 (165h31m45.098067876s) [upload=172397]: Got next segment. Inline: true Aug 15 14:57:23.138978902 (165h31m45.098076159s) [upload=172397]: Waiting for error group managing segments... Aug 15 14:57:23.139049361 (165h31m45.09814663s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:57:23.139055495 (165h31m45.098152779s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 14:57:23.139059490 (165h31m45.098156737s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 14:57:23.229485332 (165h31m45.188582585s) [upload=172397]: Done uploading segments... Aug 15 14:57:23.229537980 (165h31m45.188635235s) [upload=172397]: Upload finished. err: metaclient: Too Many Requests
Duration: 910.642927ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
3.18837078s
FAIL (2025-08-15 14:58:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:50:10.995812230 (165h24m32.954909512s) [upload=172268]: Starting upload Aug 15 14:50:10.995909348 (165h24m32.955006579s) [upload=172268]: Done starting upload Aug 15 14:50:10.996054384 (165h24m32.955151653s) [upload=172268]: Uploading segments... Aug 15 14:50:10.996503963 (165h24m32.955601199s) [upload=172268]: Got next segment. Inline: false Aug 15 14:50:10.996586671 (165h24m32.955683928s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:50:10.996598273 (165h24m32.955695534s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 14:50:11.165213619 (165h24m33.124310877s) [upload=172268]: Next segment err: metaclient: Too Many Requests Aug 15 14:50:11.165248296 (165h24m33.124345544s) [upload=172268]: Done uploading segments... Aug 15 14:50:11.165281417 (165h24m33.124378671s) [upload=172268]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.188404872s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............X..........................................X...] duration:
1.034851419s
FAIL (2025-08-15 14:58:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:57:23.138769819 (165h31m45.097867066s) [upload=172397]: Starting upload Aug 15 14:57:23.138833929 (165h31m45.097931165s) [upload=172397]: Done starting upload Aug 15 14:57:23.138911048 (165h31m45.098008287s) [upload=172397]: Uploading segments... Aug 15 14:57:23.138970618 (165h31m45.098067876s) [upload=172397]: Got next segment. Inline: true Aug 15 14:57:23.138978902 (165h31m45.098076159s) [upload=172397]: Waiting for error group managing segments... Aug 15 14:57:23.139049361 (165h31m45.09814663s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:57:23.139055495 (165h31m45.098152779s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 14:57:23.139059490 (165h31m45.098156737s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 14:57:23.229485332 (165h31m45.188582585s) [upload=172397]: Done uploading segments... Aug 15 14:57:23.229537980 (165h31m45.188635235s) [upload=172397]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.034887613s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............X..........................................X..] duration:
1.080831097s
FAIL (2025-08-15 14:58:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:57:23.138769819 (165h31m45.097867066s) [upload=172397]: Starting upload Aug 15 14:57:23.138833929 (165h31m45.097931165s) [upload=172397]: Done starting upload Aug 15 14:57:23.138911048 (165h31m45.098008287s) [upload=172397]: Uploading segments... Aug 15 14:57:23.138970618 (165h31m45.098067876s) [upload=172397]: Got next segment. Inline: true Aug 15 14:57:23.138978902 (165h31m45.098076159s) [upload=172397]: Waiting for error group managing segments... Aug 15 14:57:23.139049361 (165h31m45.09814663s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:57:23.139055495 (165h31m45.098152779s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 14:57:23.139059490 (165h31m45.098156737s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 14:57:23.229485332 (165h31m45.188582585s) [upload=172397]: Done uploading segments... Aug 15 14:57:23.229537980 (165h31m45.188635235s) [upload=172397]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.080866903s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.867963749s
FAIL (2025-08-15 14:58:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:50:10.995812230 (165h24m32.954909512s) [upload=172268]: Starting upload Aug 15 14:50:10.995909348 (165h24m32.955006579s) [upload=172268]: Done starting upload Aug 15 14:50:10.996054384 (165h24m32.955151653s) [upload=172268]: Uploading segments... Aug 15 14:50:10.996503963 (165h24m32.955601199s) [upload=172268]: Got next segment. Inline: false Aug 15 14:50:10.996586671 (165h24m32.955683928s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:50:10.996598273 (165h24m32.955695534s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 14:50:11.165213619 (165h24m33.124310877s) [upload=172268]: Next segment err: metaclient: Too Many Requests Aug 15 14:50:11.165248296 (165h24m33.124345544s) [upload=172268]: Done uploading segments... Aug 15 14:50:11.165281417 (165h24m33.124378671s) [upload=172268]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.868007369s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............X..........................................X.] duration:
869.836867ms
FAIL (2025-08-15 14:57:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:57:23.138769819 (165h31m45.097867066s) [upload=172397]: Starting upload Aug 15 14:57:23.138833929 (165h31m45.097931165s) [upload=172397]: Done starting upload Aug 15 14:57:23.138911048 (165h31m45.098008287s) [upload=172397]: Uploading segments... Aug 15 14:57:23.138970618 (165h31m45.098067876s) [upload=172397]: Got next segment. Inline: true Aug 15 14:57:23.138978902 (165h31m45.098076159s) [upload=172397]: Waiting for error group managing segments... Aug 15 14:57:23.139049361 (165h31m45.09814663s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:57:23.139055495 (165h31m45.098152779s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 14:57:23.139059490 (165h31m45.098156737s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 14:57:23.229485332 (165h31m45.188582585s) [upload=172397]: Done uploading segments... Aug 15 14:57:23.229537980 (165h31m45.188635235s) [upload=172397]: Upload finished. err: metaclient: Too Many Requests
Duration: 869.885918ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
3.1748929s
FAIL (2025-08-15 14:57:40 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:50:10.995812230 (165h24m32.954909512s) [upload=172268]: Starting upload Aug 15 14:50:10.995909348 (165h24m32.955006579s) [upload=172268]: Done starting upload Aug 15 14:50:10.996054384 (165h24m32.955151653s) [upload=172268]: Uploading segments... Aug 15 14:50:10.996503963 (165h24m32.955601199s) [upload=172268]: Got next segment. Inline: false Aug 15 14:50:10.996586671 (165h24m32.955683928s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:50:10.996598273 (165h24m32.955695534s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 14:50:11.165213619 (165h24m33.124310877s) [upload=172268]: Next segment err: metaclient: Too Many Requests Aug 15 14:50:11.165248296 (165h24m33.124345544s) [upload=172268]: Done uploading segments... Aug 15 14:50:11.165281417 (165h24m33.124378671s) [upload=172268]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.174931504s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X..........................................X] duration:
368.99405ms
FAIL (2025-08-15 14:57:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:57:23.138769819 (165h31m45.097867066s) [upload=172397]: Starting upload Aug 15 14:57:23.138833929 (165h31m45.097931165s) [upload=172397]: Done starting upload Aug 15 14:57:23.138911048 (165h31m45.098008287s) [upload=172397]: Uploading segments... Aug 15 14:57:23.138970618 (165h31m45.098067876s) [upload=172397]: Got next segment. Inline: true Aug 15 14:57:23.138978902 (165h31m45.098076159s) [upload=172397]: Waiting for error group managing segments... Aug 15 14:57:23.139049361 (165h31m45.09814663s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:57:23.139055495 (165h31m45.098152779s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 14:57:23.139059490 (165h31m45.098156737s) [upload=172397]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 14:57:23.229485332 (165h31m45.188582585s) [upload=172397]: Done uploading segments... Aug 15 14:57:23.229537980 (165h31m45.188635235s) [upload=172397]: Upload finished. err: metaclient: Too Many Requests
Duration: 369.128026ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
3.708347164s
FAIL (2025-08-15 14:57:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:50:10.995812230 (165h24m32.954909512s) [upload=172268]: Starting upload Aug 15 14:50:10.995909348 (165h24m32.955006579s) [upload=172268]: Done starting upload Aug 15 14:50:10.996054384 (165h24m32.955151653s) [upload=172268]: Uploading segments... Aug 15 14:50:10.996503963 (165h24m32.955601199s) [upload=172268]: Got next segment. Inline: false Aug 15 14:50:10.996586671 (165h24m32.955683928s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:50:10.996598273 (165h24m32.955695534s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 14:50:11.165213619 (165h24m33.124310877s) [upload=172268]: Next segment err: metaclient: Too Many Requests Aug 15 14:50:11.165248296 (165h24m33.124345544s) [upload=172268]: Done uploading segments... Aug 15 14:50:11.165281417 (165h24m33.124378671s) [upload=172268]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.708445287s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
837.155987ms
FAIL (2025-08-15 14:56:57 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 15 14:25:30.799370732 (164h59m52.758467971s) [upload=171832]: Starting upload
Aug 15 14:25:30.799433430 (164h59m52.758530676s) [upload=171832]: Done starting upload
Aug 15 14:25:30.799519552 (164h59m52.758616789s) [upload=171832]: Uploading segments...
Aug 15 14:25:30.799581891 (164h59m52.758679145s) [upload=171832]: Got next segment. Inline: true
Aug 15 14:25:30.799587243 (164h59m52.758684489s) [upload=171832]: Waiting for error group managing segments...
Aug 15 14:25:30.799650928 (164h59m52.758748174s) [upload=171832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 14:25:30.799656528 (164h59m52.758753773s) [upload=171832]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 15 14:25:30.799660302 (164h59m52.758757547s) [upload=171832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 14:25:30.986867576 (164h59m52.945964835s) [upload=171832]: Done uploading segments...
Aug 15 14:25:30.986895613 (164h59m52.945992867s) [upload=171832]: Upload finished. err: <nil>
Duration: 837.187533ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
3.200198038s
FAIL (2025-08-15 14:56:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:50:10.995812230 (165h24m32.954909512s) [upload=172268]: Starting upload Aug 15 14:50:10.995909348 (165h24m32.955006579s) [upload=172268]: Done starting upload Aug 15 14:50:10.996054384 (165h24m32.955151653s) [upload=172268]: Uploading segments... Aug 15 14:50:10.996503963 (165h24m32.955601199s) [upload=172268]: Got next segment. Inline: false Aug 15 14:50:10.996586671 (165h24m32.955683928s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:50:10.996598273 (165h24m32.955695534s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 14:50:11.165213619 (165h24m33.124310877s) [upload=172268]: Next segment err: metaclient: Too Many Requests Aug 15 14:50:11.165248296 (165h24m33.124345544s) [upload=172268]: Done uploading segments... Aug 15 14:50:11.165281417 (165h24m33.124378671s) [upload=172268]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.200315678s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.733093818s
FAIL (2025-08-15 14:56:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:50:10.995812230 (165h24m32.954909512s) [upload=172268]: Starting upload Aug 15 14:50:10.995909348 (165h24m32.955006579s) [upload=172268]: Done starting upload Aug 15 14:50:10.996054384 (165h24m32.955151653s) [upload=172268]: Uploading segments... Aug 15 14:50:10.996503963 (165h24m32.955601199s) [upload=172268]: Got next segment. Inline: false Aug 15 14:50:10.996586671 (165h24m32.955683928s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:50:10.996598273 (165h24m32.955695534s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 14:50:11.165213619 (165h24m33.124310877s) [upload=172268]: Next segment err: metaclient: Too Many Requests Aug 15 14:50:11.165248296 (165h24m33.124345544s) [upload=172268]: Done uploading segments... Aug 15 14:50:11.165281417 (165h24m33.124378671s) [upload=172268]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.733226083s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X.................X.........................................] duration:
812.641386ms
FAIL (2025-08-15 14:56:08 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 15 14:25:30.799370732 (164h59m52.758467971s) [upload=171832]: Starting upload
Aug 15 14:25:30.799433430 (164h59m52.758530676s) [upload=171832]: Done starting upload
Aug 15 14:25:30.799519552 (164h59m52.758616789s) [upload=171832]: Uploading segments...
Aug 15 14:25:30.799581891 (164h59m52.758679145s) [upload=171832]: Got next segment. Inline: true
Aug 15 14:25:30.799587243 (164h59m52.758684489s) [upload=171832]: Waiting for error group managing segments...
Aug 15 14:25:30.799650928 (164h59m52.758748174s) [upload=171832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 14:25:30.799656528 (164h59m52.758753773s) [upload=171832]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 15 14:25:30.799660302 (164h59m52.758757547s) [upload=171832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 14:25:30.986867576 (164h59m52.945964835s) [upload=171832]: Done uploading segments...
Aug 15 14:25:30.986895613 (164h59m52.945992867s) [upload=171832]: Upload finished. err: <nil>
Duration: 812.67439ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.896289404s
FAIL (2025-08-15 14:55:48 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:50:10.995812230 (165h24m32.954909512s) [upload=172268]: Starting upload Aug 15 14:50:10.995909348 (165h24m32.955006579s) [upload=172268]: Done starting upload Aug 15 14:50:10.996054384 (165h24m32.955151653s) [upload=172268]: Uploading segments... Aug 15 14:50:10.996503963 (165h24m32.955601199s) [upload=172268]: Got next segment. Inline: false Aug 15 14:50:10.996586671 (165h24m32.955683928s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:50:10.996598273 (165h24m32.955695534s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 14:50:11.165213619 (165h24m33.124310877s) [upload=172268]: Next segment err: metaclient: Too Many Requests Aug 15 14:50:11.165248296 (165h24m33.124345544s) [upload=172268]: Done uploading segments... Aug 15 14:50:11.165281417 (165h24m33.124378671s) [upload=172268]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.896377522s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X.................X........................................] duration:
1.034192932s
FAIL (2025-08-15 14:55:21 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 15 14:25:30.799370732 (164h59m52.758467971s) [upload=171832]: Starting upload
Aug 15 14:25:30.799433430 (164h59m52.758530676s) [upload=171832]: Done starting upload
Aug 15 14:25:30.799519552 (164h59m52.758616789s) [upload=171832]: Uploading segments...
Aug 15 14:25:30.799581891 (164h59m52.758679145s) [upload=171832]: Got next segment. Inline: true
Aug 15 14:25:30.799587243 (164h59m52.758684489s) [upload=171832]: Waiting for error group managing segments...
Aug 15 14:25:30.799650928 (164h59m52.758748174s) [upload=171832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 14:25:30.799656528 (164h59m52.758753773s) [upload=171832]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 15 14:25:30.799660302 (164h59m52.758757547s) [upload=171832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 14:25:30.986867576 (164h59m52.945964835s) [upload=171832]: Done uploading segments...
Aug 15 14:25:30.986895613 (164h59m52.945992867s) [upload=171832]: Upload finished. err: <nil>
Duration: 1.034223828s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
3.266223208s
FAIL (2025-08-15 14:55:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:50:10.995812230 (165h24m32.954909512s) [upload=172268]: Starting upload Aug 15 14:50:10.995909348 (165h24m32.955006579s) [upload=172268]: Done starting upload Aug 15 14:50:10.996054384 (165h24m32.955151653s) [upload=172268]: Uploading segments... Aug 15 14:50:10.996503963 (165h24m32.955601199s) [upload=172268]: Got next segment. Inline: false Aug 15 14:50:10.996586671 (165h24m32.955683928s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:50:10.996598273 (165h24m32.955695534s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 14:50:11.165213619 (165h24m33.124310877s) [upload=172268]: Next segment err: metaclient: Too Many Requests Aug 15 14:50:11.165248296 (165h24m33.124345544s) [upload=172268]: Done uploading segments... Aug 15 14:50:11.165281417 (165h24m33.124378671s) [upload=172268]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.266260173s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.723652198s
FAIL (2025-08-15 14:54:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:50:10.995812230 (165h24m32.954909512s) [upload=172268]: Starting upload Aug 15 14:50:10.995909348 (165h24m32.955006579s) [upload=172268]: Done starting upload Aug 15 14:50:10.996054384 (165h24m32.955151653s) [upload=172268]: Uploading segments... Aug 15 14:50:10.996503963 (165h24m32.955601199s) [upload=172268]: Got next segment. Inline: false Aug 15 14:50:10.996586671 (165h24m32.955683928s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:50:10.996598273 (165h24m32.955695534s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 14:50:11.165213619 (165h24m33.124310877s) [upload=172268]: Next segment err: metaclient: Too Many Requests Aug 15 14:50:11.165248296 (165h24m33.124345544s) [upload=172268]: Done uploading segments... Aug 15 14:50:11.165281417 (165h24m33.124378671s) [upload=172268]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.723684685s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
3.106490136s
FAIL (2025-08-15 14:54:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:50:10.995812230 (165h24m32.954909512s) [upload=172268]: Starting upload Aug 15 14:50:10.995909348 (165h24m32.955006579s) [upload=172268]: Done starting upload Aug 15 14:50:10.996054384 (165h24m32.955151653s) [upload=172268]: Uploading segments... Aug 15 14:50:10.996503963 (165h24m32.955601199s) [upload=172268]: Got next segment. Inline: false Aug 15 14:50:10.996586671 (165h24m32.955683928s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:50:10.996598273 (165h24m32.955695534s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 14:50:11.165213619 (165h24m33.124310877s) [upload=172268]: Next segment err: metaclient: Too Many Requests Aug 15 14:50:11.165248296 (165h24m33.124345544s) [upload=172268]: Done uploading segments... Aug 15 14:50:11.165281417 (165h24m33.124378671s) [upload=172268]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.106528492s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X.................X.......................................] duration:
1.352184237s
FAIL (2025-08-15 14:54:12 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 15 14:25:30.799370732 (164h59m52.758467971s) [upload=171832]: Starting upload
Aug 15 14:25:30.799433430 (164h59m52.758530676s) [upload=171832]: Done starting upload
Aug 15 14:25:30.799519552 (164h59m52.758616789s) [upload=171832]: Uploading segments...
Aug 15 14:25:30.799581891 (164h59m52.758679145s) [upload=171832]: Got next segment. Inline: true
Aug 15 14:25:30.799587243 (164h59m52.758684489s) [upload=171832]: Waiting for error group managing segments...
Aug 15 14:25:30.799650928 (164h59m52.758748174s) [upload=171832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 14:25:30.799656528 (164h59m52.758753773s) [upload=171832]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 15 14:25:30.799660302 (164h59m52.758757547s) [upload=171832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 14:25:30.986867576 (164h59m52.945964835s) [upload=171832]: Done uploading segments...
Aug 15 14:25:30.986895613 (164h59m52.945992867s) [upload=171832]: Upload finished. err: <nil>
Duration: 1.352223486s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.999905767s
FAIL (2025-08-15 14:54:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:50:10.995812230 (165h24m32.954909512s) [upload=172268]: Starting upload Aug 15 14:50:10.995909348 (165h24m32.955006579s) [upload=172268]: Done starting upload Aug 15 14:50:10.996054384 (165h24m32.955151653s) [upload=172268]: Uploading segments... Aug 15 14:50:10.996503963 (165h24m32.955601199s) [upload=172268]: Got next segment. Inline: false Aug 15 14:50:10.996586671 (165h24m32.955683928s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:50:10.996598273 (165h24m32.955695534s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 14:50:11.165213619 (165h24m33.124310877s) [upload=172268]: Next segment err: metaclient: Too Many Requests Aug 15 14:50:11.165248296 (165h24m33.124345544s) [upload=172268]: Done uploading segments... Aug 15 14:50:11.165281417 (165h24m33.124378671s) [upload=172268]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.999943273s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
3.338247036s
FAIL (2025-08-15 14:53:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:50:10.995812230 (165h24m32.954909512s) [upload=172268]: Starting upload Aug 15 14:50:10.995909348 (165h24m32.955006579s) [upload=172268]: Done starting upload Aug 15 14:50:10.996054384 (165h24m32.955151653s) [upload=172268]: Uploading segments... Aug 15 14:50:10.996503963 (165h24m32.955601199s) [upload=172268]: Got next segment. Inline: false Aug 15 14:50:10.996586671 (165h24m32.955683928s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:50:10.996598273 (165h24m32.955695534s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 14:50:11.165213619 (165h24m33.124310877s) [upload=172268]: Next segment err: metaclient: Too Many Requests Aug 15 14:50:11.165248296 (165h24m33.124345544s) [upload=172268]: Done uploading segments... Aug 15 14:50:11.165281417 (165h24m33.124378671s) [upload=172268]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.338297449s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X.................X......................................] duration:
848.329063ms
FAIL (2025-08-15 14:53:05 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 15 14:25:30.799370732 (164h59m52.758467971s) [upload=171832]: Starting upload
Aug 15 14:25:30.799433430 (164h59m52.758530676s) [upload=171832]: Done starting upload
Aug 15 14:25:30.799519552 (164h59m52.758616789s) [upload=171832]: Uploading segments...
Aug 15 14:25:30.799581891 (164h59m52.758679145s) [upload=171832]: Got next segment. Inline: true
Aug 15 14:25:30.799587243 (164h59m52.758684489s) [upload=171832]: Waiting for error group managing segments...
Aug 15 14:25:30.799650928 (164h59m52.758748174s) [upload=171832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 14:25:30.799656528 (164h59m52.758753773s) [upload=171832]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 15 14:25:30.799660302 (164h59m52.758757547s) [upload=171832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 14:25:30.986867576 (164h59m52.945964835s) [upload=171832]: Done uploading segments...
Aug 15 14:25:30.986895613 (164h59m52.945992867s) [upload=171832]: Upload finished. err: <nil>
Duration: 848.361012ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.831983145s
FAIL (2025-08-15 14:53:02 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:50:10.995812230 (165h24m32.954909512s) [upload=172268]: Starting upload Aug 15 14:50:10.995909348 (165h24m32.955006579s) [upload=172268]: Done starting upload Aug 15 14:50:10.996054384 (165h24m32.955151653s) [upload=172268]: Uploading segments... Aug 15 14:50:10.996503963 (165h24m32.955601199s) [upload=172268]: Got next segment. Inline: false Aug 15 14:50:10.996586671 (165h24m32.955683928s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:50:10.996598273 (165h24m32.955695534s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 14:50:11.165213619 (165h24m33.124310877s) [upload=172268]: Next segment err: metaclient: Too Many Requests Aug 15 14:50:11.165248296 (165h24m33.124345544s) [upload=172268]: Done uploading segments... Aug 15 14:50:11.165281417 (165h24m33.124378671s) [upload=172268]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.832024446s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X.................X.....................................] duration:
840.248128ms
FAIL (2025-08-15 14:52:33 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 15 14:25:30.799370732 (164h59m52.758467971s) [upload=171832]: Starting upload
Aug 15 14:25:30.799433430 (164h59m52.758530676s) [upload=171832]: Done starting upload
Aug 15 14:25:30.799519552 (164h59m52.758616789s) [upload=171832]: Uploading segments...
Aug 15 14:25:30.799581891 (164h59m52.758679145s) [upload=171832]: Got next segment. Inline: true
Aug 15 14:25:30.799587243 (164h59m52.758684489s) [upload=171832]: Waiting for error group managing segments...
Aug 15 14:25:30.799650928 (164h59m52.758748174s) [upload=171832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 14:25:30.799656528 (164h59m52.758753773s) [upload=171832]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 15 14:25:30.799660302 (164h59m52.758757547s) [upload=171832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 14:25:30.986867576 (164h59m52.945964835s) [upload=171832]: Done uploading segments...
Aug 15 14:25:30.986895613 (164h59m52.945992867s) [upload=171832]: Upload finished. err: <nil>
Duration: 840.276127ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
3.071649801s
FAIL (2025-08-15 14:52:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:50:10.995812230 (165h24m32.954909512s) [upload=172268]: Starting upload Aug 15 14:50:10.995909348 (165h24m32.955006579s) [upload=172268]: Done starting upload Aug 15 14:50:10.996054384 (165h24m32.955151653s) [upload=172268]: Uploading segments... Aug 15 14:50:10.996503963 (165h24m32.955601199s) [upload=172268]: Got next segment. Inline: false Aug 15 14:50:10.996586671 (165h24m32.955683928s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:50:10.996598273 (165h24m32.955695534s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 14:50:11.165213619 (165h24m33.124310877s) [upload=172268]: Next segment err: metaclient: Too Many Requests Aug 15 14:50:11.165248296 (165h24m33.124345544s) [upload=172268]: Done uploading segments... Aug 15 14:50:11.165281417 (165h24m33.124378671s) [upload=172268]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.07168618s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.875901155s
FAIL (2025-08-15 14:51:48 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:50:10.995812230 (165h24m32.954909512s) [upload=172268]: Starting upload Aug 15 14:50:10.995909348 (165h24m32.955006579s) [upload=172268]: Done starting upload Aug 15 14:50:10.996054384 (165h24m32.955151653s) [upload=172268]: Uploading segments... Aug 15 14:50:10.996503963 (165h24m32.955601199s) [upload=172268]: Got next segment. Inline: false Aug 15 14:50:10.996586671 (165h24m32.955683928s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:50:10.996598273 (165h24m32.955695534s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 14:50:11.165213619 (165h24m33.124310877s) [upload=172268]: Next segment err: metaclient: Too Many Requests Aug 15 14:50:11.165248296 (165h24m33.124345544s) [upload=172268]: Done uploading segments... Aug 15 14:50:11.165281417 (165h24m33.124378671s) [upload=172268]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.875932977s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X.................X....................................] duration:
880.174944ms
FAIL (2025-08-15 14:51:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 15 14:25:30.799370732 (164h59m52.758467971s) [upload=171832]: Starting upload
Aug 15 14:25:30.799433430 (164h59m52.758530676s) [upload=171832]: Done starting upload
Aug 15 14:25:30.799519552 (164h59m52.758616789s) [upload=171832]: Uploading segments...
Aug 15 14:25:30.799581891 (164h59m52.758679145s) [upload=171832]: Got next segment. Inline: true
Aug 15 14:25:30.799587243 (164h59m52.758684489s) [upload=171832]: Waiting for error group managing segments...
Aug 15 14:25:30.799650928 (164h59m52.758748174s) [upload=171832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 14:25:30.799656528 (164h59m52.758753773s) [upload=171832]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 15 14:25:30.799660302 (164h59m52.758757547s) [upload=171832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 14:25:30.986867576 (164h59m52.945964835s) [upload=171832]: Done uploading segments...
Aug 15 14:25:30.986895613 (164h59m52.945992867s) [upload=171832]: Upload finished. err: <nil>
Duration: 880.209042ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
3.263420691s
FAIL (2025-08-15 14:50:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:50:10.995812230 (165h24m32.954909512s) [upload=172268]: Starting upload Aug 15 14:50:10.995909348 (165h24m32.955006579s) [upload=172268]: Done starting upload Aug 15 14:50:10.996054384 (165h24m32.955151653s) [upload=172268]: Uploading segments... Aug 15 14:50:10.996503963 (165h24m32.955601199s) [upload=172268]: Got next segment. Inline: false Aug 15 14:50:10.996586671 (165h24m32.955683928s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:50:10.996598273 (165h24m32.955695534s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 14:50:11.165213619 (165h24m33.124310877s) [upload=172268]: Next segment err: metaclient: Too Many Requests Aug 15 14:50:11.165248296 (165h24m33.124345544s) [upload=172268]: Done uploading segments... Aug 15 14:50:11.165281417 (165h24m33.124378671s) [upload=172268]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.263518424s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X.................X...................................] duration:
881.74712ms
FAIL (2025-08-15 14:50:22 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 15 14:25:30.799370732 (164h59m52.758467971s) [upload=171832]: Starting upload
Aug 15 14:25:30.799433430 (164h59m52.758530676s) [upload=171832]: Done starting upload
Aug 15 14:25:30.799519552 (164h59m52.758616789s) [upload=171832]: Uploading segments...
Aug 15 14:25:30.799581891 (164h59m52.758679145s) [upload=171832]: Got next segment. Inline: true
Aug 15 14:25:30.799587243 (164h59m52.758684489s) [upload=171832]: Waiting for error group managing segments...
Aug 15 14:25:30.799650928 (164h59m52.758748174s) [upload=171832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 14:25:30.799656528 (164h59m52.758753773s) [upload=171832]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 15 14:25:30.799660302 (164h59m52.758757547s) [upload=171832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 14:25:30.986867576 (164h59m52.945964835s) [upload=171832]: Done uploading segments...
Aug 15 14:25:30.986895613 (164h59m52.945992867s) [upload=171832]: Upload finished. err: <nil>
Duration: 881.784132ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
3.004323397s
FAIL (2025-08-15 14:50:16 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.004404973s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
448.493655ms
FAIL (2025-08-15 14:50:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 14:50:10.995812230 (165h24m32.954909512s) [upload=172268]: Starting upload Aug 15 14:50:10.995909348 (165h24m32.955006579s) [upload=172268]: Done starting upload Aug 15 14:50:10.996054384 (165h24m32.955151653s) [upload=172268]: Uploading segments... Aug 15 14:50:10.996503963 (165h24m32.955601199s) [upload=172268]: Got next segment. Inline: false Aug 15 14:50:10.996586671 (165h24m32.955683928s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 14:50:10.996598273 (165h24m32.955695534s) [upload=172268]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 14:50:11.165213619 (165h24m33.124310877s) [upload=172268]: Next segment err: metaclient: Too Many Requests Aug 15 14:50:11.165248296 (165h24m33.124345544s) [upload=172268]: Done uploading segments... Aug 15 14:50:11.165281417 (165h24m33.124378671s) [upload=172268]: Upload finished. err: metaclient: Too Many Requests
Duration: 448.521792ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X.................X..................................] duration:
1.470094s
FAIL (2025-08-15 14:50:02 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 15 14:25:30.799370732 (164h59m52.758467971s) [upload=171832]: Starting upload
Aug 15 14:25:30.799433430 (164h59m52.758530676s) [upload=171832]: Done starting upload
Aug 15 14:25:30.799519552 (164h59m52.758616789s) [upload=171832]: Uploading segments...
Aug 15 14:25:30.799581891 (164h59m52.758679145s) [upload=171832]: Got next segment. Inline: true
Aug 15 14:25:30.799587243 (164h59m52.758684489s) [upload=171832]: Waiting for error group managing segments...
Aug 15 14:25:30.799650928 (164h59m52.758748174s) [upload=171832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 14:25:30.799656528 (164h59m52.758753773s) [upload=171832]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 15 14:25:30.799660302 (164h59m52.758757547s) [upload=171832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 14:25:30.986867576 (164h59m52.945964835s) [upload=171832]: Done uploading segments...
Aug 15 14:25:30.986895613 (164h59m52.945992867s) [upload=171832]: Upload finished. err: <nil>
Duration: 1.470138885s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|