Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................X....X................X................] duration:
875.196411ms
FAIL (2025-08-20 00:53:21 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 20 00:41:59.760613214 (271h16m21.719710465s) [upload=282341]: Starting upload Aug 20 00:41:59.760714840 (271h16m21.719812086s) [upload=282341]: Done starting upload Aug 20 00:41:59.760794811 (271h16m21.719892045s) [upload=282341]: Uploading segments... Aug 20 00:41:59.760896136 (271h16m21.719993384s) [upload=282341]: Got next segment. Inline: true Aug 20 00:41:59.760903763 (271h16m21.720001s) [upload=282341]: Waiting for error group managing segments... Aug 20 00:41:59.760975558 (271h16m21.720072793s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:59.760981083 (271h16m21.720078319s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:41:59.760984685 (271h16m21.720081924s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:42:00.099135797 (271h16m22.058233033s) [upload=282341]: Done uploading segments... Aug 20 00:42:00.099171203 (271h16m22.058268448s) [upload=282341]: Upload finished. err: <nil>
Duration: 875.276699ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [X.X......................X...........X.....X................] duration:
2.363707433s
FAIL (2025-08-20 00:53:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:41:16.718753405 (271h15m38.677850655s) [upload=282330]: Starting upload Aug 20 00:41:16.718831430 (271h15m38.677928687s) [upload=282330]: Done starting upload Aug 20 00:41:16.719014843 (271h15m38.678112094s) [upload=282330]: Uploading segments... Aug 20 00:41:16.719264159 (271h15m38.678361406s) [upload=282330]: Got next segment. Inline: false Aug 20 00:41:16.719324131 (271h15m38.678421381s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:16.719331094 (271h15m38.678428347s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:41:16.806453266 (271h15m38.765550503s) [upload=282330]: Next segment err: metaclient: Too Many Requests Aug 20 00:41:16.806494321 (271h15m38.765591568s) [upload=282330]: Done uploading segments... Aug 20 00:41:16.806513105 (271h15m38.765610345s) [upload=282330]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.363752771s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.X.X......................X...........X.....X...............] duration:
2.400926742s
FAIL (2025-08-20 00:52:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:41:16.718753405 (271h15m38.677850655s) [upload=282330]: Starting upload Aug 20 00:41:16.718831430 (271h15m38.677928687s) [upload=282330]: Done starting upload Aug 20 00:41:16.719014843 (271h15m38.678112094s) [upload=282330]: Uploading segments... Aug 20 00:41:16.719264159 (271h15m38.678361406s) [upload=282330]: Got next segment. Inline: false Aug 20 00:41:16.719324131 (271h15m38.678421381s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:16.719331094 (271h15m38.678428347s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:41:16.806453266 (271h15m38.765550503s) [upload=282330]: Next segment err: metaclient: Too Many Requests Aug 20 00:41:16.806494321 (271h15m38.765591568s) [upload=282330]: Done uploading segments... Aug 20 00:41:16.806513105 (271h15m38.765610345s) [upload=282330]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.40096298s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......................X....X................X...............] duration:
844.146393ms
FAIL (2025-08-20 00:52:24 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 20 00:41:59.760613214 (271h16m21.719710465s) [upload=282341]: Starting upload Aug 20 00:41:59.760714840 (271h16m21.719812086s) [upload=282341]: Done starting upload Aug 20 00:41:59.760794811 (271h16m21.719892045s) [upload=282341]: Uploading segments... Aug 20 00:41:59.760896136 (271h16m21.719993384s) [upload=282341]: Got next segment. Inline: true Aug 20 00:41:59.760903763 (271h16m21.720001s) [upload=282341]: Waiting for error group managing segments... Aug 20 00:41:59.760975558 (271h16m21.720072793s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:59.760981083 (271h16m21.720078319s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:41:59.760984685 (271h16m21.720081924s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:42:00.099135797 (271h16m22.058233033s) [upload=282341]: Done uploading segments... Aug 20 00:42:00.099171203 (271h16m22.058268448s) [upload=282341]: Upload finished. err: <nil>
Duration: 844.177216ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......................X....X................X..............] duration:
934.696743ms
FAIL (2025-08-20 00:51:41 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 20 00:41:59.760613214 (271h16m21.719710465s) [upload=282341]: Starting upload Aug 20 00:41:59.760714840 (271h16m21.719812086s) [upload=282341]: Done starting upload Aug 20 00:41:59.760794811 (271h16m21.719892045s) [upload=282341]: Uploading segments... Aug 20 00:41:59.760896136 (271h16m21.719993384s) [upload=282341]: Got next segment. Inline: true Aug 20 00:41:59.760903763 (271h16m21.720001s) [upload=282341]: Waiting for error group managing segments... Aug 20 00:41:59.760975558 (271h16m21.720072793s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:59.760981083 (271h16m21.720078319s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:41:59.760984685 (271h16m21.720081924s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:42:00.099135797 (271h16m22.058233033s) [upload=282341]: Done uploading segments... Aug 20 00:42:00.099171203 (271h16m22.058268448s) [upload=282341]: Upload finished. err: <nil>
Duration: 934.727568ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..X.X......................X...........X.....X..............] duration:
2.454439903s
FAIL (2025-08-20 00:51:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:41:16.718753405 (271h15m38.677850655s) [upload=282330]: Starting upload Aug 20 00:41:16.718831430 (271h15m38.677928687s) [upload=282330]: Done starting upload Aug 20 00:41:16.719014843 (271h15m38.678112094s) [upload=282330]: Uploading segments... Aug 20 00:41:16.719264159 (271h15m38.678361406s) [upload=282330]: Got next segment. Inline: false Aug 20 00:41:16.719324131 (271h15m38.678421381s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:16.719331094 (271h15m38.678428347s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:41:16.806453266 (271h15m38.765550503s) [upload=282330]: Next segment err: metaclient: Too Many Requests Aug 20 00:41:16.806494321 (271h15m38.765591568s) [upload=282330]: Done uploading segments... Aug 20 00:41:16.806513105 (271h15m38.765610345s) [upload=282330]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.454518508s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........................X....X................X.............] duration:
1.118926553s
FAIL (2025-08-20 00:51:10 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 20 00:41:59.760613214 (271h16m21.719710465s) [upload=282341]: Starting upload Aug 20 00:41:59.760714840 (271h16m21.719812086s) [upload=282341]: Done starting upload Aug 20 00:41:59.760794811 (271h16m21.719892045s) [upload=282341]: Uploading segments... Aug 20 00:41:59.760896136 (271h16m21.719993384s) [upload=282341]: Got next segment. Inline: true Aug 20 00:41:59.760903763 (271h16m21.720001s) [upload=282341]: Waiting for error group managing segments... Aug 20 00:41:59.760975558 (271h16m21.720072793s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:59.760981083 (271h16m21.720078319s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:41:59.760984685 (271h16m21.720081924s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:42:00.099135797 (271h16m22.058233033s) [upload=282341]: Done uploading segments... Aug 20 00:42:00.099171203 (271h16m22.058268448s) [upload=282341]: Upload finished. err: <nil>
Duration: 1.118955323s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........................X....X................X............] duration:
962.462988ms
FAIL (2025-08-20 00:50:28 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 20 00:41:59.760613214 (271h16m21.719710465s) [upload=282341]: Starting upload Aug 20 00:41:59.760714840 (271h16m21.719812086s) [upload=282341]: Done starting upload Aug 20 00:41:59.760794811 (271h16m21.719892045s) [upload=282341]: Uploading segments... Aug 20 00:41:59.760896136 (271h16m21.719993384s) [upload=282341]: Got next segment. Inline: true Aug 20 00:41:59.760903763 (271h16m21.720001s) [upload=282341]: Waiting for error group managing segments... Aug 20 00:41:59.760975558 (271h16m21.720072793s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:59.760981083 (271h16m21.720078319s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:41:59.760984685 (271h16m21.720081924s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:42:00.099135797 (271h16m22.058233033s) [upload=282341]: Done uploading segments... Aug 20 00:42:00.099171203 (271h16m22.058268448s) [upload=282341]: Upload finished. err: <nil>
Duration: 962.497591ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...X.X......................X...........X.....X.............] duration:
2.420395841s
FAIL (2025-08-20 00:50:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:41:16.718753405 (271h15m38.677850655s) [upload=282330]: Starting upload Aug 20 00:41:16.718831430 (271h15m38.677928687s) [upload=282330]: Done starting upload Aug 20 00:41:16.719014843 (271h15m38.678112094s) [upload=282330]: Uploading segments... Aug 20 00:41:16.719264159 (271h15m38.678361406s) [upload=282330]: Got next segment. Inline: false Aug 20 00:41:16.719324131 (271h15m38.678421381s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:16.719331094 (271h15m38.678428347s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:41:16.806453266 (271h15m38.765550503s) [upload=282330]: Next segment err: metaclient: Too Many Requests Aug 20 00:41:16.806494321 (271h15m38.765591568s) [upload=282330]: Done uploading segments... Aug 20 00:41:16.806513105 (271h15m38.765610345s) [upload=282330]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.420425792s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........................X....X................X...........] duration:
1.411563795s
FAIL (2025-08-20 00:49:44 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 20 00:41:59.760613214 (271h16m21.719710465s) [upload=282341]: Starting upload Aug 20 00:41:59.760714840 (271h16m21.719812086s) [upload=282341]: Done starting upload Aug 20 00:41:59.760794811 (271h16m21.719892045s) [upload=282341]: Uploading segments... Aug 20 00:41:59.760896136 (271h16m21.719993384s) [upload=282341]: Got next segment. Inline: true Aug 20 00:41:59.760903763 (271h16m21.720001s) [upload=282341]: Waiting for error group managing segments... Aug 20 00:41:59.760975558 (271h16m21.720072793s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:59.760981083 (271h16m21.720078319s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:41:59.760984685 (271h16m21.720081924s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:42:00.099135797 (271h16m22.058233033s) [upload=282341]: Done uploading segments... Aug 20 00:42:00.099171203 (271h16m22.058268448s) [upload=282341]: Upload finished. err: <nil>
Duration: 1.411601248s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........................X....X................X..........] duration:
1.076625262s
FAIL (2025-08-20 00:49:23 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 20 00:41:59.760613214 (271h16m21.719710465s) [upload=282341]: Starting upload Aug 20 00:41:59.760714840 (271h16m21.719812086s) [upload=282341]: Done starting upload Aug 20 00:41:59.760794811 (271h16m21.719892045s) [upload=282341]: Uploading segments... Aug 20 00:41:59.760896136 (271h16m21.719993384s) [upload=282341]: Got next segment. Inline: true Aug 20 00:41:59.760903763 (271h16m21.720001s) [upload=282341]: Waiting for error group managing segments... Aug 20 00:41:59.760975558 (271h16m21.720072793s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:59.760981083 (271h16m21.720078319s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:41:59.760984685 (271h16m21.720081924s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:42:00.099135797 (271h16m22.058233033s) [upload=282341]: Done uploading segments... Aug 20 00:42:00.099171203 (271h16m22.058268448s) [upload=282341]: Upload finished. err: <nil>
Duration: 1.076664547s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [X...X.X......................X...........X.....X............] duration:
2.484555312s
FAIL (2025-08-20 00:49:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:41:16.718753405 (271h15m38.677850655s) [upload=282330]: Starting upload Aug 20 00:41:16.718831430 (271h15m38.677928687s) [upload=282330]: Done starting upload Aug 20 00:41:16.719014843 (271h15m38.678112094s) [upload=282330]: Uploading segments... Aug 20 00:41:16.719264159 (271h15m38.678361406s) [upload=282330]: Got next segment. Inline: false Aug 20 00:41:16.719324131 (271h15m38.678421381s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:16.719331094 (271h15m38.678428347s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:41:16.806453266 (271h15m38.765550503s) [upload=282330]: Next segment err: metaclient: Too Many Requests Aug 20 00:41:16.806494321 (271h15m38.765591568s) [upload=282330]: Done uploading segments... Aug 20 00:41:16.806513105 (271h15m38.765610345s) [upload=282330]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.484590232s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.X...X.X......................X...........X.....X...........] duration:
2.594236184s
FAIL (2025-08-20 00:48:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:41:16.718753405 (271h15m38.677850655s) [upload=282330]: Starting upload Aug 20 00:41:16.718831430 (271h15m38.677928687s) [upload=282330]: Done starting upload Aug 20 00:41:16.719014843 (271h15m38.678112094s) [upload=282330]: Uploading segments... Aug 20 00:41:16.719264159 (271h15m38.678361406s) [upload=282330]: Got next segment. Inline: false Aug 20 00:41:16.719324131 (271h15m38.678421381s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:16.719331094 (271h15m38.678428347s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:41:16.806453266 (271h15m38.765550503s) [upload=282330]: Next segment err: metaclient: Too Many Requests Aug 20 00:41:16.806494321 (271h15m38.765591568s) [upload=282330]: Done uploading segments... Aug 20 00:41:16.806513105 (271h15m38.765610345s) [upload=282330]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.594285585s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............................X....X................X.........] duration:
859.440663ms
FAIL (2025-08-20 00:48:39 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 20 00:41:59.760613214 (271h16m21.719710465s) [upload=282341]: Starting upload Aug 20 00:41:59.760714840 (271h16m21.719812086s) [upload=282341]: Done starting upload Aug 20 00:41:59.760794811 (271h16m21.719892045s) [upload=282341]: Uploading segments... Aug 20 00:41:59.760896136 (271h16m21.719993384s) [upload=282341]: Got next segment. Inline: true Aug 20 00:41:59.760903763 (271h16m21.720001s) [upload=282341]: Waiting for error group managing segments... Aug 20 00:41:59.760975558 (271h16m21.720072793s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:59.760981083 (271h16m21.720078319s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:41:59.760984685 (271h16m21.720081924s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:42:00.099135797 (271h16m22.058233033s) [upload=282341]: Done uploading segments... Aug 20 00:42:00.099171203 (271h16m22.058268448s) [upload=282341]: Upload finished. err: <nil>
Duration: 859.47452ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..X...X.X......................X...........X.....X..........] duration:
2.746067324s
FAIL (2025-08-20 00:48:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:41:16.718753405 (271h15m38.677850655s) [upload=282330]: Starting upload Aug 20 00:41:16.718831430 (271h15m38.677928687s) [upload=282330]: Done starting upload Aug 20 00:41:16.719014843 (271h15m38.678112094s) [upload=282330]: Uploading segments... Aug 20 00:41:16.719264159 (271h15m38.678361406s) [upload=282330]: Got next segment. Inline: false Aug 20 00:41:16.719324131 (271h15m38.678421381s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:16.719331094 (271h15m38.678428347s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:41:16.806453266 (271h15m38.765550503s) [upload=282330]: Next segment err: metaclient: Too Many Requests Aug 20 00:41:16.806494321 (271h15m38.765591568s) [upload=282330]: Done uploading segments... Aug 20 00:41:16.806513105 (271h15m38.765610345s) [upload=282330]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.746109802s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............................X....X................X........] duration:
1.071948817s
FAIL (2025-08-20 00:48:10 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 20 00:41:59.760613214 (271h16m21.719710465s) [upload=282341]: Starting upload Aug 20 00:41:59.760714840 (271h16m21.719812086s) [upload=282341]: Done starting upload Aug 20 00:41:59.760794811 (271h16m21.719892045s) [upload=282341]: Uploading segments... Aug 20 00:41:59.760896136 (271h16m21.719993384s) [upload=282341]: Got next segment. Inline: true Aug 20 00:41:59.760903763 (271h16m21.720001s) [upload=282341]: Waiting for error group managing segments... Aug 20 00:41:59.760975558 (271h16m21.720072793s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:59.760981083 (271h16m21.720078319s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:41:59.760984685 (271h16m21.720081924s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:42:00.099135797 (271h16m22.058233033s) [upload=282341]: Done uploading segments... Aug 20 00:42:00.099171203 (271h16m22.058268448s) [upload=282341]: Upload finished. err: <nil>
Duration: 1.07197942s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............................X....X................X.......] duration:
865.60559ms
FAIL (2025-08-20 00:47:53 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 20 00:41:59.760613214 (271h16m21.719710465s) [upload=282341]: Starting upload Aug 20 00:41:59.760714840 (271h16m21.719812086s) [upload=282341]: Done starting upload Aug 20 00:41:59.760794811 (271h16m21.719892045s) [upload=282341]: Uploading segments... Aug 20 00:41:59.760896136 (271h16m21.719993384s) [upload=282341]: Got next segment. Inline: true Aug 20 00:41:59.760903763 (271h16m21.720001s) [upload=282341]: Waiting for error group managing segments... Aug 20 00:41:59.760975558 (271h16m21.720072793s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:59.760981083 (271h16m21.720078319s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:41:59.760984685 (271h16m21.720081924s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:42:00.099135797 (271h16m22.058233033s) [upload=282341]: Done uploading segments... Aug 20 00:42:00.099171203 (271h16m22.058268448s) [upload=282341]: Upload finished. err: <nil>
Duration: 865.633774ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...X...X.X......................X...........X.....X.........] duration:
2.540940556s
FAIL (2025-08-20 00:47:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:41:16.718753405 (271h15m38.677850655s) [upload=282330]: Starting upload Aug 20 00:41:16.718831430 (271h15m38.677928687s) [upload=282330]: Done starting upload Aug 20 00:41:16.719014843 (271h15m38.678112094s) [upload=282330]: Uploading segments... Aug 20 00:41:16.719264159 (271h15m38.678361406s) [upload=282330]: Got next segment. Inline: false Aug 20 00:41:16.719324131 (271h15m38.678421381s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:16.719331094 (271h15m38.678428347s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:41:16.806453266 (271h15m38.765550503s) [upload=282330]: Next segment err: metaclient: Too Many Requests Aug 20 00:41:16.806494321 (271h15m38.765591568s) [upload=282330]: Done uploading segments... Aug 20 00:41:16.806513105 (271h15m38.765610345s) [upload=282330]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.540995172s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............................X....X................X......] duration:
1.01599133s
FAIL (2025-08-20 00:47:04 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 20 00:41:59.760613214 (271h16m21.719710465s) [upload=282341]: Starting upload Aug 20 00:41:59.760714840 (271h16m21.719812086s) [upload=282341]: Done starting upload Aug 20 00:41:59.760794811 (271h16m21.719892045s) [upload=282341]: Uploading segments... Aug 20 00:41:59.760896136 (271h16m21.719993384s) [upload=282341]: Got next segment. Inline: true Aug 20 00:41:59.760903763 (271h16m21.720001s) [upload=282341]: Waiting for error group managing segments... Aug 20 00:41:59.760975558 (271h16m21.720072793s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:59.760981083 (271h16m21.720078319s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:41:59.760984685 (271h16m21.720081924s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:42:00.099135797 (271h16m22.058233033s) [upload=282341]: Done uploading segments... Aug 20 00:42:00.099171203 (271h16m22.058268448s) [upload=282341]: Upload finished. err: <nil>
Duration: 1.016138396s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [....X...X.X......................X...........X.....X........] duration:
2.51468461s
FAIL (2025-08-20 00:46:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:41:16.718753405 (271h15m38.677850655s) [upload=282330]: Starting upload Aug 20 00:41:16.718831430 (271h15m38.677928687s) [upload=282330]: Done starting upload Aug 20 00:41:16.719014843 (271h15m38.678112094s) [upload=282330]: Uploading segments... Aug 20 00:41:16.719264159 (271h15m38.678361406s) [upload=282330]: Got next segment. Inline: false Aug 20 00:41:16.719324131 (271h15m38.678421381s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:16.719331094 (271h15m38.678428347s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:41:16.806453266 (271h15m38.765550503s) [upload=282330]: Next segment err: metaclient: Too Many Requests Aug 20 00:41:16.806494321 (271h15m38.765591568s) [upload=282330]: Done uploading segments... Aug 20 00:41:16.806513105 (271h15m38.765610345s) [upload=282330]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.51471807s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................................X....X................X.....] duration:
909.418855ms
FAIL (2025-08-20 00:46:00 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 20 00:41:59.760613214 (271h16m21.719710465s) [upload=282341]: Starting upload Aug 20 00:41:59.760714840 (271h16m21.719812086s) [upload=282341]: Done starting upload Aug 20 00:41:59.760794811 (271h16m21.719892045s) [upload=282341]: Uploading segments... Aug 20 00:41:59.760896136 (271h16m21.719993384s) [upload=282341]: Got next segment. Inline: true Aug 20 00:41:59.760903763 (271h16m21.720001s) [upload=282341]: Waiting for error group managing segments... Aug 20 00:41:59.760975558 (271h16m21.720072793s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:59.760981083 (271h16m21.720078319s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:41:59.760984685 (271h16m21.720081924s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:42:00.099135797 (271h16m22.058233033s) [upload=282341]: Done uploading segments... Aug 20 00:42:00.099171203 (271h16m22.058268448s) [upload=282341]: Upload finished. err: <nil>
Duration: 909.45165ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.....X...X.X......................X...........X.....X.......] duration:
2.489539025s
FAIL (2025-08-20 00:45:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:41:16.718753405 (271h15m38.677850655s) [upload=282330]: Starting upload Aug 20 00:41:16.718831430 (271h15m38.677928687s) [upload=282330]: Done starting upload Aug 20 00:41:16.719014843 (271h15m38.678112094s) [upload=282330]: Uploading segments... Aug 20 00:41:16.719264159 (271h15m38.678361406s) [upload=282330]: Got next segment. Inline: false Aug 20 00:41:16.719324131 (271h15m38.678421381s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:16.719331094 (271h15m38.678428347s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:41:16.806453266 (271h15m38.765550503s) [upload=282330]: Next segment err: metaclient: Too Many Requests Aug 20 00:41:16.806494321 (271h15m38.765591568s) [upload=282330]: Done uploading segments... Aug 20 00:41:16.806513105 (271h15m38.765610345s) [upload=282330]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.489631214s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [......X...X.X......................X...........X.....X......] duration:
2.333039518s
FAIL (2025-08-20 00:45:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:41:16.718753405 (271h15m38.677850655s) [upload=282330]: Starting upload Aug 20 00:41:16.718831430 (271h15m38.677928687s) [upload=282330]: Done starting upload Aug 20 00:41:16.719014843 (271h15m38.678112094s) [upload=282330]: Uploading segments... Aug 20 00:41:16.719264159 (271h15m38.678361406s) [upload=282330]: Got next segment. Inline: false Aug 20 00:41:16.719324131 (271h15m38.678421381s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:16.719331094 (271h15m38.678428347s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:41:16.806453266 (271h15m38.765550503s) [upload=282330]: Next segment err: metaclient: Too Many Requests Aug 20 00:41:16.806494321 (271h15m38.765591568s) [upload=282330]: Done uploading segments... Aug 20 00:41:16.806513105 (271h15m38.765610345s) [upload=282330]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.333110293s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................................X....X................X....] duration:
889.078411ms
FAIL (2025-08-20 00:45:07 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 20 00:41:59.760613214 (271h16m21.719710465s) [upload=282341]: Starting upload Aug 20 00:41:59.760714840 (271h16m21.719812086s) [upload=282341]: Done starting upload Aug 20 00:41:59.760794811 (271h16m21.719892045s) [upload=282341]: Uploading segments... Aug 20 00:41:59.760896136 (271h16m21.719993384s) [upload=282341]: Got next segment. Inline: true Aug 20 00:41:59.760903763 (271h16m21.720001s) [upload=282341]: Waiting for error group managing segments... Aug 20 00:41:59.760975558 (271h16m21.720072793s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:59.760981083 (271h16m21.720078319s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:41:59.760984685 (271h16m21.720081924s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:42:00.099135797 (271h16m22.058233033s) [upload=282341]: Done uploading segments... Aug 20 00:42:00.099171203 (271h16m22.058268448s) [upload=282341]: Upload finished. err: <nil>
Duration: 889.104569ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................................X....X................X...] duration:
966.897946ms
FAIL (2025-08-20 00:44:36 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 20 00:41:59.760613214 (271h16m21.719710465s) [upload=282341]: Starting upload Aug 20 00:41:59.760714840 (271h16m21.719812086s) [upload=282341]: Done starting upload Aug 20 00:41:59.760794811 (271h16m21.719892045s) [upload=282341]: Uploading segments... Aug 20 00:41:59.760896136 (271h16m21.719993384s) [upload=282341]: Got next segment. Inline: true Aug 20 00:41:59.760903763 (271h16m21.720001s) [upload=282341]: Waiting for error group managing segments... Aug 20 00:41:59.760975558 (271h16m21.720072793s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:59.760981083 (271h16m21.720078319s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:41:59.760984685 (271h16m21.720081924s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:42:00.099135797 (271h16m22.058233033s) [upload=282341]: Done uploading segments... Aug 20 00:42:00.099171203 (271h16m22.058268448s) [upload=282341]: Upload finished. err: <nil>
Duration: 966.928806ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................................X....X................X..] duration:
1.096069343s
FAIL (2025-08-20 00:44:18 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 20 00:41:59.760613214 (271h16m21.719710465s) [upload=282341]: Starting upload Aug 20 00:41:59.760714840 (271h16m21.719812086s) [upload=282341]: Done starting upload Aug 20 00:41:59.760794811 (271h16m21.719892045s) [upload=282341]: Uploading segments... Aug 20 00:41:59.760896136 (271h16m21.719993384s) [upload=282341]: Got next segment. Inline: true Aug 20 00:41:59.760903763 (271h16m21.720001s) [upload=282341]: Waiting for error group managing segments... Aug 20 00:41:59.760975558 (271h16m21.720072793s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:59.760981083 (271h16m21.720078319s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:41:59.760984685 (271h16m21.720081924s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:42:00.099135797 (271h16m22.058233033s) [upload=282341]: Done uploading segments... Aug 20 00:42:00.099171203 (271h16m22.058268448s) [upload=282341]: Upload finished. err: <nil>
Duration: 1.096102861s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.......X...X.X......................X...........X.....X.....] duration:
2.637140868s
FAIL (2025-08-20 00:44:07 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:41:16.718753405 (271h15m38.677850655s) [upload=282330]: Starting upload Aug 20 00:41:16.718831430 (271h15m38.677928687s) [upload=282330]: Done starting upload Aug 20 00:41:16.719014843 (271h15m38.678112094s) [upload=282330]: Uploading segments... Aug 20 00:41:16.719264159 (271h15m38.678361406s) [upload=282330]: Got next segment. Inline: false Aug 20 00:41:16.719324131 (271h15m38.678421381s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:16.719331094 (271h15m38.678428347s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:41:16.806453266 (271h15m38.765550503s) [upload=282330]: Next segment err: metaclient: Too Many Requests Aug 20 00:41:16.806494321 (271h15m38.765591568s) [upload=282330]: Done uploading segments... Aug 20 00:41:16.806513105 (271h15m38.765610345s) [upload=282330]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.637178781s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [........X...X.X......................X...........X.....X....] duration:
2.580084549s
FAIL (2025-08-20 00:43:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:41:16.718753405 (271h15m38.677850655s) [upload=282330]: Starting upload Aug 20 00:41:16.718831430 (271h15m38.677928687s) [upload=282330]: Done starting upload Aug 20 00:41:16.719014843 (271h15m38.678112094s) [upload=282330]: Uploading segments... Aug 20 00:41:16.719264159 (271h15m38.678361406s) [upload=282330]: Got next segment. Inline: false Aug 20 00:41:16.719324131 (271h15m38.678421381s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:16.719331094 (271h15m38.678428347s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:41:16.806453266 (271h15m38.765550503s) [upload=282330]: Next segment err: metaclient: Too Many Requests Aug 20 00:41:16.806494321 (271h15m38.765591568s) [upload=282330]: Done uploading segments... Aug 20 00:41:16.806513105 (271h15m38.765610345s) [upload=282330]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.580124494s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................................X....X................X.] duration:
967.530423ms
FAIL (2025-08-20 00:43:04 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 20 00:41:59.760613214 (271h16m21.719710465s) [upload=282341]: Starting upload Aug 20 00:41:59.760714840 (271h16m21.719812086s) [upload=282341]: Done starting upload Aug 20 00:41:59.760794811 (271h16m21.719892045s) [upload=282341]: Uploading segments... Aug 20 00:41:59.760896136 (271h16m21.719993384s) [upload=282341]: Got next segment. Inline: true Aug 20 00:41:59.760903763 (271h16m21.720001s) [upload=282341]: Waiting for error group managing segments... Aug 20 00:41:59.760975558 (271h16m21.720072793s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:59.760981083 (271h16m21.720078319s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:41:59.760984685 (271h16m21.720081924s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:42:00.099135797 (271h16m22.058233033s) [upload=282341]: Done uploading segments... Aug 20 00:42:00.099171203 (271h16m22.058268448s) [upload=282341]: Upload finished. err: <nil>
Duration: 967.56326ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.........X...X.X......................X...........X.....X...] duration:
2.481319371s
FAIL (2025-08-20 00:43:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:41:16.718753405 (271h15m38.677850655s) [upload=282330]: Starting upload Aug 20 00:41:16.718831430 (271h15m38.677928687s) [upload=282330]: Done starting upload Aug 20 00:41:16.719014843 (271h15m38.678112094s) [upload=282330]: Uploading segments... Aug 20 00:41:16.719264159 (271h15m38.678361406s) [upload=282330]: Got next segment. Inline: false Aug 20 00:41:16.719324131 (271h15m38.678421381s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:16.719331094 (271h15m38.678428347s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:41:16.806453266 (271h15m38.765550503s) [upload=282330]: Next segment err: metaclient: Too Many Requests Aug 20 00:41:16.806494321 (271h15m38.765591568s) [upload=282330]: Done uploading segments... Aug 20 00:41:16.806513105 (271h15m38.765610345s) [upload=282330]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.481364401s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..........X...X.X......................X...........X.....X..] duration:
2.867482924s
FAIL (2025-08-20 00:42:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:41:16.718753405 (271h15m38.677850655s) [upload=282330]: Starting upload Aug 20 00:41:16.718831430 (271h15m38.677928687s) [upload=282330]: Done starting upload Aug 20 00:41:16.719014843 (271h15m38.678112094s) [upload=282330]: Uploading segments... Aug 20 00:41:16.719264159 (271h15m38.678361406s) [upload=282330]: Got next segment. Inline: false Aug 20 00:41:16.719324131 (271h15m38.678421381s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:16.719331094 (271h15m38.678428347s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:41:16.806453266 (271h15m38.765550503s) [upload=282330]: Next segment err: metaclient: Too Many Requests Aug 20 00:41:16.806494321 (271h15m38.765591568s) [upload=282330]: Done uploading segments... Aug 20 00:41:16.806513105 (271h15m38.765610345s) [upload=282330]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.867526095s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...........X...X.X......................X...........X.....X.] duration:
2.407398712s
FAIL (2025-08-20 00:42:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:41:16.718753405 (271h15m38.677850655s) [upload=282330]: Starting upload Aug 20 00:41:16.718831430 (271h15m38.677928687s) [upload=282330]: Done starting upload Aug 20 00:41:16.719014843 (271h15m38.678112094s) [upload=282330]: Uploading segments... Aug 20 00:41:16.719264159 (271h15m38.678361406s) [upload=282330]: Got next segment. Inline: false Aug 20 00:41:16.719324131 (271h15m38.678421381s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:16.719331094 (271h15m38.678428347s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:41:16.806453266 (271h15m38.765550503s) [upload=282330]: Next segment err: metaclient: Too Many Requests Aug 20 00:41:16.806494321 (271h15m38.765591568s) [upload=282330]: Done uploading segments... Aug 20 00:41:16.806513105 (271h15m38.765610345s) [upload=282330]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.407436913s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................................X....X................X] duration:
817.645803ms
FAIL (2025-08-20 00:42:00 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 20 00:41:59.760613214 (271h16m21.719710465s) [upload=282341]: Starting upload Aug 20 00:41:59.760714840 (271h16m21.719812086s) [upload=282341]: Done starting upload Aug 20 00:41:59.760794811 (271h16m21.719892045s) [upload=282341]: Uploading segments... Aug 20 00:41:59.760896136 (271h16m21.719993384s) [upload=282341]: Got next segment. Inline: true Aug 20 00:41:59.760903763 (271h16m21.720001s) [upload=282341]: Waiting for error group managing segments... Aug 20 00:41:59.760975558 (271h16m21.720072793s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:59.760981083 (271h16m21.720078319s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:41:59.760984685 (271h16m21.720081924s) [upload=282341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:42:00.099135797 (271h16m22.058233033s) [upload=282341]: Done uploading segments... Aug 20 00:42:00.099171203 (271h16m22.058268448s) [upload=282341]: Upload finished. err: <nil>
Duration: 817.681798ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................................X....X................] duration:
870.029176ms
FAIL (2025-08-20 00:41:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:30:38.458774989 (271h5m0.417872238s) [upload=282143]: Starting upload Aug 20 00:30:38.458899922 (271h5m0.417997159s) [upload=282143]: Done starting upload Aug 20 00:30:38.458994542 (271h5m0.418091788s) [upload=282143]: Uploading segments... Aug 20 00:30:38.459089877 (271h5m0.418187122s) [upload=282143]: Got next segment. Inline: true Aug 20 00:30:38.459095351 (271h5m0.418192597s) [upload=282143]: Waiting for error group managing segments... Aug 20 00:30:38.459155079 (271h5m0.418252324s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:30:38.459160277 (271h5m0.418257523s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:30:38.459164346 (271h5m0.41826159s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:30:38.551411507 (271h5m0.510508767s) [upload=282143]: Done uploading segments... Aug 20 00:30:38.551441357 (271h5m0.510538613s) [upload=282143]: Upload finished. err: metaclient: Too Many Requests
Duration: 870.059204ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [............X...X.X......................X...........X.....X] duration:
361.968911ms
FAIL (2025-08-20 00:41:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:41:16.718753405 (271h15m38.677850655s) [upload=282330]: Starting upload Aug 20 00:41:16.718831430 (271h15m38.677928687s) [upload=282330]: Done starting upload Aug 20 00:41:16.719014843 (271h15m38.678112094s) [upload=282330]: Uploading segments... Aug 20 00:41:16.719264159 (271h15m38.678361406s) [upload=282330]: Got next segment. Inline: false Aug 20 00:41:16.719324131 (271h15m38.678421381s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:41:16.719331094 (271h15m38.678428347s) [upload=282330]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:41:16.806453266 (271h15m38.765550503s) [upload=282330]: Next segment err: metaclient: Too Many Requests Aug 20 00:41:16.806494321 (271h15m38.765591568s) [upload=282330]: Done uploading segments... Aug 20 00:41:16.806513105 (271h15m38.765610345s) [upload=282330]: Upload finished. err: metaclient: Too Many Requests
Duration: 361.995215ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X....X...............] duration:
907.384046ms
FAIL (2025-08-20 00:40:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:30:38.458774989 (271h5m0.417872238s) [upload=282143]: Starting upload Aug 20 00:30:38.458899922 (271h5m0.417997159s) [upload=282143]: Done starting upload Aug 20 00:30:38.458994542 (271h5m0.418091788s) [upload=282143]: Uploading segments... Aug 20 00:30:38.459089877 (271h5m0.418187122s) [upload=282143]: Got next segment. Inline: true Aug 20 00:30:38.459095351 (271h5m0.418192597s) [upload=282143]: Waiting for error group managing segments... Aug 20 00:30:38.459155079 (271h5m0.418252324s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:30:38.459160277 (271h5m0.418257523s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:30:38.459164346 (271h5m0.41826159s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:30:38.551411507 (271h5m0.510508767s) [upload=282143]: Done uploading segments... Aug 20 00:30:38.551441357 (271h5m0.510538613s) [upload=282143]: Upload finished. err: metaclient: Too Many Requests
Duration: 907.420536ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.............X...X.X......................X...........X.....] duration:
2.695571934s
FAIL (2025-08-20 00:40:15 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 00:35:35.600457384 (271h9m57.559554619s) [upload=282233]: Starting upload
Aug 20 00:35:35.600521407 (271h9m57.559618644s) [upload=282233]: Done starting upload
Aug 20 00:35:35.600768607 (271h9m57.559865845s) [upload=282233]: Uploading segments...
Aug 20 00:35:35.600845231 (271h9m57.559942485s) [upload=282233]: Got next segment. Inline: false
Aug 20 00:35:35.600880638 (271h9m57.559977883s) [upload=282233]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:35:35.600886239 (271h9m57.559983484s) [upload=282233]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:35:35.844578934 (271h9m57.803676179s) [seg_pos={0 0}, upload=282233]: Begin upload segment...
Aug 20 00:35:35.844652794 (271h9m57.803750042s) [seg_pos={0 0}, upload=282233]: Done begin upload segment.
Aug 20 00:35:35.844701165 (271h9m57.803798416s) [noise=true , address=77.90.31.21:4891 , piece_id=OLTUGRDK6OL25UBG2V75EFEOAWW5ECDPNMCI5F3AMBCMQD7QQFLA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.845327069 (271h9m57.804424325s) [noise=true , address=45.91.116.12:4238 , piece_id=CJPB34UVJ5R2JF55L2ZMQ7XLQWRSIXNH2IKA4NF5X3LJIYX5C35A, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.845748658 (271h9m57.804845906s) [noise=true , address=77.90.31.11:4587 , piece_id=2UZSWTHNM4JF3JFYHKED6LGZIJ5BCMDNM6IDJQSSUC3CM7V5LUZA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.845993820 (271h9m57.8050911s) [noise=true , address=45.91.116.14:4217 , piece_id=LO2BSMMLYQB2MDVKRP3H2BROAL6JLLJBYTRGBZHSMTN7JV5IJXLQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.846119208 (271h9m57.805216457s) [noise=true , address=45.91.116.9:4294 , piece_id=5VXPXLA577WJ2KN4E37Q4EXWXUPJS4W5ERK3X4GARIETNW2E3U3A, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.846392453 (271h9m57.805489689s) [noise=true , address=104.36.82.35:4615 , piece_id=AZ4SWOUFUW7R674HC3UOPPSPFVJYNY3RX6KQDLCJ25ECLPR7AKWQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.846459204 (271h9m57.805556455s) [noise=true , address=104.36.82.9:4039 , piece_id=H7BNNE66EWTFXEBRW2AU4FTQXMGVU7XCZ6OF2XHNTZKE3LI3A4SA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.846690068 (271h9m57.805787316s) [noise=true , address=79.127.205.233:4624 , piece_id=AZDNTPEHVSUE5UY5TXQR6IBCONG7ZT5TNTAKQ7QK3PJOL356BLXA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.846824783 (271h9m57.805922035s) [noise=true , address=77.90.31.19:4846 , piece_id=ZO6R3IGSEC53OPWKBMRCNZ6MT63WK6ARHSYOJNOINQTX7W3PVJAQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.846980920 (271h9m57.806078171s) [noise=true , address=77.90.31.13:4652 , piece_id=DZKHOGL3LPHAQDT2THBQPTXGA5YSLYM47UFKIDSVWFZ3WDARUW4A, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.847176778 (271h9m57.806274026s) [noise=true , address=104.36.82.5:4854 , piece_id=PP2UBAKB6R33X4N3JL3OSVQB4LZHRVXJ6RXJPNS4RANPKHA72IOQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.847266841 (271h9m57.806364075s) [noise=true , address=104.36.82.54:4183 , piece_id=KNJAKR6MKEZGATCTHYW7N4L3TQXIZTDGBQCSD643EJXS5X2YFJEA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.847516744 (271h9m57.806613991s) [noise=true , address=104.36.82.44:4885 , piece_id=BRETW6W3EQ6FVTUCJZVTAOU2WQCU7W67XOZJTIKTHO5KUF6FP5DQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.847573590 (271h9m57.80667084s) [noise=true , address=104.36.82.19:4427 , piece_id=OPP2W2EG3HS6PDLOATXBLG7LZ4YYOVGLWJMKG3X5KGSPRBSJK3TA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.847853150 (271h9m57.806950396s) [noise=true , address=104.36.82.15:4262 , piece_id=LFJGH4BEFA2FTFCWZM3PVVT3FGDI45EHFA4WQGQDRKCJSNRZZ5VQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.847862092 (271h9m57.80695934s) [noise=true , address=104.36.82.14:4236 , piece_id=XKA54QYMVO5EZACYHJAA2YBTUAY4TTKPU5SQNKYH5QFCPOPNSSDQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.848130622 (271h9m57.807227873s) [noise=true , address=77.90.31.12:4614 , piece_id=XZY6OTN2DFWMK64RR4QGPO534ZRLVI23O6WDJ33SZKY2XXNHYLGA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.848366579 (271h9m57.807463824s) [noise=true , address=104.36.82.36:4620 , piece_id=3JS2QDD2IXLDMV5THOEMOBU6VEVNSIDQW7CIUIJHHMLOZ2RMGOXA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:36.401986054 (271h9m58.36108329s) [upload=282233]: Next returned nil segment
Aug 20 00:35:36.402007843 (271h9m58.361105099s) [upload=282233]: Waiting for error group managing segments...
Aug 20 00:35:36.574273182 (271h9m58.533370418s) [noise=true , address=77.90.31.12:4614 , piece_id=XZY6OTN2DFWMK64RR4QGPO534ZRLVI23O6WDJ33SZKY2XXNHYLGA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.588004288 (271h9m58.547101531s) [noise=true , address=104.36.82.35:4615 , piece_id=AZ4SWOUFUW7R674HC3UOPPSPFVJYNY3RX6KQDLCJ25ECLPR7AKWQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.591282444 (271h9m58.55037969s) [noise=true , address=104.36.82.5:4854 , piece_id=PP2UBAKB6R33X4N3JL3OSVQB4LZHRVXJ6RXJPNS4RANPKHA72IOQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.600926247 (271h9m58.560023484s) [noise=true , address=104.36.82.19:4427 , piece_id=OPP2W2EG3HS6PDLOATXBLG7LZ4YYOVGLWJMKG3X5KGSPRBSJK3TA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.608984817 (271h9m58.568082056s) [noise=true , address=104.36.82.54:4183 , piece_id=KNJAKR6MKEZGATCTHYW7N4L3TQXIZTDGBQCSD643EJXS5X2YFJEA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.611438340 (271h9m58.570535573s) [noise=true , address=104.36.82.44:4885 , piece_id=BRETW6W3EQ6FVTUCJZVTAOU2WQCU7W67XOZJTIKTHO5KUF6FP5DQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.615952932 (271h9m58.57505017s) [noise=true , address=104.36.82.9:4039 , piece_id=H7BNNE66EWTFXEBRW2AU4FTQXMGVU7XCZ6OF2XHNTZKE3LI3A4SA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.616692684 (271h9m58.575789922s) [noise=true , address=104.36.82.15:4262 , piece_id=LFJGH4BEFA2FTFCWZM3PVVT3FGDI45EHFA4WQGQDRKCJSNRZZ5VQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.635144854 (271h9m58.594242086s) [noise=true , address=104.36.82.14:4236 , piece_id=XKA54QYMVO5EZACYHJAA2YBTUAY4TTKPU5SQNKYH5QFCPOPNSSDQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.678140617 (271h9m58.637237862s) [noise=true , address=77.90.31.11:4587 , piece_id=2UZSWTHNM4JF3JFYHKED6LGZIJ5BCMDNM6IDJQSSUC3CM7V5LUZA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.683531838 (271h9m58.64262907s) [noise=true , address=104.36.82.36:4620 , piece_id=3JS2QDD2IXLDMV5THOEMOBU6VEVNSIDQW7CIUIJHHMLOZ2RMGOXA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.694805924 (271h9m58.653903157s) [noise=true , address=77.90.31.19:4846 , piece_id=ZO6R3IGSEC53OPWKBMRCNZ6MT63WK6ARHSYOJNOINQTX7W3PVJAQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.697407227 (271h9m58.656504479s) [noise=true , address=45.91.116.9:4294 , piece_id=5VXPXLA577WJ2KN4E37Q4EXWXUPJS4W5ERK3X4GARIETNW2E3U3A, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.704603917 (271h9m58.663701155s) [noise=true , address=45.91.116.12:4238 , piece_id=CJPB34UVJ5R2JF55L2ZMQ7XLQWRSIXNH2IKA4NF5X3LJIYX5C35A, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.704631887 (271h9m58.663729126s) [seg_pos={0 0}, upload=282233]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:35:36.704790050 (271h9m58.663887296s) [noise=true , address=77.90.31.21:4891 , piece_id=OLTUGRDK6OL25UBG2V75EFEOAWW5ECDPNMCI5F3AMBCMQD7QQFLA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17RDAerfx8AW5NsgWLTXLNDbuAEWQFT3SVM4iwdmuBzWrML83g): protocol: expected piece hash; context canceled; EOF
Aug 20 00:35:36.705035473 (271h9m58.664132708s) [noise=true , address=45.91.116.14:4217 , piece_id=LO2BSMMLYQB2MDVKRP3H2BROAL6JLLJBYTRGBZHSMTN7JV5IJXLQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSXWFiq27Dd2vBDD9vVnhDHVG59UmDKn3hVAhf3oyo5goVNaE): protocol: expected piece hash; context canceled; EOF
Aug 20 00:35:36.705373790 (271h9m58.664471037s) [noise=true , address=79.127.205.233:4624 , piece_id=AZDNTPEHVSUE5UY5TXQR6IBCONG7ZT5TNTAKQ7QK3PJOL356BLXA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fD69hzWAhaScaVnRiPMZEFbybabwe1qfRZYfxZtwkFkze9wM4): protocol: write tcp 139.59.144.22:49550->79.127.205.233:4624: use of closed network connection; write tcp 139.59.144.22:49550->79.127.205.233:4624: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49550->79.127.205.233:4624: use of closed network connection
Aug 20 00:35:36.705468173 (271h9m58.664565426s) [noise=true , address=77.90.31.13:4652 , piece_id=DZKHOGL3LPHAQDT2THBQPTXGA5YSLYM47UFKIDSVWFZ3WDARUW4A, seg_pos={0 0}, upload=282233]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KrMw5DoiMSiBHMZJ8Zf8ir7UnTzBwUt9XMhw3Ria6ASGkm3FA): protocol: write tcp 139.59.144.22:46732->77.90.31.13:4652: use of closed network connection; write tcp 139.59.144.22:46732->77.90.31.13:4652: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46732->77.90.31.13:4652: use of closed network connection
Aug 20 00:35:36.705485991 (271h9m58.664583239s) [seg_pos={0 0}, upload=282233]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:35:36.705558099 (271h9m58.664655344s) [upload=282233]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:35:36.705562997 (271h9m58.664660241s) [upload=282233]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:35:36.875951536 (271h9m58.835048848s) [upload=282233]: Done uploading segments...
Aug 20 00:35:36.875976580 (271h9m58.835073836s) [upload=282233]: Upload finished. err: <nil>
Duration: 2.695668955s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................................X....X..............] duration:
835.090627ms
FAIL (2025-08-20 00:40:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:30:38.458774989 (271h5m0.417872238s) [upload=282143]: Starting upload Aug 20 00:30:38.458899922 (271h5m0.417997159s) [upload=282143]: Done starting upload Aug 20 00:30:38.458994542 (271h5m0.418091788s) [upload=282143]: Uploading segments... Aug 20 00:30:38.459089877 (271h5m0.418187122s) [upload=282143]: Got next segment. Inline: true Aug 20 00:30:38.459095351 (271h5m0.418192597s) [upload=282143]: Waiting for error group managing segments... Aug 20 00:30:38.459155079 (271h5m0.418252324s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:30:38.459160277 (271h5m0.418257523s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:30:38.459164346 (271h5m0.41826159s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:30:38.551411507 (271h5m0.510508767s) [upload=282143]: Done uploading segments... Aug 20 00:30:38.551441357 (271h5m0.510538613s) [upload=282143]: Upload finished. err: metaclient: Too Many Requests
Duration: 835.178801ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X....X.............] duration:
919.988575ms
FAIL (2025-08-20 00:39:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:30:38.458774989 (271h5m0.417872238s) [upload=282143]: Starting upload Aug 20 00:30:38.458899922 (271h5m0.417997159s) [upload=282143]: Done starting upload Aug 20 00:30:38.458994542 (271h5m0.418091788s) [upload=282143]: Uploading segments... Aug 20 00:30:38.459089877 (271h5m0.418187122s) [upload=282143]: Got next segment. Inline: true Aug 20 00:30:38.459095351 (271h5m0.418192597s) [upload=282143]: Waiting for error group managing segments... Aug 20 00:30:38.459155079 (271h5m0.418252324s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:30:38.459160277 (271h5m0.418257523s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:30:38.459164346 (271h5m0.41826159s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:30:38.551411507 (271h5m0.510508767s) [upload=282143]: Done uploading segments... Aug 20 00:30:38.551441357 (271h5m0.510538613s) [upload=282143]: Upload finished. err: metaclient: Too Many Requests
Duration: 920.023728ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..............X...X.X......................X...........X....] duration:
2.41060395s
FAIL (2025-08-20 00:39:17 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 00:35:35.600457384 (271h9m57.559554619s) [upload=282233]: Starting upload
Aug 20 00:35:35.600521407 (271h9m57.559618644s) [upload=282233]: Done starting upload
Aug 20 00:35:35.600768607 (271h9m57.559865845s) [upload=282233]: Uploading segments...
Aug 20 00:35:35.600845231 (271h9m57.559942485s) [upload=282233]: Got next segment. Inline: false
Aug 20 00:35:35.600880638 (271h9m57.559977883s) [upload=282233]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:35:35.600886239 (271h9m57.559983484s) [upload=282233]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:35:35.844578934 (271h9m57.803676179s) [seg_pos={0 0}, upload=282233]: Begin upload segment...
Aug 20 00:35:35.844652794 (271h9m57.803750042s) [seg_pos={0 0}, upload=282233]: Done begin upload segment.
Aug 20 00:35:35.844701165 (271h9m57.803798416s) [noise=true , address=77.90.31.21:4891 , piece_id=OLTUGRDK6OL25UBG2V75EFEOAWW5ECDPNMCI5F3AMBCMQD7QQFLA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.845327069 (271h9m57.804424325s) [noise=true , address=45.91.116.12:4238 , piece_id=CJPB34UVJ5R2JF55L2ZMQ7XLQWRSIXNH2IKA4NF5X3LJIYX5C35A, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.845748658 (271h9m57.804845906s) [noise=true , address=77.90.31.11:4587 , piece_id=2UZSWTHNM4JF3JFYHKED6LGZIJ5BCMDNM6IDJQSSUC3CM7V5LUZA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.845993820 (271h9m57.8050911s) [noise=true , address=45.91.116.14:4217 , piece_id=LO2BSMMLYQB2MDVKRP3H2BROAL6JLLJBYTRGBZHSMTN7JV5IJXLQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.846119208 (271h9m57.805216457s) [noise=true , address=45.91.116.9:4294 , piece_id=5VXPXLA577WJ2KN4E37Q4EXWXUPJS4W5ERK3X4GARIETNW2E3U3A, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.846392453 (271h9m57.805489689s) [noise=true , address=104.36.82.35:4615 , piece_id=AZ4SWOUFUW7R674HC3UOPPSPFVJYNY3RX6KQDLCJ25ECLPR7AKWQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.846459204 (271h9m57.805556455s) [noise=true , address=104.36.82.9:4039 , piece_id=H7BNNE66EWTFXEBRW2AU4FTQXMGVU7XCZ6OF2XHNTZKE3LI3A4SA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.846690068 (271h9m57.805787316s) [noise=true , address=79.127.205.233:4624 , piece_id=AZDNTPEHVSUE5UY5TXQR6IBCONG7ZT5TNTAKQ7QK3PJOL356BLXA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.846824783 (271h9m57.805922035s) [noise=true , address=77.90.31.19:4846 , piece_id=ZO6R3IGSEC53OPWKBMRCNZ6MT63WK6ARHSYOJNOINQTX7W3PVJAQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.846980920 (271h9m57.806078171s) [noise=true , address=77.90.31.13:4652 , piece_id=DZKHOGL3LPHAQDT2THBQPTXGA5YSLYM47UFKIDSVWFZ3WDARUW4A, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.847176778 (271h9m57.806274026s) [noise=true , address=104.36.82.5:4854 , piece_id=PP2UBAKB6R33X4N3JL3OSVQB4LZHRVXJ6RXJPNS4RANPKHA72IOQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.847266841 (271h9m57.806364075s) [noise=true , address=104.36.82.54:4183 , piece_id=KNJAKR6MKEZGATCTHYW7N4L3TQXIZTDGBQCSD643EJXS5X2YFJEA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.847516744 (271h9m57.806613991s) [noise=true , address=104.36.82.44:4885 , piece_id=BRETW6W3EQ6FVTUCJZVTAOU2WQCU7W67XOZJTIKTHO5KUF6FP5DQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.847573590 (271h9m57.80667084s) [noise=true , address=104.36.82.19:4427 , piece_id=OPP2W2EG3HS6PDLOATXBLG7LZ4YYOVGLWJMKG3X5KGSPRBSJK3TA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.847853150 (271h9m57.806950396s) [noise=true , address=104.36.82.15:4262 , piece_id=LFJGH4BEFA2FTFCWZM3PVVT3FGDI45EHFA4WQGQDRKCJSNRZZ5VQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.847862092 (271h9m57.80695934s) [noise=true , address=104.36.82.14:4236 , piece_id=XKA54QYMVO5EZACYHJAA2YBTUAY4TTKPU5SQNKYH5QFCPOPNSSDQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.848130622 (271h9m57.807227873s) [noise=true , address=77.90.31.12:4614 , piece_id=XZY6OTN2DFWMK64RR4QGPO534ZRLVI23O6WDJ33SZKY2XXNHYLGA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.848366579 (271h9m57.807463824s) [noise=true , address=104.36.82.36:4620 , piece_id=3JS2QDD2IXLDMV5THOEMOBU6VEVNSIDQW7CIUIJHHMLOZ2RMGOXA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:36.401986054 (271h9m58.36108329s) [upload=282233]: Next returned nil segment
Aug 20 00:35:36.402007843 (271h9m58.361105099s) [upload=282233]: Waiting for error group managing segments...
Aug 20 00:35:36.574273182 (271h9m58.533370418s) [noise=true , address=77.90.31.12:4614 , piece_id=XZY6OTN2DFWMK64RR4QGPO534ZRLVI23O6WDJ33SZKY2XXNHYLGA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.588004288 (271h9m58.547101531s) [noise=true , address=104.36.82.35:4615 , piece_id=AZ4SWOUFUW7R674HC3UOPPSPFVJYNY3RX6KQDLCJ25ECLPR7AKWQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.591282444 (271h9m58.55037969s) [noise=true , address=104.36.82.5:4854 , piece_id=PP2UBAKB6R33X4N3JL3OSVQB4LZHRVXJ6RXJPNS4RANPKHA72IOQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.600926247 (271h9m58.560023484s) [noise=true , address=104.36.82.19:4427 , piece_id=OPP2W2EG3HS6PDLOATXBLG7LZ4YYOVGLWJMKG3X5KGSPRBSJK3TA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.608984817 (271h9m58.568082056s) [noise=true , address=104.36.82.54:4183 , piece_id=KNJAKR6MKEZGATCTHYW7N4L3TQXIZTDGBQCSD643EJXS5X2YFJEA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.611438340 (271h9m58.570535573s) [noise=true , address=104.36.82.44:4885 , piece_id=BRETW6W3EQ6FVTUCJZVTAOU2WQCU7W67XOZJTIKTHO5KUF6FP5DQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.615952932 (271h9m58.57505017s) [noise=true , address=104.36.82.9:4039 , piece_id=H7BNNE66EWTFXEBRW2AU4FTQXMGVU7XCZ6OF2XHNTZKE3LI3A4SA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.616692684 (271h9m58.575789922s) [noise=true , address=104.36.82.15:4262 , piece_id=LFJGH4BEFA2FTFCWZM3PVVT3FGDI45EHFA4WQGQDRKCJSNRZZ5VQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.635144854 (271h9m58.594242086s) [noise=true , address=104.36.82.14:4236 , piece_id=XKA54QYMVO5EZACYHJAA2YBTUAY4TTKPU5SQNKYH5QFCPOPNSSDQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.678140617 (271h9m58.637237862s) [noise=true , address=77.90.31.11:4587 , piece_id=2UZSWTHNM4JF3JFYHKED6LGZIJ5BCMDNM6IDJQSSUC3CM7V5LUZA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.683531838 (271h9m58.64262907s) [noise=true , address=104.36.82.36:4620 , piece_id=3JS2QDD2IXLDMV5THOEMOBU6VEVNSIDQW7CIUIJHHMLOZ2RMGOXA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.694805924 (271h9m58.653903157s) [noise=true , address=77.90.31.19:4846 , piece_id=ZO6R3IGSEC53OPWKBMRCNZ6MT63WK6ARHSYOJNOINQTX7W3PVJAQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.697407227 (271h9m58.656504479s) [noise=true , address=45.91.116.9:4294 , piece_id=5VXPXLA577WJ2KN4E37Q4EXWXUPJS4W5ERK3X4GARIETNW2E3U3A, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.704603917 (271h9m58.663701155s) [noise=true , address=45.91.116.12:4238 , piece_id=CJPB34UVJ5R2JF55L2ZMQ7XLQWRSIXNH2IKA4NF5X3LJIYX5C35A, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.704631887 (271h9m58.663729126s) [seg_pos={0 0}, upload=282233]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:35:36.704790050 (271h9m58.663887296s) [noise=true , address=77.90.31.21:4891 , piece_id=OLTUGRDK6OL25UBG2V75EFEOAWW5ECDPNMCI5F3AMBCMQD7QQFLA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17RDAerfx8AW5NsgWLTXLNDbuAEWQFT3SVM4iwdmuBzWrML83g): protocol: expected piece hash; context canceled; EOF
Aug 20 00:35:36.705035473 (271h9m58.664132708s) [noise=true , address=45.91.116.14:4217 , piece_id=LO2BSMMLYQB2MDVKRP3H2BROAL6JLLJBYTRGBZHSMTN7JV5IJXLQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSXWFiq27Dd2vBDD9vVnhDHVG59UmDKn3hVAhf3oyo5goVNaE): protocol: expected piece hash; context canceled; EOF
Aug 20 00:35:36.705373790 (271h9m58.664471037s) [noise=true , address=79.127.205.233:4624 , piece_id=AZDNTPEHVSUE5UY5TXQR6IBCONG7ZT5TNTAKQ7QK3PJOL356BLXA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fD69hzWAhaScaVnRiPMZEFbybabwe1qfRZYfxZtwkFkze9wM4): protocol: write tcp 139.59.144.22:49550->79.127.205.233:4624: use of closed network connection; write tcp 139.59.144.22:49550->79.127.205.233:4624: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49550->79.127.205.233:4624: use of closed network connection
Aug 20 00:35:36.705468173 (271h9m58.664565426s) [noise=true , address=77.90.31.13:4652 , piece_id=DZKHOGL3LPHAQDT2THBQPTXGA5YSLYM47UFKIDSVWFZ3WDARUW4A, seg_pos={0 0}, upload=282233]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KrMw5DoiMSiBHMZJ8Zf8ir7UnTzBwUt9XMhw3Ria6ASGkm3FA): protocol: write tcp 139.59.144.22:46732->77.90.31.13:4652: use of closed network connection; write tcp 139.59.144.22:46732->77.90.31.13:4652: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46732->77.90.31.13:4652: use of closed network connection
Aug 20 00:35:36.705485991 (271h9m58.664583239s) [seg_pos={0 0}, upload=282233]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:35:36.705558099 (271h9m58.664655344s) [upload=282233]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:35:36.705562997 (271h9m58.664660241s) [upload=282233]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:35:36.875951536 (271h9m58.835048848s) [upload=282233]: Done uploading segments...
Aug 20 00:35:36.875976580 (271h9m58.835073836s) [upload=282233]: Upload finished. err: <nil>
Duration: 2.410634914s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X....X............] duration:
894.40757ms
FAIL (2025-08-20 00:39:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:30:38.458774989 (271h5m0.417872238s) [upload=282143]: Starting upload Aug 20 00:30:38.458899922 (271h5m0.417997159s) [upload=282143]: Done starting upload Aug 20 00:30:38.458994542 (271h5m0.418091788s) [upload=282143]: Uploading segments... Aug 20 00:30:38.459089877 (271h5m0.418187122s) [upload=282143]: Got next segment. Inline: true Aug 20 00:30:38.459095351 (271h5m0.418192597s) [upload=282143]: Waiting for error group managing segments... Aug 20 00:30:38.459155079 (271h5m0.418252324s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:30:38.459160277 (271h5m0.418257523s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:30:38.459164346 (271h5m0.41826159s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:30:38.551411507 (271h5m0.510508767s) [upload=282143]: Done uploading segments... Aug 20 00:30:38.551441357 (271h5m0.510538613s) [upload=282143]: Upload finished. err: metaclient: Too Many Requests
Duration: 894.44059ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X....X...........] duration:
899.434566ms
FAIL (2025-08-20 00:38:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:30:38.458774989 (271h5m0.417872238s) [upload=282143]: Starting upload Aug 20 00:30:38.458899922 (271h5m0.417997159s) [upload=282143]: Done starting upload Aug 20 00:30:38.458994542 (271h5m0.418091788s) [upload=282143]: Uploading segments... Aug 20 00:30:38.459089877 (271h5m0.418187122s) [upload=282143]: Got next segment. Inline: true Aug 20 00:30:38.459095351 (271h5m0.418192597s) [upload=282143]: Waiting for error group managing segments... Aug 20 00:30:38.459155079 (271h5m0.418252324s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:30:38.459160277 (271h5m0.418257523s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:30:38.459164346 (271h5m0.41826159s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:30:38.551411507 (271h5m0.510508767s) [upload=282143]: Done uploading segments... Aug 20 00:30:38.551441357 (271h5m0.510538613s) [upload=282143]: Upload finished. err: metaclient: Too Many Requests
Duration: 899.486204ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................................X....X..........] duration:
906.999519ms
FAIL (2025-08-20 00:38:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:30:38.458774989 (271h5m0.417872238s) [upload=282143]: Starting upload Aug 20 00:30:38.458899922 (271h5m0.417997159s) [upload=282143]: Done starting upload Aug 20 00:30:38.458994542 (271h5m0.418091788s) [upload=282143]: Uploading segments... Aug 20 00:30:38.459089877 (271h5m0.418187122s) [upload=282143]: Got next segment. Inline: true Aug 20 00:30:38.459095351 (271h5m0.418192597s) [upload=282143]: Waiting for error group managing segments... Aug 20 00:30:38.459155079 (271h5m0.418252324s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:30:38.459160277 (271h5m0.418257523s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:30:38.459164346 (271h5m0.41826159s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:30:38.551411507 (271h5m0.510508767s) [upload=282143]: Done uploading segments... Aug 20 00:30:38.551441357 (271h5m0.510538613s) [upload=282143]: Upload finished. err: metaclient: Too Many Requests
Duration: 907.027675ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...............X...X.X......................X...........X...] duration:
2.856850963s
FAIL (2025-08-20 00:38:14 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 00:35:35.600457384 (271h9m57.559554619s) [upload=282233]: Starting upload
Aug 20 00:35:35.600521407 (271h9m57.559618644s) [upload=282233]: Done starting upload
Aug 20 00:35:35.600768607 (271h9m57.559865845s) [upload=282233]: Uploading segments...
Aug 20 00:35:35.600845231 (271h9m57.559942485s) [upload=282233]: Got next segment. Inline: false
Aug 20 00:35:35.600880638 (271h9m57.559977883s) [upload=282233]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:35:35.600886239 (271h9m57.559983484s) [upload=282233]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:35:35.844578934 (271h9m57.803676179s) [seg_pos={0 0}, upload=282233]: Begin upload segment...
Aug 20 00:35:35.844652794 (271h9m57.803750042s) [seg_pos={0 0}, upload=282233]: Done begin upload segment.
Aug 20 00:35:35.844701165 (271h9m57.803798416s) [noise=true , address=77.90.31.21:4891 , piece_id=OLTUGRDK6OL25UBG2V75EFEOAWW5ECDPNMCI5F3AMBCMQD7QQFLA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.845327069 (271h9m57.804424325s) [noise=true , address=45.91.116.12:4238 , piece_id=CJPB34UVJ5R2JF55L2ZMQ7XLQWRSIXNH2IKA4NF5X3LJIYX5C35A, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.845748658 (271h9m57.804845906s) [noise=true , address=77.90.31.11:4587 , piece_id=2UZSWTHNM4JF3JFYHKED6LGZIJ5BCMDNM6IDJQSSUC3CM7V5LUZA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.845993820 (271h9m57.8050911s) [noise=true , address=45.91.116.14:4217 , piece_id=LO2BSMMLYQB2MDVKRP3H2BROAL6JLLJBYTRGBZHSMTN7JV5IJXLQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.846119208 (271h9m57.805216457s) [noise=true , address=45.91.116.9:4294 , piece_id=5VXPXLA577WJ2KN4E37Q4EXWXUPJS4W5ERK3X4GARIETNW2E3U3A, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.846392453 (271h9m57.805489689s) [noise=true , address=104.36.82.35:4615 , piece_id=AZ4SWOUFUW7R674HC3UOPPSPFVJYNY3RX6KQDLCJ25ECLPR7AKWQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.846459204 (271h9m57.805556455s) [noise=true , address=104.36.82.9:4039 , piece_id=H7BNNE66EWTFXEBRW2AU4FTQXMGVU7XCZ6OF2XHNTZKE3LI3A4SA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.846690068 (271h9m57.805787316s) [noise=true , address=79.127.205.233:4624 , piece_id=AZDNTPEHVSUE5UY5TXQR6IBCONG7ZT5TNTAKQ7QK3PJOL356BLXA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.846824783 (271h9m57.805922035s) [noise=true , address=77.90.31.19:4846 , piece_id=ZO6R3IGSEC53OPWKBMRCNZ6MT63WK6ARHSYOJNOINQTX7W3PVJAQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.846980920 (271h9m57.806078171s) [noise=true , address=77.90.31.13:4652 , piece_id=DZKHOGL3LPHAQDT2THBQPTXGA5YSLYM47UFKIDSVWFZ3WDARUW4A, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.847176778 (271h9m57.806274026s) [noise=true , address=104.36.82.5:4854 , piece_id=PP2UBAKB6R33X4N3JL3OSVQB4LZHRVXJ6RXJPNS4RANPKHA72IOQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.847266841 (271h9m57.806364075s) [noise=true , address=104.36.82.54:4183 , piece_id=KNJAKR6MKEZGATCTHYW7N4L3TQXIZTDGBQCSD643EJXS5X2YFJEA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.847516744 (271h9m57.806613991s) [noise=true , address=104.36.82.44:4885 , piece_id=BRETW6W3EQ6FVTUCJZVTAOU2WQCU7W67XOZJTIKTHO5KUF6FP5DQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.847573590 (271h9m57.80667084s) [noise=true , address=104.36.82.19:4427 , piece_id=OPP2W2EG3HS6PDLOATXBLG7LZ4YYOVGLWJMKG3X5KGSPRBSJK3TA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.847853150 (271h9m57.806950396s) [noise=true , address=104.36.82.15:4262 , piece_id=LFJGH4BEFA2FTFCWZM3PVVT3FGDI45EHFA4WQGQDRKCJSNRZZ5VQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.847862092 (271h9m57.80695934s) [noise=true , address=104.36.82.14:4236 , piece_id=XKA54QYMVO5EZACYHJAA2YBTUAY4TTKPU5SQNKYH5QFCPOPNSSDQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.848130622 (271h9m57.807227873s) [noise=true , address=77.90.31.12:4614 , piece_id=XZY6OTN2DFWMK64RR4QGPO534ZRLVI23O6WDJ33SZKY2XXNHYLGA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.848366579 (271h9m57.807463824s) [noise=true , address=104.36.82.36:4620 , piece_id=3JS2QDD2IXLDMV5THOEMOBU6VEVNSIDQW7CIUIJHHMLOZ2RMGOXA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:36.401986054 (271h9m58.36108329s) [upload=282233]: Next returned nil segment
Aug 20 00:35:36.402007843 (271h9m58.361105099s) [upload=282233]: Waiting for error group managing segments...
Aug 20 00:35:36.574273182 (271h9m58.533370418s) [noise=true , address=77.90.31.12:4614 , piece_id=XZY6OTN2DFWMK64RR4QGPO534ZRLVI23O6WDJ33SZKY2XXNHYLGA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.588004288 (271h9m58.547101531s) [noise=true , address=104.36.82.35:4615 , piece_id=AZ4SWOUFUW7R674HC3UOPPSPFVJYNY3RX6KQDLCJ25ECLPR7AKWQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.591282444 (271h9m58.55037969s) [noise=true , address=104.36.82.5:4854 , piece_id=PP2UBAKB6R33X4N3JL3OSVQB4LZHRVXJ6RXJPNS4RANPKHA72IOQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.600926247 (271h9m58.560023484s) [noise=true , address=104.36.82.19:4427 , piece_id=OPP2W2EG3HS6PDLOATXBLG7LZ4YYOVGLWJMKG3X5KGSPRBSJK3TA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.608984817 (271h9m58.568082056s) [noise=true , address=104.36.82.54:4183 , piece_id=KNJAKR6MKEZGATCTHYW7N4L3TQXIZTDGBQCSD643EJXS5X2YFJEA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.611438340 (271h9m58.570535573s) [noise=true , address=104.36.82.44:4885 , piece_id=BRETW6W3EQ6FVTUCJZVTAOU2WQCU7W67XOZJTIKTHO5KUF6FP5DQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.615952932 (271h9m58.57505017s) [noise=true , address=104.36.82.9:4039 , piece_id=H7BNNE66EWTFXEBRW2AU4FTQXMGVU7XCZ6OF2XHNTZKE3LI3A4SA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.616692684 (271h9m58.575789922s) [noise=true , address=104.36.82.15:4262 , piece_id=LFJGH4BEFA2FTFCWZM3PVVT3FGDI45EHFA4WQGQDRKCJSNRZZ5VQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.635144854 (271h9m58.594242086s) [noise=true , address=104.36.82.14:4236 , piece_id=XKA54QYMVO5EZACYHJAA2YBTUAY4TTKPU5SQNKYH5QFCPOPNSSDQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.678140617 (271h9m58.637237862s) [noise=true , address=77.90.31.11:4587 , piece_id=2UZSWTHNM4JF3JFYHKED6LGZIJ5BCMDNM6IDJQSSUC3CM7V5LUZA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.683531838 (271h9m58.64262907s) [noise=true , address=104.36.82.36:4620 , piece_id=3JS2QDD2IXLDMV5THOEMOBU6VEVNSIDQW7CIUIJHHMLOZ2RMGOXA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.694805924 (271h9m58.653903157s) [noise=true , address=77.90.31.19:4846 , piece_id=ZO6R3IGSEC53OPWKBMRCNZ6MT63WK6ARHSYOJNOINQTX7W3PVJAQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.697407227 (271h9m58.656504479s) [noise=true , address=45.91.116.9:4294 , piece_id=5VXPXLA577WJ2KN4E37Q4EXWXUPJS4W5ERK3X4GARIETNW2E3U3A, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.704603917 (271h9m58.663701155s) [noise=true , address=45.91.116.12:4238 , piece_id=CJPB34UVJ5R2JF55L2ZMQ7XLQWRSIXNH2IKA4NF5X3LJIYX5C35A, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.704631887 (271h9m58.663729126s) [seg_pos={0 0}, upload=282233]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:35:36.704790050 (271h9m58.663887296s) [noise=true , address=77.90.31.21:4891 , piece_id=OLTUGRDK6OL25UBG2V75EFEOAWW5ECDPNMCI5F3AMBCMQD7QQFLA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17RDAerfx8AW5NsgWLTXLNDbuAEWQFT3SVM4iwdmuBzWrML83g): protocol: expected piece hash; context canceled; EOF
Aug 20 00:35:36.705035473 (271h9m58.664132708s) [noise=true , address=45.91.116.14:4217 , piece_id=LO2BSMMLYQB2MDVKRP3H2BROAL6JLLJBYTRGBZHSMTN7JV5IJXLQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSXWFiq27Dd2vBDD9vVnhDHVG59UmDKn3hVAhf3oyo5goVNaE): protocol: expected piece hash; context canceled; EOF
Aug 20 00:35:36.705373790 (271h9m58.664471037s) [noise=true , address=79.127.205.233:4624 , piece_id=AZDNTPEHVSUE5UY5TXQR6IBCONG7ZT5TNTAKQ7QK3PJOL356BLXA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fD69hzWAhaScaVnRiPMZEFbybabwe1qfRZYfxZtwkFkze9wM4): protocol: write tcp 139.59.144.22:49550->79.127.205.233:4624: use of closed network connection; write tcp 139.59.144.22:49550->79.127.205.233:4624: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49550->79.127.205.233:4624: use of closed network connection
Aug 20 00:35:36.705468173 (271h9m58.664565426s) [noise=true , address=77.90.31.13:4652 , piece_id=DZKHOGL3LPHAQDT2THBQPTXGA5YSLYM47UFKIDSVWFZ3WDARUW4A, seg_pos={0 0}, upload=282233]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KrMw5DoiMSiBHMZJ8Zf8ir7UnTzBwUt9XMhw3Ria6ASGkm3FA): protocol: write tcp 139.59.144.22:46732->77.90.31.13:4652: use of closed network connection; write tcp 139.59.144.22:46732->77.90.31.13:4652: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46732->77.90.31.13:4652: use of closed network connection
Aug 20 00:35:36.705485991 (271h9m58.664583239s) [seg_pos={0 0}, upload=282233]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:35:36.705558099 (271h9m58.664655344s) [upload=282233]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:35:36.705562997 (271h9m58.664660241s) [upload=282233]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:35:36.875951536 (271h9m58.835048848s) [upload=282233]: Done uploading segments...
Aug 20 00:35:36.875976580 (271h9m58.835073836s) [upload=282233]: Upload finished. err: <nil>
Duration: 2.856880564s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................................X....X.........] duration:
1.055339704s
FAIL (2025-08-20 00:37:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:30:38.458774989 (271h5m0.417872238s) [upload=282143]: Starting upload Aug 20 00:30:38.458899922 (271h5m0.417997159s) [upload=282143]: Done starting upload Aug 20 00:30:38.458994542 (271h5m0.418091788s) [upload=282143]: Uploading segments... Aug 20 00:30:38.459089877 (271h5m0.418187122s) [upload=282143]: Got next segment. Inline: true Aug 20 00:30:38.459095351 (271h5m0.418192597s) [upload=282143]: Waiting for error group managing segments... Aug 20 00:30:38.459155079 (271h5m0.418252324s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:30:38.459160277 (271h5m0.418257523s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:30:38.459164346 (271h5m0.41826159s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:30:38.551411507 (271h5m0.510508767s) [upload=282143]: Done uploading segments... Aug 20 00:30:38.551441357 (271h5m0.510538613s) [upload=282143]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.055365867s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [................X...X.X......................X...........X..] duration:
2.638400003s
FAIL (2025-08-20 00:37:37 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 00:35:35.600457384 (271h9m57.559554619s) [upload=282233]: Starting upload
Aug 20 00:35:35.600521407 (271h9m57.559618644s) [upload=282233]: Done starting upload
Aug 20 00:35:35.600768607 (271h9m57.559865845s) [upload=282233]: Uploading segments...
Aug 20 00:35:35.600845231 (271h9m57.559942485s) [upload=282233]: Got next segment. Inline: false
Aug 20 00:35:35.600880638 (271h9m57.559977883s) [upload=282233]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:35:35.600886239 (271h9m57.559983484s) [upload=282233]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:35:35.844578934 (271h9m57.803676179s) [seg_pos={0 0}, upload=282233]: Begin upload segment...
Aug 20 00:35:35.844652794 (271h9m57.803750042s) [seg_pos={0 0}, upload=282233]: Done begin upload segment.
Aug 20 00:35:35.844701165 (271h9m57.803798416s) [noise=true , address=77.90.31.21:4891 , piece_id=OLTUGRDK6OL25UBG2V75EFEOAWW5ECDPNMCI5F3AMBCMQD7QQFLA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.845327069 (271h9m57.804424325s) [noise=true , address=45.91.116.12:4238 , piece_id=CJPB34UVJ5R2JF55L2ZMQ7XLQWRSIXNH2IKA4NF5X3LJIYX5C35A, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.845748658 (271h9m57.804845906s) [noise=true , address=77.90.31.11:4587 , piece_id=2UZSWTHNM4JF3JFYHKED6LGZIJ5BCMDNM6IDJQSSUC3CM7V5LUZA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.845993820 (271h9m57.8050911s) [noise=true , address=45.91.116.14:4217 , piece_id=LO2BSMMLYQB2MDVKRP3H2BROAL6JLLJBYTRGBZHSMTN7JV5IJXLQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.846119208 (271h9m57.805216457s) [noise=true , address=45.91.116.9:4294 , piece_id=5VXPXLA577WJ2KN4E37Q4EXWXUPJS4W5ERK3X4GARIETNW2E3U3A, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.846392453 (271h9m57.805489689s) [noise=true , address=104.36.82.35:4615 , piece_id=AZ4SWOUFUW7R674HC3UOPPSPFVJYNY3RX6KQDLCJ25ECLPR7AKWQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.846459204 (271h9m57.805556455s) [noise=true , address=104.36.82.9:4039 , piece_id=H7BNNE66EWTFXEBRW2AU4FTQXMGVU7XCZ6OF2XHNTZKE3LI3A4SA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.846690068 (271h9m57.805787316s) [noise=true , address=79.127.205.233:4624 , piece_id=AZDNTPEHVSUE5UY5TXQR6IBCONG7ZT5TNTAKQ7QK3PJOL356BLXA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.846824783 (271h9m57.805922035s) [noise=true , address=77.90.31.19:4846 , piece_id=ZO6R3IGSEC53OPWKBMRCNZ6MT63WK6ARHSYOJNOINQTX7W3PVJAQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.846980920 (271h9m57.806078171s) [noise=true , address=77.90.31.13:4652 , piece_id=DZKHOGL3LPHAQDT2THBQPTXGA5YSLYM47UFKIDSVWFZ3WDARUW4A, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.847176778 (271h9m57.806274026s) [noise=true , address=104.36.82.5:4854 , piece_id=PP2UBAKB6R33X4N3JL3OSVQB4LZHRVXJ6RXJPNS4RANPKHA72IOQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.847266841 (271h9m57.806364075s) [noise=true , address=104.36.82.54:4183 , piece_id=KNJAKR6MKEZGATCTHYW7N4L3TQXIZTDGBQCSD643EJXS5X2YFJEA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.847516744 (271h9m57.806613991s) [noise=true , address=104.36.82.44:4885 , piece_id=BRETW6W3EQ6FVTUCJZVTAOU2WQCU7W67XOZJTIKTHO5KUF6FP5DQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.847573590 (271h9m57.80667084s) [noise=true , address=104.36.82.19:4427 , piece_id=OPP2W2EG3HS6PDLOATXBLG7LZ4YYOVGLWJMKG3X5KGSPRBSJK3TA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.847853150 (271h9m57.806950396s) [noise=true , address=104.36.82.15:4262 , piece_id=LFJGH4BEFA2FTFCWZM3PVVT3FGDI45EHFA4WQGQDRKCJSNRZZ5VQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.847862092 (271h9m57.80695934s) [noise=true , address=104.36.82.14:4236 , piece_id=XKA54QYMVO5EZACYHJAA2YBTUAY4TTKPU5SQNKYH5QFCPOPNSSDQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.848130622 (271h9m57.807227873s) [noise=true , address=77.90.31.12:4614 , piece_id=XZY6OTN2DFWMK64RR4QGPO534ZRLVI23O6WDJ33SZKY2XXNHYLGA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.848366579 (271h9m57.807463824s) [noise=true , address=104.36.82.36:4620 , piece_id=3JS2QDD2IXLDMV5THOEMOBU6VEVNSIDQW7CIUIJHHMLOZ2RMGOXA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:36.401986054 (271h9m58.36108329s) [upload=282233]: Next returned nil segment
Aug 20 00:35:36.402007843 (271h9m58.361105099s) [upload=282233]: Waiting for error group managing segments...
Aug 20 00:35:36.574273182 (271h9m58.533370418s) [noise=true , address=77.90.31.12:4614 , piece_id=XZY6OTN2DFWMK64RR4QGPO534ZRLVI23O6WDJ33SZKY2XXNHYLGA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.588004288 (271h9m58.547101531s) [noise=true , address=104.36.82.35:4615 , piece_id=AZ4SWOUFUW7R674HC3UOPPSPFVJYNY3RX6KQDLCJ25ECLPR7AKWQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.591282444 (271h9m58.55037969s) [noise=true , address=104.36.82.5:4854 , piece_id=PP2UBAKB6R33X4N3JL3OSVQB4LZHRVXJ6RXJPNS4RANPKHA72IOQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.600926247 (271h9m58.560023484s) [noise=true , address=104.36.82.19:4427 , piece_id=OPP2W2EG3HS6PDLOATXBLG7LZ4YYOVGLWJMKG3X5KGSPRBSJK3TA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.608984817 (271h9m58.568082056s) [noise=true , address=104.36.82.54:4183 , piece_id=KNJAKR6MKEZGATCTHYW7N4L3TQXIZTDGBQCSD643EJXS5X2YFJEA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.611438340 (271h9m58.570535573s) [noise=true , address=104.36.82.44:4885 , piece_id=BRETW6W3EQ6FVTUCJZVTAOU2WQCU7W67XOZJTIKTHO5KUF6FP5DQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.615952932 (271h9m58.57505017s) [noise=true , address=104.36.82.9:4039 , piece_id=H7BNNE66EWTFXEBRW2AU4FTQXMGVU7XCZ6OF2XHNTZKE3LI3A4SA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.616692684 (271h9m58.575789922s) [noise=true , address=104.36.82.15:4262 , piece_id=LFJGH4BEFA2FTFCWZM3PVVT3FGDI45EHFA4WQGQDRKCJSNRZZ5VQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.635144854 (271h9m58.594242086s) [noise=true , address=104.36.82.14:4236 , piece_id=XKA54QYMVO5EZACYHJAA2YBTUAY4TTKPU5SQNKYH5QFCPOPNSSDQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.678140617 (271h9m58.637237862s) [noise=true , address=77.90.31.11:4587 , piece_id=2UZSWTHNM4JF3JFYHKED6LGZIJ5BCMDNM6IDJQSSUC3CM7V5LUZA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.683531838 (271h9m58.64262907s) [noise=true , address=104.36.82.36:4620 , piece_id=3JS2QDD2IXLDMV5THOEMOBU6VEVNSIDQW7CIUIJHHMLOZ2RMGOXA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.694805924 (271h9m58.653903157s) [noise=true , address=77.90.31.19:4846 , piece_id=ZO6R3IGSEC53OPWKBMRCNZ6MT63WK6ARHSYOJNOINQTX7W3PVJAQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.697407227 (271h9m58.656504479s) [noise=true , address=45.91.116.9:4294 , piece_id=5VXPXLA577WJ2KN4E37Q4EXWXUPJS4W5ERK3X4GARIETNW2E3U3A, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.704603917 (271h9m58.663701155s) [noise=true , address=45.91.116.12:4238 , piece_id=CJPB34UVJ5R2JF55L2ZMQ7XLQWRSIXNH2IKA4NF5X3LJIYX5C35A, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.704631887 (271h9m58.663729126s) [seg_pos={0 0}, upload=282233]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:35:36.704790050 (271h9m58.663887296s) [noise=true , address=77.90.31.21:4891 , piece_id=OLTUGRDK6OL25UBG2V75EFEOAWW5ECDPNMCI5F3AMBCMQD7QQFLA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17RDAerfx8AW5NsgWLTXLNDbuAEWQFT3SVM4iwdmuBzWrML83g): protocol: expected piece hash; context canceled; EOF
Aug 20 00:35:36.705035473 (271h9m58.664132708s) [noise=true , address=45.91.116.14:4217 , piece_id=LO2BSMMLYQB2MDVKRP3H2BROAL6JLLJBYTRGBZHSMTN7JV5IJXLQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSXWFiq27Dd2vBDD9vVnhDHVG59UmDKn3hVAhf3oyo5goVNaE): protocol: expected piece hash; context canceled; EOF
Aug 20 00:35:36.705373790 (271h9m58.664471037s) [noise=true , address=79.127.205.233:4624 , piece_id=AZDNTPEHVSUE5UY5TXQR6IBCONG7ZT5TNTAKQ7QK3PJOL356BLXA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fD69hzWAhaScaVnRiPMZEFbybabwe1qfRZYfxZtwkFkze9wM4): protocol: write tcp 139.59.144.22:49550->79.127.205.233:4624: use of closed network connection; write tcp 139.59.144.22:49550->79.127.205.233:4624: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49550->79.127.205.233:4624: use of closed network connection
Aug 20 00:35:36.705468173 (271h9m58.664565426s) [noise=true , address=77.90.31.13:4652 , piece_id=DZKHOGL3LPHAQDT2THBQPTXGA5YSLYM47UFKIDSVWFZ3WDARUW4A, seg_pos={0 0}, upload=282233]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KrMw5DoiMSiBHMZJ8Zf8ir7UnTzBwUt9XMhw3Ria6ASGkm3FA): protocol: write tcp 139.59.144.22:46732->77.90.31.13:4652: use of closed network connection; write tcp 139.59.144.22:46732->77.90.31.13:4652: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46732->77.90.31.13:4652: use of closed network connection
Aug 20 00:35:36.705485991 (271h9m58.664583239s) [seg_pos={0 0}, upload=282233]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:35:36.705558099 (271h9m58.664655344s) [upload=282233]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:35:36.705562997 (271h9m58.664660241s) [upload=282233]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:35:36.875951536 (271h9m58.835048848s) [upload=282233]: Done uploading segments...
Aug 20 00:35:36.875976580 (271h9m58.835073836s) [upload=282233]: Upload finished. err: <nil>
Duration: 2.638422365s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................................X....X........] duration:
1.05564182s
FAIL (2025-08-20 00:37:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:30:38.458774989 (271h5m0.417872238s) [upload=282143]: Starting upload Aug 20 00:30:38.458899922 (271h5m0.417997159s) [upload=282143]: Done starting upload Aug 20 00:30:38.458994542 (271h5m0.418091788s) [upload=282143]: Uploading segments... Aug 20 00:30:38.459089877 (271h5m0.418187122s) [upload=282143]: Got next segment. Inline: true Aug 20 00:30:38.459095351 (271h5m0.418192597s) [upload=282143]: Waiting for error group managing segments... Aug 20 00:30:38.459155079 (271h5m0.418252324s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:30:38.459160277 (271h5m0.418257523s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:30:38.459164346 (271h5m0.41826159s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:30:38.551411507 (271h5m0.510508767s) [upload=282143]: Done uploading segments... Aug 20 00:30:38.551441357 (271h5m0.510538613s) [upload=282143]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.055671134s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.................X...X.X......................X...........X.] duration:
2.599650374s
FAIL (2025-08-20 00:36:43 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 00:35:35.600457384 (271h9m57.559554619s) [upload=282233]: Starting upload
Aug 20 00:35:35.600521407 (271h9m57.559618644s) [upload=282233]: Done starting upload
Aug 20 00:35:35.600768607 (271h9m57.559865845s) [upload=282233]: Uploading segments...
Aug 20 00:35:35.600845231 (271h9m57.559942485s) [upload=282233]: Got next segment. Inline: false
Aug 20 00:35:35.600880638 (271h9m57.559977883s) [upload=282233]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:35:35.600886239 (271h9m57.559983484s) [upload=282233]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:35:35.844578934 (271h9m57.803676179s) [seg_pos={0 0}, upload=282233]: Begin upload segment...
Aug 20 00:35:35.844652794 (271h9m57.803750042s) [seg_pos={0 0}, upload=282233]: Done begin upload segment.
Aug 20 00:35:35.844701165 (271h9m57.803798416s) [noise=true , address=77.90.31.21:4891 , piece_id=OLTUGRDK6OL25UBG2V75EFEOAWW5ECDPNMCI5F3AMBCMQD7QQFLA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.845327069 (271h9m57.804424325s) [noise=true , address=45.91.116.12:4238 , piece_id=CJPB34UVJ5R2JF55L2ZMQ7XLQWRSIXNH2IKA4NF5X3LJIYX5C35A, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.845748658 (271h9m57.804845906s) [noise=true , address=77.90.31.11:4587 , piece_id=2UZSWTHNM4JF3JFYHKED6LGZIJ5BCMDNM6IDJQSSUC3CM7V5LUZA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.845993820 (271h9m57.8050911s) [noise=true , address=45.91.116.14:4217 , piece_id=LO2BSMMLYQB2MDVKRP3H2BROAL6JLLJBYTRGBZHSMTN7JV5IJXLQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.846119208 (271h9m57.805216457s) [noise=true , address=45.91.116.9:4294 , piece_id=5VXPXLA577WJ2KN4E37Q4EXWXUPJS4W5ERK3X4GARIETNW2E3U3A, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.846392453 (271h9m57.805489689s) [noise=true , address=104.36.82.35:4615 , piece_id=AZ4SWOUFUW7R674HC3UOPPSPFVJYNY3RX6KQDLCJ25ECLPR7AKWQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.846459204 (271h9m57.805556455s) [noise=true , address=104.36.82.9:4039 , piece_id=H7BNNE66EWTFXEBRW2AU4FTQXMGVU7XCZ6OF2XHNTZKE3LI3A4SA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.846690068 (271h9m57.805787316s) [noise=true , address=79.127.205.233:4624 , piece_id=AZDNTPEHVSUE5UY5TXQR6IBCONG7ZT5TNTAKQ7QK3PJOL356BLXA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.846824783 (271h9m57.805922035s) [noise=true , address=77.90.31.19:4846 , piece_id=ZO6R3IGSEC53OPWKBMRCNZ6MT63WK6ARHSYOJNOINQTX7W3PVJAQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.846980920 (271h9m57.806078171s) [noise=true , address=77.90.31.13:4652 , piece_id=DZKHOGL3LPHAQDT2THBQPTXGA5YSLYM47UFKIDSVWFZ3WDARUW4A, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.847176778 (271h9m57.806274026s) [noise=true , address=104.36.82.5:4854 , piece_id=PP2UBAKB6R33X4N3JL3OSVQB4LZHRVXJ6RXJPNS4RANPKHA72IOQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.847266841 (271h9m57.806364075s) [noise=true , address=104.36.82.54:4183 , piece_id=KNJAKR6MKEZGATCTHYW7N4L3TQXIZTDGBQCSD643EJXS5X2YFJEA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.847516744 (271h9m57.806613991s) [noise=true , address=104.36.82.44:4885 , piece_id=BRETW6W3EQ6FVTUCJZVTAOU2WQCU7W67XOZJTIKTHO5KUF6FP5DQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.847573590 (271h9m57.80667084s) [noise=true , address=104.36.82.19:4427 , piece_id=OPP2W2EG3HS6PDLOATXBLG7LZ4YYOVGLWJMKG3X5KGSPRBSJK3TA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.847853150 (271h9m57.806950396s) [noise=true , address=104.36.82.15:4262 , piece_id=LFJGH4BEFA2FTFCWZM3PVVT3FGDI45EHFA4WQGQDRKCJSNRZZ5VQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.847862092 (271h9m57.80695934s) [noise=true , address=104.36.82.14:4236 , piece_id=XKA54QYMVO5EZACYHJAA2YBTUAY4TTKPU5SQNKYH5QFCPOPNSSDQ, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.848130622 (271h9m57.807227873s) [noise=true , address=77.90.31.12:4614 , piece_id=XZY6OTN2DFWMK64RR4QGPO534ZRLVI23O6WDJ33SZKY2XXNHYLGA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:35.848366579 (271h9m57.807463824s) [noise=true , address=104.36.82.36:4620 , piece_id=3JS2QDD2IXLDMV5THOEMOBU6VEVNSIDQW7CIUIJHHMLOZ2RMGOXA, seg_pos={0 0}, upload=282233]: Uploading piece...
Aug 20 00:35:36.401986054 (271h9m58.36108329s) [upload=282233]: Next returned nil segment
Aug 20 00:35:36.402007843 (271h9m58.361105099s) [upload=282233]: Waiting for error group managing segments...
Aug 20 00:35:36.574273182 (271h9m58.533370418s) [noise=true , address=77.90.31.12:4614 , piece_id=XZY6OTN2DFWMK64RR4QGPO534ZRLVI23O6WDJ33SZKY2XXNHYLGA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.588004288 (271h9m58.547101531s) [noise=true , address=104.36.82.35:4615 , piece_id=AZ4SWOUFUW7R674HC3UOPPSPFVJYNY3RX6KQDLCJ25ECLPR7AKWQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.591282444 (271h9m58.55037969s) [noise=true , address=104.36.82.5:4854 , piece_id=PP2UBAKB6R33X4N3JL3OSVQB4LZHRVXJ6RXJPNS4RANPKHA72IOQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.600926247 (271h9m58.560023484s) [noise=true , address=104.36.82.19:4427 , piece_id=OPP2W2EG3HS6PDLOATXBLG7LZ4YYOVGLWJMKG3X5KGSPRBSJK3TA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.608984817 (271h9m58.568082056s) [noise=true , address=104.36.82.54:4183 , piece_id=KNJAKR6MKEZGATCTHYW7N4L3TQXIZTDGBQCSD643EJXS5X2YFJEA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.611438340 (271h9m58.570535573s) [noise=true , address=104.36.82.44:4885 , piece_id=BRETW6W3EQ6FVTUCJZVTAOU2WQCU7W67XOZJTIKTHO5KUF6FP5DQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.615952932 (271h9m58.57505017s) [noise=true , address=104.36.82.9:4039 , piece_id=H7BNNE66EWTFXEBRW2AU4FTQXMGVU7XCZ6OF2XHNTZKE3LI3A4SA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.616692684 (271h9m58.575789922s) [noise=true , address=104.36.82.15:4262 , piece_id=LFJGH4BEFA2FTFCWZM3PVVT3FGDI45EHFA4WQGQDRKCJSNRZZ5VQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.635144854 (271h9m58.594242086s) [noise=true , address=104.36.82.14:4236 , piece_id=XKA54QYMVO5EZACYHJAA2YBTUAY4TTKPU5SQNKYH5QFCPOPNSSDQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.678140617 (271h9m58.637237862s) [noise=true , address=77.90.31.11:4587 , piece_id=2UZSWTHNM4JF3JFYHKED6LGZIJ5BCMDNM6IDJQSSUC3CM7V5LUZA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.683531838 (271h9m58.64262907s) [noise=true , address=104.36.82.36:4620 , piece_id=3JS2QDD2IXLDMV5THOEMOBU6VEVNSIDQW7CIUIJHHMLOZ2RMGOXA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.694805924 (271h9m58.653903157s) [noise=true , address=77.90.31.19:4846 , piece_id=ZO6R3IGSEC53OPWKBMRCNZ6MT63WK6ARHSYOJNOINQTX7W3PVJAQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.697407227 (271h9m58.656504479s) [noise=true , address=45.91.116.9:4294 , piece_id=5VXPXLA577WJ2KN4E37Q4EXWXUPJS4W5ERK3X4GARIETNW2E3U3A, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.704603917 (271h9m58.663701155s) [noise=true , address=45.91.116.12:4238 , piece_id=CJPB34UVJ5R2JF55L2ZMQ7XLQWRSIXNH2IKA4NF5X3LJIYX5C35A, seg_pos={0 0}, upload=282233]: Done uploading piece. err: <nil>
Aug 20 00:35:36.704631887 (271h9m58.663729126s) [seg_pos={0 0}, upload=282233]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:35:36.704790050 (271h9m58.663887296s) [noise=true , address=77.90.31.21:4891 , piece_id=OLTUGRDK6OL25UBG2V75EFEOAWW5ECDPNMCI5F3AMBCMQD7QQFLA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17RDAerfx8AW5NsgWLTXLNDbuAEWQFT3SVM4iwdmuBzWrML83g): protocol: expected piece hash; context canceled; EOF
Aug 20 00:35:36.705035473 (271h9m58.664132708s) [noise=true , address=45.91.116.14:4217 , piece_id=LO2BSMMLYQB2MDVKRP3H2BROAL6JLLJBYTRGBZHSMTN7JV5IJXLQ, seg_pos={0 0}, upload=282233]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSXWFiq27Dd2vBDD9vVnhDHVG59UmDKn3hVAhf3oyo5goVNaE): protocol: expected piece hash; context canceled; EOF
Aug 20 00:35:36.705373790 (271h9m58.664471037s) [noise=true , address=79.127.205.233:4624 , piece_id=AZDNTPEHVSUE5UY5TXQR6IBCONG7ZT5TNTAKQ7QK3PJOL356BLXA, seg_pos={0 0}, upload=282233]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fD69hzWAhaScaVnRiPMZEFbybabwe1qfRZYfxZtwkFkze9wM4): protocol: write tcp 139.59.144.22:49550->79.127.205.233:4624: use of closed network connection; write tcp 139.59.144.22:49550->79.127.205.233:4624: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49550->79.127.205.233:4624: use of closed network connection
Aug 20 00:35:36.705468173 (271h9m58.664565426s) [noise=true , address=77.90.31.13:4652 , piece_id=DZKHOGL3LPHAQDT2THBQPTXGA5YSLYM47UFKIDSVWFZ3WDARUW4A, seg_pos={0 0}, upload=282233]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KrMw5DoiMSiBHMZJ8Zf8ir7UnTzBwUt9XMhw3Ria6ASGkm3FA): protocol: write tcp 139.59.144.22:46732->77.90.31.13:4652: use of closed network connection; write tcp 139.59.144.22:46732->77.90.31.13:4652: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46732->77.90.31.13:4652: use of closed network connection
Aug 20 00:35:36.705485991 (271h9m58.664583239s) [seg_pos={0 0}, upload=282233]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:35:36.705558099 (271h9m58.664655344s) [upload=282233]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:35:36.705562997 (271h9m58.664660241s) [upload=282233]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:35:36.875951536 (271h9m58.835048848s) [upload=282233]: Done uploading segments...
Aug 20 00:35:36.875976580 (271h9m58.835073836s) [upload=282233]: Upload finished. err: <nil>
Duration: 2.599687887s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................................X....X.......] duration:
868.435701ms
FAIL (2025-08-20 00:36:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:30:38.458774989 (271h5m0.417872238s) [upload=282143]: Starting upload Aug 20 00:30:38.458899922 (271h5m0.417997159s) [upload=282143]: Done starting upload Aug 20 00:30:38.458994542 (271h5m0.418091788s) [upload=282143]: Uploading segments... Aug 20 00:30:38.459089877 (271h5m0.418187122s) [upload=282143]: Got next segment. Inline: true Aug 20 00:30:38.459095351 (271h5m0.418192597s) [upload=282143]: Waiting for error group managing segments... Aug 20 00:30:38.459155079 (271h5m0.418252324s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:30:38.459160277 (271h5m0.418257523s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:30:38.459164346 (271h5m0.41826159s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:30:38.551411507 (271h5m0.510508767s) [upload=282143]: Done uploading segments... Aug 20 00:30:38.551441357 (271h5m0.510538613s) [upload=282143]: Upload finished. err: metaclient: Too Many Requests
Duration: 868.509398ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................................X....X......] duration:
867.574517ms
FAIL (2025-08-20 00:35:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:30:38.458774989 (271h5m0.417872238s) [upload=282143]: Starting upload Aug 20 00:30:38.458899922 (271h5m0.417997159s) [upload=282143]: Done starting upload Aug 20 00:30:38.458994542 (271h5m0.418091788s) [upload=282143]: Uploading segments... Aug 20 00:30:38.459089877 (271h5m0.418187122s) [upload=282143]: Got next segment. Inline: true Aug 20 00:30:38.459095351 (271h5m0.418192597s) [upload=282143]: Waiting for error group managing segments... Aug 20 00:30:38.459155079 (271h5m0.418252324s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:30:38.459160277 (271h5m0.418257523s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:30:38.459164346 (271h5m0.41826159s) [upload=282143]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:30:38.551411507 (271h5m0.510508767s) [upload=282143]: Done uploading segments... Aug 20 00:30:38.551441357 (271h5m0.510538613s) [upload=282143]: Upload finished. err: metaclient: Too Many Requests
Duration: 867.644819ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|