Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.410782707s
FAIL (2025-08-14 08:18:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 08:07:55.178570761 (134h42m17.137668014s) [upload=140323]: Starting upload Aug 14 08:07:55.178815498 (134h42m17.137912749s) [upload=140323]: Done starting upload Aug 14 08:07:55.178957669 (134h42m17.138054901s) [upload=140323]: Uploading segments... Aug 14 08:07:55.179365998 (134h42m17.138463249s) [upload=140323]: Got next segment. Inline: false Aug 14 08:07:55.179436790 (134h42m17.138534041s) [upload=140323]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 08:07:55.179444798 (134h42m17.138542056s) [upload=140323]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 08:07:55.338204515 (134h42m17.297301759s) [upload=140323]: Next segment err: metaclient: Too Many Requests Aug 14 08:07:55.338233519 (134h42m17.297330778s) [upload=140323]: Done uploading segments... Aug 14 08:07:55.338250687 (134h42m17.297347928s) [upload=140323]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.410814953s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............X....................................X.......] duration:
836.666868ms
FAIL (2025-08-14 08:18:13 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 14 08:13:41.486486653 (134h48m3.445583898s) [upload=140421]: Starting upload
Aug 14 08:13:41.486553250 (134h48m3.445650495s) [upload=140421]: Done starting upload
Aug 14 08:13:41.486677644 (134h48m3.445774882s) [upload=140421]: Uploading segments...
Aug 14 08:13:41.486743005 (134h48m3.445840253s) [upload=140421]: Got next segment. Inline: true
Aug 14 08:13:41.486748498 (134h48m3.445845743s) [upload=140421]: Waiting for error group managing segments...
Aug 14 08:13:41.486803115 (134h48m3.445900361s) [upload=140421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 08:13:41.486819761 (134h48m3.445917007s) [upload=140421]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 08:13:41.486823568 (134h48m3.445920814s) [upload=140421]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 08:13:41.641374390 (134h48m3.600471624s) [upload=140421]: Done uploading segments...
Aug 14 08:13:41.641394182 (134h48m3.60049142s) [upload=140421]: Upload finished. err: <nil>
Duration: 836.759166ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.554440385s
FAIL (2025-08-14 08:17:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 08:07:55.178570761 (134h42m17.137668014s) [upload=140323]: Starting upload Aug 14 08:07:55.178815498 (134h42m17.137912749s) [upload=140323]: Done starting upload Aug 14 08:07:55.178957669 (134h42m17.138054901s) [upload=140323]: Uploading segments... Aug 14 08:07:55.179365998 (134h42m17.138463249s) [upload=140323]: Got next segment. Inline: false Aug 14 08:07:55.179436790 (134h42m17.138534041s) [upload=140323]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 08:07:55.179444798 (134h42m17.138542056s) [upload=140323]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 08:07:55.338204515 (134h42m17.297301759s) [upload=140323]: Next segment err: metaclient: Too Many Requests Aug 14 08:07:55.338233519 (134h42m17.297330778s) [upload=140323]: Done uploading segments... Aug 14 08:07:55.338250687 (134h42m17.297347928s) [upload=140323]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.554495863s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X....................................X......] duration:
1.231709278s
FAIL (2025-08-14 08:17:26 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 14 08:13:41.486486653 (134h48m3.445583898s) [upload=140421]: Starting upload
Aug 14 08:13:41.486553250 (134h48m3.445650495s) [upload=140421]: Done starting upload
Aug 14 08:13:41.486677644 (134h48m3.445774882s) [upload=140421]: Uploading segments...
Aug 14 08:13:41.486743005 (134h48m3.445840253s) [upload=140421]: Got next segment. Inline: true
Aug 14 08:13:41.486748498 (134h48m3.445845743s) [upload=140421]: Waiting for error group managing segments...
Aug 14 08:13:41.486803115 (134h48m3.445900361s) [upload=140421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 08:13:41.486819761 (134h48m3.445917007s) [upload=140421]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 08:13:41.486823568 (134h48m3.445920814s) [upload=140421]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 08:13:41.641374390 (134h48m3.600471624s) [upload=140421]: Done uploading segments...
Aug 14 08:13:41.641394182 (134h48m3.60049142s) [upload=140421]: Upload finished. err: <nil>
Duration: 1.231743066s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X....................................X.....] duration:
837.36879ms
FAIL (2025-08-14 08:17:10 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 14 08:13:41.486486653 (134h48m3.445583898s) [upload=140421]: Starting upload
Aug 14 08:13:41.486553250 (134h48m3.445650495s) [upload=140421]: Done starting upload
Aug 14 08:13:41.486677644 (134h48m3.445774882s) [upload=140421]: Uploading segments...
Aug 14 08:13:41.486743005 (134h48m3.445840253s) [upload=140421]: Got next segment. Inline: true
Aug 14 08:13:41.486748498 (134h48m3.445845743s) [upload=140421]: Waiting for error group managing segments...
Aug 14 08:13:41.486803115 (134h48m3.445900361s) [upload=140421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 08:13:41.486819761 (134h48m3.445917007s) [upload=140421]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 08:13:41.486823568 (134h48m3.445920814s) [upload=140421]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 08:13:41.641374390 (134h48m3.600471624s) [upload=140421]: Done uploading segments...
Aug 14 08:13:41.641394182 (134h48m3.60049142s) [upload=140421]: Upload finished. err: <nil>
Duration: 837.421644ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.372509526s
FAIL (2025-08-14 08:16:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 08:07:55.178570761 (134h42m17.137668014s) [upload=140323]: Starting upload Aug 14 08:07:55.178815498 (134h42m17.137912749s) [upload=140323]: Done starting upload Aug 14 08:07:55.178957669 (134h42m17.138054901s) [upload=140323]: Uploading segments... Aug 14 08:07:55.179365998 (134h42m17.138463249s) [upload=140323]: Got next segment. Inline: false Aug 14 08:07:55.179436790 (134h42m17.138534041s) [upload=140323]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 08:07:55.179444798 (134h42m17.138542056s) [upload=140323]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 08:07:55.338204515 (134h42m17.297301759s) [upload=140323]: Next segment err: metaclient: Too Many Requests Aug 14 08:07:55.338233519 (134h42m17.297330778s) [upload=140323]: Done uploading segments... Aug 14 08:07:55.338250687 (134h42m17.297347928s) [upload=140323]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.372552017s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X....................................X....] duration:
837.975369ms
FAIL (2025-08-14 08:16:39 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 14 08:13:41.486486653 (134h48m3.445583898s) [upload=140421]: Starting upload
Aug 14 08:13:41.486553250 (134h48m3.445650495s) [upload=140421]: Done starting upload
Aug 14 08:13:41.486677644 (134h48m3.445774882s) [upload=140421]: Uploading segments...
Aug 14 08:13:41.486743005 (134h48m3.445840253s) [upload=140421]: Got next segment. Inline: true
Aug 14 08:13:41.486748498 (134h48m3.445845743s) [upload=140421]: Waiting for error group managing segments...
Aug 14 08:13:41.486803115 (134h48m3.445900361s) [upload=140421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 08:13:41.486819761 (134h48m3.445917007s) [upload=140421]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 08:13:41.486823568 (134h48m3.445920814s) [upload=140421]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 08:13:41.641374390 (134h48m3.600471624s) [upload=140421]: Done uploading segments...
Aug 14 08:13:41.641394182 (134h48m3.60049142s) [upload=140421]: Upload finished. err: <nil>
Duration: 838.108025ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.424473395s
FAIL (2025-08-14 08:16:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 08:07:55.178570761 (134h42m17.137668014s) [upload=140323]: Starting upload Aug 14 08:07:55.178815498 (134h42m17.137912749s) [upload=140323]: Done starting upload Aug 14 08:07:55.178957669 (134h42m17.138054901s) [upload=140323]: Uploading segments... Aug 14 08:07:55.179365998 (134h42m17.138463249s) [upload=140323]: Got next segment. Inline: false Aug 14 08:07:55.179436790 (134h42m17.138534041s) [upload=140323]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 08:07:55.179444798 (134h42m17.138542056s) [upload=140323]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 08:07:55.338204515 (134h42m17.297301759s) [upload=140323]: Next segment err: metaclient: Too Many Requests Aug 14 08:07:55.338233519 (134h42m17.297330778s) [upload=140323]: Done uploading segments... Aug 14 08:07:55.338250687 (134h42m17.297347928s) [upload=140323]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.42450905s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X....................................X...] duration:
1.039047308s
FAIL (2025-08-14 08:16:06 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 14 08:13:41.486486653 (134h48m3.445583898s) [upload=140421]: Starting upload
Aug 14 08:13:41.486553250 (134h48m3.445650495s) [upload=140421]: Done starting upload
Aug 14 08:13:41.486677644 (134h48m3.445774882s) [upload=140421]: Uploading segments...
Aug 14 08:13:41.486743005 (134h48m3.445840253s) [upload=140421]: Got next segment. Inline: true
Aug 14 08:13:41.486748498 (134h48m3.445845743s) [upload=140421]: Waiting for error group managing segments...
Aug 14 08:13:41.486803115 (134h48m3.445900361s) [upload=140421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 08:13:41.486819761 (134h48m3.445917007s) [upload=140421]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 08:13:41.486823568 (134h48m3.445920814s) [upload=140421]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 08:13:41.641374390 (134h48m3.600471624s) [upload=140421]: Done uploading segments...
Aug 14 08:13:41.641394182 (134h48m3.60049142s) [upload=140421]: Upload finished. err: <nil>
Duration: 1.039083294s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.660426462s
FAIL (2025-08-14 08:15:51 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 08:07:55.178570761 (134h42m17.137668014s) [upload=140323]: Starting upload Aug 14 08:07:55.178815498 (134h42m17.137912749s) [upload=140323]: Done starting upload Aug 14 08:07:55.178957669 (134h42m17.138054901s) [upload=140323]: Uploading segments... Aug 14 08:07:55.179365998 (134h42m17.138463249s) [upload=140323]: Got next segment. Inline: false Aug 14 08:07:55.179436790 (134h42m17.138534041s) [upload=140323]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 08:07:55.179444798 (134h42m17.138542056s) [upload=140323]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 08:07:55.338204515 (134h42m17.297301759s) [upload=140323]: Next segment err: metaclient: Too Many Requests Aug 14 08:07:55.338233519 (134h42m17.297330778s) [upload=140323]: Done uploading segments... Aug 14 08:07:55.338250687 (134h42m17.297347928s) [upload=140323]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.660459806s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X....................................X..] duration:
893.746045ms
FAIL (2025-08-14 08:15:43 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 14 08:13:41.486486653 (134h48m3.445583898s) [upload=140421]: Starting upload
Aug 14 08:13:41.486553250 (134h48m3.445650495s) [upload=140421]: Done starting upload
Aug 14 08:13:41.486677644 (134h48m3.445774882s) [upload=140421]: Uploading segments...
Aug 14 08:13:41.486743005 (134h48m3.445840253s) [upload=140421]: Got next segment. Inline: true
Aug 14 08:13:41.486748498 (134h48m3.445845743s) [upload=140421]: Waiting for error group managing segments...
Aug 14 08:13:41.486803115 (134h48m3.445900361s) [upload=140421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 08:13:41.486819761 (134h48m3.445917007s) [upload=140421]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 08:13:41.486823568 (134h48m3.445920814s) [upload=140421]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 08:13:41.641374390 (134h48m3.600471624s) [upload=140421]: Done uploading segments...
Aug 14 08:13:41.641394182 (134h48m3.60049142s) [upload=140421]: Upload finished. err: <nil>
Duration: 893.804191ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.452830749s
FAIL (2025-08-14 08:15:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 08:07:55.178570761 (134h42m17.137668014s) [upload=140323]: Starting upload Aug 14 08:07:55.178815498 (134h42m17.137912749s) [upload=140323]: Done starting upload Aug 14 08:07:55.178957669 (134h42m17.138054901s) [upload=140323]: Uploading segments... Aug 14 08:07:55.179365998 (134h42m17.138463249s) [upload=140323]: Got next segment. Inline: false Aug 14 08:07:55.179436790 (134h42m17.138534041s) [upload=140323]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 08:07:55.179444798 (134h42m17.138542056s) [upload=140323]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 08:07:55.338204515 (134h42m17.297301759s) [upload=140323]: Next segment err: metaclient: Too Many Requests Aug 14 08:07:55.338233519 (134h42m17.297330778s) [upload=140323]: Done uploading segments... Aug 14 08:07:55.338250687 (134h42m17.297347928s) [upload=140323]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.452866513s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X....................................X.] duration:
1.10500104s
FAIL (2025-08-14 08:14:31 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 14 08:13:41.486486653 (134h48m3.445583898s) [upload=140421]: Starting upload
Aug 14 08:13:41.486553250 (134h48m3.445650495s) [upload=140421]: Done starting upload
Aug 14 08:13:41.486677644 (134h48m3.445774882s) [upload=140421]: Uploading segments...
Aug 14 08:13:41.486743005 (134h48m3.445840253s) [upload=140421]: Got next segment. Inline: true
Aug 14 08:13:41.486748498 (134h48m3.445845743s) [upload=140421]: Waiting for error group managing segments...
Aug 14 08:13:41.486803115 (134h48m3.445900361s) [upload=140421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 08:13:41.486819761 (134h48m3.445917007s) [upload=140421]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 08:13:41.486823568 (134h48m3.445920814s) [upload=140421]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 08:13:41.641374390 (134h48m3.600471624s) [upload=140421]: Done uploading segments...
Aug 14 08:13:41.641394182 (134h48m3.60049142s) [upload=140421]: Upload finished. err: <nil>
Duration: 1.105035734s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.424705524s
FAIL (2025-08-14 08:13:54 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 08:07:55.178570761 (134h42m17.137668014s) [upload=140323]: Starting upload Aug 14 08:07:55.178815498 (134h42m17.137912749s) [upload=140323]: Done starting upload Aug 14 08:07:55.178957669 (134h42m17.138054901s) [upload=140323]: Uploading segments... Aug 14 08:07:55.179365998 (134h42m17.138463249s) [upload=140323]: Got next segment. Inline: false Aug 14 08:07:55.179436790 (134h42m17.138534041s) [upload=140323]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 08:07:55.179444798 (134h42m17.138542056s) [upload=140323]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 08:07:55.338204515 (134h42m17.297301759s) [upload=140323]: Next segment err: metaclient: Too Many Requests Aug 14 08:07:55.338233519 (134h42m17.297330778s) [upload=140323]: Done uploading segments... Aug 14 08:07:55.338250687 (134h42m17.297347928s) [upload=140323]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.424741442s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................X....................................X] duration:
726.815454ms
FAIL (2025-08-14 08:13:41 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 14 08:13:41.486486653 (134h48m3.445583898s) [upload=140421]: Starting upload
Aug 14 08:13:41.486553250 (134h48m3.445650495s) [upload=140421]: Done starting upload
Aug 14 08:13:41.486677644 (134h48m3.445774882s) [upload=140421]: Uploading segments...
Aug 14 08:13:41.486743005 (134h48m3.445840253s) [upload=140421]: Got next segment. Inline: true
Aug 14 08:13:41.486748498 (134h48m3.445845743s) [upload=140421]: Waiting for error group managing segments...
Aug 14 08:13:41.486803115 (134h48m3.445900361s) [upload=140421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 08:13:41.486819761 (134h48m3.445917007s) [upload=140421]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 08:13:41.486823568 (134h48m3.445920814s) [upload=140421]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 08:13:41.641374390 (134h48m3.600471624s) [upload=140421]: Done uploading segments...
Aug 14 08:13:41.641394182 (134h48m3.60049142s) [upload=140421]: Upload finished. err: <nil>
Duration: 726.85608ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.33934975s
FAIL (2025-08-14 08:13:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 08:07:55.178570761 (134h42m17.137668014s) [upload=140323]: Starting upload Aug 14 08:07:55.178815498 (134h42m17.137912749s) [upload=140323]: Done starting upload Aug 14 08:07:55.178957669 (134h42m17.138054901s) [upload=140323]: Uploading segments... Aug 14 08:07:55.179365998 (134h42m17.138463249s) [upload=140323]: Got next segment. Inline: false Aug 14 08:07:55.179436790 (134h42m17.138534041s) [upload=140323]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 08:07:55.179444798 (134h42m17.138542056s) [upload=140323]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 08:07:55.338204515 (134h42m17.297301759s) [upload=140323]: Next segment err: metaclient: Too Many Requests Aug 14 08:07:55.338233519 (134h42m17.297330778s) [upload=140323]: Done uploading segments... Aug 14 08:07:55.338250687 (134h42m17.297347928s) [upload=140323]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.339385182s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
828.227929ms
FAIL (2025-08-14 08:12:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 07:47:11.992786671 (134h21m33.951883923s) [upload=139963]: Starting upload Aug 14 07:47:11.992860493 (134h21m33.951957737s) [upload=139963]: Done starting upload Aug 14 07:47:11.992934804 (134h21m33.952032051s) [upload=139963]: Uploading segments... Aug 14 07:47:11.993066452 (134h21m33.952163706s) [upload=139963]: Got next segment. Inline: true Aug 14 07:47:11.993074995 (134h21m33.95217223s) [upload=139963]: Waiting for error group managing segments... Aug 14 07:47:11.993140176 (134h21m33.95223741s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 07:47:11.993145821 (134h21m33.952243058s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 07:47:11.993149615 (134h21m33.95224685s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 07:47:12.080107026 (134h21m34.039204272s) [upload=139963]: Done uploading segments... Aug 14 07:47:12.080128377 (134h21m34.039225624s) [upload=139963]: Upload finished. err: metaclient: Too Many Requests
Duration: 828.260135ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.466606499s
FAIL (2025-08-14 08:12:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 08:07:55.178570761 (134h42m17.137668014s) [upload=140323]: Starting upload Aug 14 08:07:55.178815498 (134h42m17.137912749s) [upload=140323]: Done starting upload Aug 14 08:07:55.178957669 (134h42m17.138054901s) [upload=140323]: Uploading segments... Aug 14 08:07:55.179365998 (134h42m17.138463249s) [upload=140323]: Got next segment. Inline: false Aug 14 08:07:55.179436790 (134h42m17.138534041s) [upload=140323]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 08:07:55.179444798 (134h42m17.138542056s) [upload=140323]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 08:07:55.338204515 (134h42m17.297301759s) [upload=140323]: Next segment err: metaclient: Too Many Requests Aug 14 08:07:55.338233519 (134h42m17.297330778s) [upload=140323]: Done uploading segments... Aug 14 08:07:55.338250687 (134h42m17.297347928s) [upload=140323]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.466637299s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
836.136756ms
FAIL (2025-08-14 08:11:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 07:47:11.992786671 (134h21m33.951883923s) [upload=139963]: Starting upload Aug 14 07:47:11.992860493 (134h21m33.951957737s) [upload=139963]: Done starting upload Aug 14 07:47:11.992934804 (134h21m33.952032051s) [upload=139963]: Uploading segments... Aug 14 07:47:11.993066452 (134h21m33.952163706s) [upload=139963]: Got next segment. Inline: true Aug 14 07:47:11.993074995 (134h21m33.95217223s) [upload=139963]: Waiting for error group managing segments... Aug 14 07:47:11.993140176 (134h21m33.95223741s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 07:47:11.993145821 (134h21m33.952243058s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 07:47:11.993149615 (134h21m33.95224685s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 07:47:12.080107026 (134h21m34.039204272s) [upload=139963]: Done uploading segments... Aug 14 07:47:12.080128377 (134h21m34.039225624s) [upload=139963]: Upload finished. err: metaclient: Too Many Requests
Duration: 836.172725ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X.......................................................X...] duration:
2.464479287s
FAIL (2025-08-14 08:11:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 08:07:55.178570761 (134h42m17.137668014s) [upload=140323]: Starting upload Aug 14 08:07:55.178815498 (134h42m17.137912749s) [upload=140323]: Done starting upload Aug 14 08:07:55.178957669 (134h42m17.138054901s) [upload=140323]: Uploading segments... Aug 14 08:07:55.179365998 (134h42m17.138463249s) [upload=140323]: Got next segment. Inline: false Aug 14 08:07:55.179436790 (134h42m17.138534041s) [upload=140323]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 08:07:55.179444798 (134h42m17.138542056s) [upload=140323]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 08:07:55.338204515 (134h42m17.297301759s) [upload=140323]: Next segment err: metaclient: Too Many Requests Aug 14 08:07:55.338233519 (134h42m17.297330778s) [upload=140323]: Done uploading segments... Aug 14 08:07:55.338250687 (134h42m17.297347928s) [upload=140323]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.464582437s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
830.821943ms
FAIL (2025-08-14 08:10:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 07:47:11.992786671 (134h21m33.951883923s) [upload=139963]: Starting upload Aug 14 07:47:11.992860493 (134h21m33.951957737s) [upload=139963]: Done starting upload Aug 14 07:47:11.992934804 (134h21m33.952032051s) [upload=139963]: Uploading segments... Aug 14 07:47:11.993066452 (134h21m33.952163706s) [upload=139963]: Got next segment. Inline: true Aug 14 07:47:11.993074995 (134h21m33.95217223s) [upload=139963]: Waiting for error group managing segments... Aug 14 07:47:11.993140176 (134h21m33.95223741s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 07:47:11.993145821 (134h21m33.952243058s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 07:47:11.993149615 (134h21m33.95224685s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 07:47:12.080107026 (134h21m34.039204272s) [upload=139963]: Done uploading segments... Aug 14 07:47:12.080128377 (134h21m34.039225624s) [upload=139963]: Upload finished. err: metaclient: Too Many Requests
Duration: 830.854543ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X.......................................................X..] duration:
2.400982661s
FAIL (2025-08-14 08:10:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 08:07:55.178570761 (134h42m17.137668014s) [upload=140323]: Starting upload Aug 14 08:07:55.178815498 (134h42m17.137912749s) [upload=140323]: Done starting upload Aug 14 08:07:55.178957669 (134h42m17.138054901s) [upload=140323]: Uploading segments... Aug 14 08:07:55.179365998 (134h42m17.138463249s) [upload=140323]: Got next segment. Inline: false Aug 14 08:07:55.179436790 (134h42m17.138534041s) [upload=140323]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 08:07:55.179444798 (134h42m17.138542056s) [upload=140323]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 08:07:55.338204515 (134h42m17.297301759s) [upload=140323]: Next segment err: metaclient: Too Many Requests Aug 14 08:07:55.338233519 (134h42m17.297330778s) [upload=140323]: Done uploading segments... Aug 14 08:07:55.338250687 (134h42m17.297347928s) [upload=140323]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.401020679s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
866.390486ms
FAIL (2025-08-14 08:10:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 07:47:11.992786671 (134h21m33.951883923s) [upload=139963]: Starting upload Aug 14 07:47:11.992860493 (134h21m33.951957737s) [upload=139963]: Done starting upload Aug 14 07:47:11.992934804 (134h21m33.952032051s) [upload=139963]: Uploading segments... Aug 14 07:47:11.993066452 (134h21m33.952163706s) [upload=139963]: Got next segment. Inline: true Aug 14 07:47:11.993074995 (134h21m33.95217223s) [upload=139963]: Waiting for error group managing segments... Aug 14 07:47:11.993140176 (134h21m33.95223741s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 07:47:11.993145821 (134h21m33.952243058s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 07:47:11.993149615 (134h21m33.95224685s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 07:47:12.080107026 (134h21m34.039204272s) [upload=139963]: Done uploading segments... Aug 14 07:47:12.080128377 (134h21m34.039225624s) [upload=139963]: Upload finished. err: metaclient: Too Many Requests
Duration: 866.426163ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X.......................................................X.] duration:
2.5524465s
FAIL (2025-08-14 08:09:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 08:07:55.178570761 (134h42m17.137668014s) [upload=140323]: Starting upload Aug 14 08:07:55.178815498 (134h42m17.137912749s) [upload=140323]: Done starting upload Aug 14 08:07:55.178957669 (134h42m17.138054901s) [upload=140323]: Uploading segments... Aug 14 08:07:55.179365998 (134h42m17.138463249s) [upload=140323]: Got next segment. Inline: false Aug 14 08:07:55.179436790 (134h42m17.138534041s) [upload=140323]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 08:07:55.179444798 (134h42m17.138542056s) [upload=140323]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 08:07:55.338204515 (134h42m17.297301759s) [upload=140323]: Next segment err: metaclient: Too Many Requests Aug 14 08:07:55.338233519 (134h42m17.297330778s) [upload=140323]: Done uploading segments... Aug 14 08:07:55.338250687 (134h42m17.297347928s) [upload=140323]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.552486501s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
832.302977ms
FAIL (2025-08-14 08:08:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 07:47:11.992786671 (134h21m33.951883923s) [upload=139963]: Starting upload Aug 14 07:47:11.992860493 (134h21m33.951957737s) [upload=139963]: Done starting upload Aug 14 07:47:11.992934804 (134h21m33.952032051s) [upload=139963]: Uploading segments... Aug 14 07:47:11.993066452 (134h21m33.952163706s) [upload=139963]: Got next segment. Inline: true Aug 14 07:47:11.993074995 (134h21m33.95217223s) [upload=139963]: Waiting for error group managing segments... Aug 14 07:47:11.993140176 (134h21m33.95223741s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 07:47:11.993145821 (134h21m33.952243058s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 07:47:11.993149615 (134h21m33.95224685s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 07:47:12.080107026 (134h21m34.039204272s) [upload=139963]: Done uploading segments... Aug 14 07:47:12.080128377 (134h21m34.039225624s) [upload=139963]: Upload finished. err: metaclient: Too Many Requests
Duration: 832.333988ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X.......................................................X] duration:
438.291353ms
FAIL (2025-08-14 08:07:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 08:07:55.178570761 (134h42m17.137668014s) [upload=140323]: Starting upload Aug 14 08:07:55.178815498 (134h42m17.137912749s) [upload=140323]: Done starting upload Aug 14 08:07:55.178957669 (134h42m17.138054901s) [upload=140323]: Uploading segments... Aug 14 08:07:55.179365998 (134h42m17.138463249s) [upload=140323]: Got next segment. Inline: false Aug 14 08:07:55.179436790 (134h42m17.138534041s) [upload=140323]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 08:07:55.179444798 (134h42m17.138542056s) [upload=140323]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 08:07:55.338204515 (134h42m17.297301759s) [upload=140323]: Next segment err: metaclient: Too Many Requests Aug 14 08:07:55.338233519 (134h42m17.297330778s) [upload=140323]: Done uploading segments... Aug 14 08:07:55.338250687 (134h42m17.297347928s) [upload=140323]: Upload finished. err: metaclient: Too Many Requests
Duration: 438.335716ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
855.811457ms
FAIL (2025-08-14 08:07:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 07:47:11.992786671 (134h21m33.951883923s) [upload=139963]: Starting upload Aug 14 07:47:11.992860493 (134h21m33.951957737s) [upload=139963]: Done starting upload Aug 14 07:47:11.992934804 (134h21m33.952032051s) [upload=139963]: Uploading segments... Aug 14 07:47:11.993066452 (134h21m33.952163706s) [upload=139963]: Got next segment. Inline: true Aug 14 07:47:11.993074995 (134h21m33.95217223s) [upload=139963]: Waiting for error group managing segments... Aug 14 07:47:11.993140176 (134h21m33.95223741s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 07:47:11.993145821 (134h21m33.952243058s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 07:47:11.993149615 (134h21m33.95224685s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 07:47:12.080107026 (134h21m34.039204272s) [upload=139963]: Done uploading segments... Aug 14 07:47:12.080128377 (134h21m34.039225624s) [upload=139963]: Upload finished. err: metaclient: Too Many Requests
Duration: 855.84476ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.705696257s
FAIL (2025-08-14 08:07:36 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 07:25:09.956973924 (133h59m31.91607116s) [upload=139577]: Starting upload
Aug 14 07:25:09.957032907 (133h59m31.916130153s) [upload=139577]: Done starting upload
Aug 14 07:25:09.957129748 (133h59m31.916226993s) [upload=139577]: Uploading segments...
Aug 14 07:25:09.957339009 (133h59m31.916436247s) [upload=139577]: Got next segment. Inline: false
Aug 14 07:25:09.957436584 (133h59m31.91653383s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 07:25:09.957443440 (133h59m31.916540685s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 07:25:10.154380951 (133h59m32.113478197s) [seg_pos={0 0}, upload=139577]: Begin upload segment...
Aug 14 07:25:10.154468905 (133h59m32.113566151s) [seg_pos={0 0}, upload=139577]: Done begin upload segment.
Aug 14 07:25:10.154701354 (133h59m32.113798602s) [noise=true , address=77.90.31.12:4614 , piece_id=2HGLRMWPGEX2VE4EAOKW3AURGUOSLPYZJZ6ITWGJFBHHVOKEICKA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.154848318 (133h59m32.113945568s) [noise=true , address=66.23.193.175:4561 , piece_id=DTXPGEWJ4J6TSG4Z7DB7XJQCUNBU4KVJTIVVBTLPEFTEKKRB5ZTQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.155378855 (133h59m32.114476101s) [noise=true , address=104.36.82.39:4726 , piece_id=FNHEEZ32MIL5ETIJUIIPPNZZNKFZOEHSJORPY2B5RDJRWBCW3UBA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.156922693 (133h59m32.116019947s) [noise=true , address=104.36.82.34:4545 , piece_id=PDZLJ5YBBSZCTFEY2G5JUDYF4LKMUQQY3ZTJYKQCAWDYRQCLPIRA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.157691367 (133h59m32.116788622s) [noise=true , address=104.36.82.36:4651 , piece_id=LNFLTNNQQAYVTCFB5DE52K574RYCGC2ESEJLGLXTVNCLEG5DP56Q, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158149663 (133h59m32.117246915s) [noise=true , address=77.90.31.11:4580 , piece_id=RWGPCUVUIGHSZJEJZ2L2KSMRJ4D4ZLZ3H7KYIC3YT32YNL4IXLRA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158463935 (133h59m32.117561186s) [noise=true , address=104.36.82.23:4473 , piece_id=KRYJUMRXK5G3F4QKYH44SFZCI533STE5INLGKXWAVAKM5V7IT2XQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158774796 (133h59m32.117872047s) [noise=true , address=79.127.205.233:4635 , piece_id=CRUUHWDS7CL7C32M2Q65ZJ65RNTHP4NEJ6IH73CP2RCPI64FHMTA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159091926 (133h59m32.11818918s) [noise=true , address=77.90.31.14:4678 , piece_id=H3ZZXOABAEB5PETTSUA6H67A3ONHITRI42ZB7JMFEUGJBL4QWNVQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159433693 (133h59m32.118530973s) [noise=true , address=104.36.82.59:4320 , piece_id=2CDINXZFWNEALAQONUFKZOJXTAHKUR4NK7N5FZEB7LYWQXBQSFBA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159818042 (133h59m32.118915297s) [noise=true , address=77.90.31.18:4818 , piece_id=MWE2FGHHESHPG7I2M454MZKRRX5E3AVSKQGU5T4MYC2TYFW3YSAA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.160391987 (133h59m32.119489233s) [noise=true , address=77.90.31.15:4718 , piece_id=NLG3OVRC57PLR6TXQOFNWNKVMASOUJ3TEACQZ5WPJVPFLELQOXTQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.160892152 (133h59m32.119989383s) [noise=true , address=104.36.82.51:4068 , piece_id=Q3AQZ6YGT2RSJVNH42FGYUKGH6D7UX4I7E7BJD4X6G5X3DIKKNDA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.161379066 (133h59m32.120476321s) [noise=true , address=104.36.82.60:4341 , piece_id=RGUT4D2SW3X3DHQVWDYTGTJYKXDAAWUZYPTL7WMIR6ZEFMHNCYMA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.161738433 (133h59m32.120835689s) [noise=true , address=104.36.82.17:4336 , piece_id=NPMIKZGE5DMIVWUPZNYLJHS5EFHY7PNFWIJY2OBIDNKSZR27RM4Q, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.162169485 (133h59m32.121266732s) [noise=true , address=104.36.82.37:4680 , piece_id=25M2EO245Q66ZYHEIAWHT4B5U23A6GTMMJ3C42BEKTZRDSSBNTNQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.162572296 (133h59m32.121669548s) [noise=true , address=79.127.201.215:4344 , piece_id=KJF7LAUZHBT72YIHN3HMWHNSKAPTOL624UUJAPJ5I76L6GYPKEXA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.163864823 (133h59m32.12296208s) [noise=true , address=104.36.82.44:4881 , piece_id=WXKB4QHLTHHEQBABFNUVW75WAGRAFLF7KBPCD4WCGRARK6PNHK2A, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.725866433 (133h59m32.684963694s) [upload=139577]: Next returned nil segment
Aug 14 07:25:10.725904162 (133h59m32.685001419s) [upload=139577]: Waiting for error group managing segments...
Aug 14 07:25:10.862450158 (133h59m32.821547417s) [noise=true , address=77.90.31.12:4614 , piece_id=2HGLRMWPGEX2VE4EAOKW3AURGUOSLPYZJZ6ITWGJFBHHVOKEICKA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.862709772 (133h59m32.821807018s) [noise=true , address=77.90.31.14:4678 , piece_id=H3ZZXOABAEB5PETTSUA6H67A3ONHITRI42ZB7JMFEUGJBL4QWNVQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.866585589 (133h59m32.825682823s) [noise=true , address=77.90.31.18:4818 , piece_id=MWE2FGHHESHPG7I2M454MZKRRX5E3AVSKQGU5T4MYC2TYFW3YSAA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.874172708 (133h59m32.833270061s) [noise=true , address=77.90.31.15:4718 , piece_id=NLG3OVRC57PLR6TXQOFNWNKVMASOUJ3TEACQZ5WPJVPFLELQOXTQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.874505189 (133h59m32.833602423s) [noise=true , address=77.90.31.11:4580 , piece_id=RWGPCUVUIGHSZJEJZ2L2KSMRJ4D4ZLZ3H7KYIC3YT32YNL4IXLRA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.878471514 (133h59m32.837568761s) [noise=true , address=104.36.82.59:4320 , piece_id=2CDINXZFWNEALAQONUFKZOJXTAHKUR4NK7N5FZEB7LYWQXBQSFBA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.881638470 (133h59m32.840735716s) [noise=true , address=104.36.82.17:4336 , piece_id=NPMIKZGE5DMIVWUPZNYLJHS5EFHY7PNFWIJY2OBIDNKSZR27RM4Q, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.886865828 (133h59m32.845963074s) [noise=true , address=104.36.82.44:4881 , piece_id=WXKB4QHLTHHEQBABFNUVW75WAGRAFLF7KBPCD4WCGRARK6PNHK2A, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.889413475 (133h59m32.848510725s) [noise=true , address=104.36.82.39:4726 , piece_id=FNHEEZ32MIL5ETIJUIIPPNZZNKFZOEHSJORPY2B5RDJRWBCW3UBA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.906945117 (133h59m32.866042362s) [noise=true , address=104.36.82.34:4545 , piece_id=PDZLJ5YBBSZCTFEY2G5JUDYF4LKMUQQY3ZTJYKQCAWDYRQCLPIRA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.907087156 (133h59m32.866184406s) [noise=true , address=104.36.82.37:4680 , piece_id=25M2EO245Q66ZYHEIAWHT4B5U23A6GTMMJ3C42BEKTZRDSSBNTNQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.908961498 (133h59m32.86805873s) [noise=true , address=104.36.82.60:4341 , piece_id=RGUT4D2SW3X3DHQVWDYTGTJYKXDAAWUZYPTL7WMIR6ZEFMHNCYMA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.969332098 (133h59m32.928429338s) [noise=true , address=104.36.82.36:4651 , piece_id=LNFLTNNQQAYVTCFB5DE52K574RYCGC2ESEJLGLXTVNCLEG5DP56Q, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.977796980 (133h59m32.936894233s) [noise=true , address=104.36.82.23:4473 , piece_id=KRYJUMRXK5G3F4QKYH44SFZCI533STE5INLGKXWAVAKM5V7IT2XQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.977845819 (133h59m32.936943071s) [seg_pos={0 0}, upload=139577]: Segment reached optimal threshold of 14 pieces.
Aug 14 07:25:10.978277534 (133h59m32.937374783s) [noise=true , address=79.127.205.233:4635 , piece_id=CRUUHWDS7CL7C32M2Q65ZJ65RNTHP4NEJ6IH73CP2RCPI64FHMTA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZmShGfgfvurAu2DYTpX85R2WbtGx9oeS1gYQ6z17P6FeDrfRt): protocol: write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection; write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection
Aug 14 07:25:10.978292891 (133h59m32.937390139s) [noise=true , address=104.36.82.51:4068 , piece_id=Q3AQZ6YGT2RSJVNH42FGYUKGH6D7UX4I7E7BJD4X6G5X3DIKKNDA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Lh9dYpHCxbs7gpZ4Xt7os5Gm5Nco6jrNW1V1FHddVUEMkFfPY): protocol: expected piece hash; context canceled; EOF
Aug 14 07:25:10.978321765 (133h59m32.937419014s) [noise=true , address=79.127.201.215:4344 , piece_id=KJF7LAUZHBT72YIHN3HMWHNSKAPTOL624UUJAPJ5I76L6GYPKEXA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 14 07:25:10.978386078 (133h59m32.937483327s) [noise=true , address=66.23.193.175:4561 , piece_id=DTXPGEWJ4J6TSG4Z7DB7XJQCUNBU4KVJTIVVBTLPEFTEKKRB5ZTQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection
Aug 14 07:25:10.978404766 (133h59m32.937502014s) [seg_pos={0 0}, upload=139577]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 07:25:10.978549466 (133h59m32.937646702s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 07:25:10.978556260 (133h59m32.937653495s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 07:25:11.265569461 (133h59m33.224666727s) [upload=139577]: Done uploading segments...
Aug 14 07:25:11.265589989 (133h59m33.224687228s) [upload=139577]: Upload finished. err: <nil>
Duration: 2.705729422s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
816.160053ms
FAIL (2025-08-14 08:07:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 07:47:11.992786671 (134h21m33.951883923s) [upload=139963]: Starting upload Aug 14 07:47:11.992860493 (134h21m33.951957737s) [upload=139963]: Done starting upload Aug 14 07:47:11.992934804 (134h21m33.952032051s) [upload=139963]: Uploading segments... Aug 14 07:47:11.993066452 (134h21m33.952163706s) [upload=139963]: Got next segment. Inline: true Aug 14 07:47:11.993074995 (134h21m33.95217223s) [upload=139963]: Waiting for error group managing segments... Aug 14 07:47:11.993140176 (134h21m33.95223741s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 07:47:11.993145821 (134h21m33.952243058s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 07:47:11.993149615 (134h21m33.95224685s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 07:47:12.080107026 (134h21m34.039204272s) [upload=139963]: Done uploading segments... Aug 14 07:47:12.080128377 (134h21m34.039225624s) [upload=139963]: Upload finished. err: metaclient: Too Many Requests
Duration: 816.191102ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.358559913s
FAIL (2025-08-14 08:06:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 07:25:09.956973924 (133h59m31.91607116s) [upload=139577]: Starting upload
Aug 14 07:25:09.957032907 (133h59m31.916130153s) [upload=139577]: Done starting upload
Aug 14 07:25:09.957129748 (133h59m31.916226993s) [upload=139577]: Uploading segments...
Aug 14 07:25:09.957339009 (133h59m31.916436247s) [upload=139577]: Got next segment. Inline: false
Aug 14 07:25:09.957436584 (133h59m31.91653383s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 07:25:09.957443440 (133h59m31.916540685s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 07:25:10.154380951 (133h59m32.113478197s) [seg_pos={0 0}, upload=139577]: Begin upload segment...
Aug 14 07:25:10.154468905 (133h59m32.113566151s) [seg_pos={0 0}, upload=139577]: Done begin upload segment.
Aug 14 07:25:10.154701354 (133h59m32.113798602s) [noise=true , address=77.90.31.12:4614 , piece_id=2HGLRMWPGEX2VE4EAOKW3AURGUOSLPYZJZ6ITWGJFBHHVOKEICKA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.154848318 (133h59m32.113945568s) [noise=true , address=66.23.193.175:4561 , piece_id=DTXPGEWJ4J6TSG4Z7DB7XJQCUNBU4KVJTIVVBTLPEFTEKKRB5ZTQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.155378855 (133h59m32.114476101s) [noise=true , address=104.36.82.39:4726 , piece_id=FNHEEZ32MIL5ETIJUIIPPNZZNKFZOEHSJORPY2B5RDJRWBCW3UBA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.156922693 (133h59m32.116019947s) [noise=true , address=104.36.82.34:4545 , piece_id=PDZLJ5YBBSZCTFEY2G5JUDYF4LKMUQQY3ZTJYKQCAWDYRQCLPIRA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.157691367 (133h59m32.116788622s) [noise=true , address=104.36.82.36:4651 , piece_id=LNFLTNNQQAYVTCFB5DE52K574RYCGC2ESEJLGLXTVNCLEG5DP56Q, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158149663 (133h59m32.117246915s) [noise=true , address=77.90.31.11:4580 , piece_id=RWGPCUVUIGHSZJEJZ2L2KSMRJ4D4ZLZ3H7KYIC3YT32YNL4IXLRA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158463935 (133h59m32.117561186s) [noise=true , address=104.36.82.23:4473 , piece_id=KRYJUMRXK5G3F4QKYH44SFZCI533STE5INLGKXWAVAKM5V7IT2XQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158774796 (133h59m32.117872047s) [noise=true , address=79.127.205.233:4635 , piece_id=CRUUHWDS7CL7C32M2Q65ZJ65RNTHP4NEJ6IH73CP2RCPI64FHMTA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159091926 (133h59m32.11818918s) [noise=true , address=77.90.31.14:4678 , piece_id=H3ZZXOABAEB5PETTSUA6H67A3ONHITRI42ZB7JMFEUGJBL4QWNVQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159433693 (133h59m32.118530973s) [noise=true , address=104.36.82.59:4320 , piece_id=2CDINXZFWNEALAQONUFKZOJXTAHKUR4NK7N5FZEB7LYWQXBQSFBA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159818042 (133h59m32.118915297s) [noise=true , address=77.90.31.18:4818 , piece_id=MWE2FGHHESHPG7I2M454MZKRRX5E3AVSKQGU5T4MYC2TYFW3YSAA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.160391987 (133h59m32.119489233s) [noise=true , address=77.90.31.15:4718 , piece_id=NLG3OVRC57PLR6TXQOFNWNKVMASOUJ3TEACQZ5WPJVPFLELQOXTQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.160892152 (133h59m32.119989383s) [noise=true , address=104.36.82.51:4068 , piece_id=Q3AQZ6YGT2RSJVNH42FGYUKGH6D7UX4I7E7BJD4X6G5X3DIKKNDA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.161379066 (133h59m32.120476321s) [noise=true , address=104.36.82.60:4341 , piece_id=RGUT4D2SW3X3DHQVWDYTGTJYKXDAAWUZYPTL7WMIR6ZEFMHNCYMA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.161738433 (133h59m32.120835689s) [noise=true , address=104.36.82.17:4336 , piece_id=NPMIKZGE5DMIVWUPZNYLJHS5EFHY7PNFWIJY2OBIDNKSZR27RM4Q, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.162169485 (133h59m32.121266732s) [noise=true , address=104.36.82.37:4680 , piece_id=25M2EO245Q66ZYHEIAWHT4B5U23A6GTMMJ3C42BEKTZRDSSBNTNQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.162572296 (133h59m32.121669548s) [noise=true , address=79.127.201.215:4344 , piece_id=KJF7LAUZHBT72YIHN3HMWHNSKAPTOL624UUJAPJ5I76L6GYPKEXA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.163864823 (133h59m32.12296208s) [noise=true , address=104.36.82.44:4881 , piece_id=WXKB4QHLTHHEQBABFNUVW75WAGRAFLF7KBPCD4WCGRARK6PNHK2A, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.725866433 (133h59m32.684963694s) [upload=139577]: Next returned nil segment
Aug 14 07:25:10.725904162 (133h59m32.685001419s) [upload=139577]: Waiting for error group managing segments...
Aug 14 07:25:10.862450158 (133h59m32.821547417s) [noise=true , address=77.90.31.12:4614 , piece_id=2HGLRMWPGEX2VE4EAOKW3AURGUOSLPYZJZ6ITWGJFBHHVOKEICKA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.862709772 (133h59m32.821807018s) [noise=true , address=77.90.31.14:4678 , piece_id=H3ZZXOABAEB5PETTSUA6H67A3ONHITRI42ZB7JMFEUGJBL4QWNVQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.866585589 (133h59m32.825682823s) [noise=true , address=77.90.31.18:4818 , piece_id=MWE2FGHHESHPG7I2M454MZKRRX5E3AVSKQGU5T4MYC2TYFW3YSAA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.874172708 (133h59m32.833270061s) [noise=true , address=77.90.31.15:4718 , piece_id=NLG3OVRC57PLR6TXQOFNWNKVMASOUJ3TEACQZ5WPJVPFLELQOXTQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.874505189 (133h59m32.833602423s) [noise=true , address=77.90.31.11:4580 , piece_id=RWGPCUVUIGHSZJEJZ2L2KSMRJ4D4ZLZ3H7KYIC3YT32YNL4IXLRA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.878471514 (133h59m32.837568761s) [noise=true , address=104.36.82.59:4320 , piece_id=2CDINXZFWNEALAQONUFKZOJXTAHKUR4NK7N5FZEB7LYWQXBQSFBA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.881638470 (133h59m32.840735716s) [noise=true , address=104.36.82.17:4336 , piece_id=NPMIKZGE5DMIVWUPZNYLJHS5EFHY7PNFWIJY2OBIDNKSZR27RM4Q, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.886865828 (133h59m32.845963074s) [noise=true , address=104.36.82.44:4881 , piece_id=WXKB4QHLTHHEQBABFNUVW75WAGRAFLF7KBPCD4WCGRARK6PNHK2A, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.889413475 (133h59m32.848510725s) [noise=true , address=104.36.82.39:4726 , piece_id=FNHEEZ32MIL5ETIJUIIPPNZZNKFZOEHSJORPY2B5RDJRWBCW3UBA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.906945117 (133h59m32.866042362s) [noise=true , address=104.36.82.34:4545 , piece_id=PDZLJ5YBBSZCTFEY2G5JUDYF4LKMUQQY3ZTJYKQCAWDYRQCLPIRA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.907087156 (133h59m32.866184406s) [noise=true , address=104.36.82.37:4680 , piece_id=25M2EO245Q66ZYHEIAWHT4B5U23A6GTMMJ3C42BEKTZRDSSBNTNQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.908961498 (133h59m32.86805873s) [noise=true , address=104.36.82.60:4341 , piece_id=RGUT4D2SW3X3DHQVWDYTGTJYKXDAAWUZYPTL7WMIR6ZEFMHNCYMA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.969332098 (133h59m32.928429338s) [noise=true , address=104.36.82.36:4651 , piece_id=LNFLTNNQQAYVTCFB5DE52K574RYCGC2ESEJLGLXTVNCLEG5DP56Q, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.977796980 (133h59m32.936894233s) [noise=true , address=104.36.82.23:4473 , piece_id=KRYJUMRXK5G3F4QKYH44SFZCI533STE5INLGKXWAVAKM5V7IT2XQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.977845819 (133h59m32.936943071s) [seg_pos={0 0}, upload=139577]: Segment reached optimal threshold of 14 pieces.
Aug 14 07:25:10.978277534 (133h59m32.937374783s) [noise=true , address=79.127.205.233:4635 , piece_id=CRUUHWDS7CL7C32M2Q65ZJ65RNTHP4NEJ6IH73CP2RCPI64FHMTA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZmShGfgfvurAu2DYTpX85R2WbtGx9oeS1gYQ6z17P6FeDrfRt): protocol: write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection; write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection
Aug 14 07:25:10.978292891 (133h59m32.937390139s) [noise=true , address=104.36.82.51:4068 , piece_id=Q3AQZ6YGT2RSJVNH42FGYUKGH6D7UX4I7E7BJD4X6G5X3DIKKNDA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Lh9dYpHCxbs7gpZ4Xt7os5Gm5Nco6jrNW1V1FHddVUEMkFfPY): protocol: expected piece hash; context canceled; EOF
Aug 14 07:25:10.978321765 (133h59m32.937419014s) [noise=true , address=79.127.201.215:4344 , piece_id=KJF7LAUZHBT72YIHN3HMWHNSKAPTOL624UUJAPJ5I76L6GYPKEXA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 14 07:25:10.978386078 (133h59m32.937483327s) [noise=true , address=66.23.193.175:4561 , piece_id=DTXPGEWJ4J6TSG4Z7DB7XJQCUNBU4KVJTIVVBTLPEFTEKKRB5ZTQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection
Aug 14 07:25:10.978404766 (133h59m32.937502014s) [seg_pos={0 0}, upload=139577]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 07:25:10.978549466 (133h59m32.937646702s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 07:25:10.978556260 (133h59m32.937653495s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 07:25:11.265569461 (133h59m33.224666727s) [upload=139577]: Done uploading segments...
Aug 14 07:25:11.265589989 (133h59m33.224687228s) [upload=139577]: Upload finished. err: <nil>
Duration: 2.358600349s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
992.4761ms
FAIL (2025-08-14 08:06:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 07:47:11.992786671 (134h21m33.951883923s) [upload=139963]: Starting upload Aug 14 07:47:11.992860493 (134h21m33.951957737s) [upload=139963]: Done starting upload Aug 14 07:47:11.992934804 (134h21m33.952032051s) [upload=139963]: Uploading segments... Aug 14 07:47:11.993066452 (134h21m33.952163706s) [upload=139963]: Got next segment. Inline: true Aug 14 07:47:11.993074995 (134h21m33.95217223s) [upload=139963]: Waiting for error group managing segments... Aug 14 07:47:11.993140176 (134h21m33.95223741s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 07:47:11.993145821 (134h21m33.952243058s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 07:47:11.993149615 (134h21m33.95224685s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 07:47:12.080107026 (134h21m34.039204272s) [upload=139963]: Done uploading segments... Aug 14 07:47:12.080128377 (134h21m34.039225624s) [upload=139963]: Upload finished. err: metaclient: Too Many Requests
Duration: 992.516964ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.321907662s
FAIL (2025-08-14 08:05:38 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 07:25:09.956973924 (133h59m31.91607116s) [upload=139577]: Starting upload
Aug 14 07:25:09.957032907 (133h59m31.916130153s) [upload=139577]: Done starting upload
Aug 14 07:25:09.957129748 (133h59m31.916226993s) [upload=139577]: Uploading segments...
Aug 14 07:25:09.957339009 (133h59m31.916436247s) [upload=139577]: Got next segment. Inline: false
Aug 14 07:25:09.957436584 (133h59m31.91653383s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 07:25:09.957443440 (133h59m31.916540685s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 07:25:10.154380951 (133h59m32.113478197s) [seg_pos={0 0}, upload=139577]: Begin upload segment...
Aug 14 07:25:10.154468905 (133h59m32.113566151s) [seg_pos={0 0}, upload=139577]: Done begin upload segment.
Aug 14 07:25:10.154701354 (133h59m32.113798602s) [noise=true , address=77.90.31.12:4614 , piece_id=2HGLRMWPGEX2VE4EAOKW3AURGUOSLPYZJZ6ITWGJFBHHVOKEICKA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.154848318 (133h59m32.113945568s) [noise=true , address=66.23.193.175:4561 , piece_id=DTXPGEWJ4J6TSG4Z7DB7XJQCUNBU4KVJTIVVBTLPEFTEKKRB5ZTQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.155378855 (133h59m32.114476101s) [noise=true , address=104.36.82.39:4726 , piece_id=FNHEEZ32MIL5ETIJUIIPPNZZNKFZOEHSJORPY2B5RDJRWBCW3UBA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.156922693 (133h59m32.116019947s) [noise=true , address=104.36.82.34:4545 , piece_id=PDZLJ5YBBSZCTFEY2G5JUDYF4LKMUQQY3ZTJYKQCAWDYRQCLPIRA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.157691367 (133h59m32.116788622s) [noise=true , address=104.36.82.36:4651 , piece_id=LNFLTNNQQAYVTCFB5DE52K574RYCGC2ESEJLGLXTVNCLEG5DP56Q, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158149663 (133h59m32.117246915s) [noise=true , address=77.90.31.11:4580 , piece_id=RWGPCUVUIGHSZJEJZ2L2KSMRJ4D4ZLZ3H7KYIC3YT32YNL4IXLRA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158463935 (133h59m32.117561186s) [noise=true , address=104.36.82.23:4473 , piece_id=KRYJUMRXK5G3F4QKYH44SFZCI533STE5INLGKXWAVAKM5V7IT2XQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158774796 (133h59m32.117872047s) [noise=true , address=79.127.205.233:4635 , piece_id=CRUUHWDS7CL7C32M2Q65ZJ65RNTHP4NEJ6IH73CP2RCPI64FHMTA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159091926 (133h59m32.11818918s) [noise=true , address=77.90.31.14:4678 , piece_id=H3ZZXOABAEB5PETTSUA6H67A3ONHITRI42ZB7JMFEUGJBL4QWNVQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159433693 (133h59m32.118530973s) [noise=true , address=104.36.82.59:4320 , piece_id=2CDINXZFWNEALAQONUFKZOJXTAHKUR4NK7N5FZEB7LYWQXBQSFBA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159818042 (133h59m32.118915297s) [noise=true , address=77.90.31.18:4818 , piece_id=MWE2FGHHESHPG7I2M454MZKRRX5E3AVSKQGU5T4MYC2TYFW3YSAA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.160391987 (133h59m32.119489233s) [noise=true , address=77.90.31.15:4718 , piece_id=NLG3OVRC57PLR6TXQOFNWNKVMASOUJ3TEACQZ5WPJVPFLELQOXTQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.160892152 (133h59m32.119989383s) [noise=true , address=104.36.82.51:4068 , piece_id=Q3AQZ6YGT2RSJVNH42FGYUKGH6D7UX4I7E7BJD4X6G5X3DIKKNDA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.161379066 (133h59m32.120476321s) [noise=true , address=104.36.82.60:4341 , piece_id=RGUT4D2SW3X3DHQVWDYTGTJYKXDAAWUZYPTL7WMIR6ZEFMHNCYMA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.161738433 (133h59m32.120835689s) [noise=true , address=104.36.82.17:4336 , piece_id=NPMIKZGE5DMIVWUPZNYLJHS5EFHY7PNFWIJY2OBIDNKSZR27RM4Q, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.162169485 (133h59m32.121266732s) [noise=true , address=104.36.82.37:4680 , piece_id=25M2EO245Q66ZYHEIAWHT4B5U23A6GTMMJ3C42BEKTZRDSSBNTNQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.162572296 (133h59m32.121669548s) [noise=true , address=79.127.201.215:4344 , piece_id=KJF7LAUZHBT72YIHN3HMWHNSKAPTOL624UUJAPJ5I76L6GYPKEXA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.163864823 (133h59m32.12296208s) [noise=true , address=104.36.82.44:4881 , piece_id=WXKB4QHLTHHEQBABFNUVW75WAGRAFLF7KBPCD4WCGRARK6PNHK2A, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.725866433 (133h59m32.684963694s) [upload=139577]: Next returned nil segment
Aug 14 07:25:10.725904162 (133h59m32.685001419s) [upload=139577]: Waiting for error group managing segments...
Aug 14 07:25:10.862450158 (133h59m32.821547417s) [noise=true , address=77.90.31.12:4614 , piece_id=2HGLRMWPGEX2VE4EAOKW3AURGUOSLPYZJZ6ITWGJFBHHVOKEICKA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.862709772 (133h59m32.821807018s) [noise=true , address=77.90.31.14:4678 , piece_id=H3ZZXOABAEB5PETTSUA6H67A3ONHITRI42ZB7JMFEUGJBL4QWNVQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.866585589 (133h59m32.825682823s) [noise=true , address=77.90.31.18:4818 , piece_id=MWE2FGHHESHPG7I2M454MZKRRX5E3AVSKQGU5T4MYC2TYFW3YSAA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.874172708 (133h59m32.833270061s) [noise=true , address=77.90.31.15:4718 , piece_id=NLG3OVRC57PLR6TXQOFNWNKVMASOUJ3TEACQZ5WPJVPFLELQOXTQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.874505189 (133h59m32.833602423s) [noise=true , address=77.90.31.11:4580 , piece_id=RWGPCUVUIGHSZJEJZ2L2KSMRJ4D4ZLZ3H7KYIC3YT32YNL4IXLRA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.878471514 (133h59m32.837568761s) [noise=true , address=104.36.82.59:4320 , piece_id=2CDINXZFWNEALAQONUFKZOJXTAHKUR4NK7N5FZEB7LYWQXBQSFBA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.881638470 (133h59m32.840735716s) [noise=true , address=104.36.82.17:4336 , piece_id=NPMIKZGE5DMIVWUPZNYLJHS5EFHY7PNFWIJY2OBIDNKSZR27RM4Q, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.886865828 (133h59m32.845963074s) [noise=true , address=104.36.82.44:4881 , piece_id=WXKB4QHLTHHEQBABFNUVW75WAGRAFLF7KBPCD4WCGRARK6PNHK2A, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.889413475 (133h59m32.848510725s) [noise=true , address=104.36.82.39:4726 , piece_id=FNHEEZ32MIL5ETIJUIIPPNZZNKFZOEHSJORPY2B5RDJRWBCW3UBA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.906945117 (133h59m32.866042362s) [noise=true , address=104.36.82.34:4545 , piece_id=PDZLJ5YBBSZCTFEY2G5JUDYF4LKMUQQY3ZTJYKQCAWDYRQCLPIRA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.907087156 (133h59m32.866184406s) [noise=true , address=104.36.82.37:4680 , piece_id=25M2EO245Q66ZYHEIAWHT4B5U23A6GTMMJ3C42BEKTZRDSSBNTNQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.908961498 (133h59m32.86805873s) [noise=true , address=104.36.82.60:4341 , piece_id=RGUT4D2SW3X3DHQVWDYTGTJYKXDAAWUZYPTL7WMIR6ZEFMHNCYMA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.969332098 (133h59m32.928429338s) [noise=true , address=104.36.82.36:4651 , piece_id=LNFLTNNQQAYVTCFB5DE52K574RYCGC2ESEJLGLXTVNCLEG5DP56Q, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.977796980 (133h59m32.936894233s) [noise=true , address=104.36.82.23:4473 , piece_id=KRYJUMRXK5G3F4QKYH44SFZCI533STE5INLGKXWAVAKM5V7IT2XQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.977845819 (133h59m32.936943071s) [seg_pos={0 0}, upload=139577]: Segment reached optimal threshold of 14 pieces.
Aug 14 07:25:10.978277534 (133h59m32.937374783s) [noise=true , address=79.127.205.233:4635 , piece_id=CRUUHWDS7CL7C32M2Q65ZJ65RNTHP4NEJ6IH73CP2RCPI64FHMTA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZmShGfgfvurAu2DYTpX85R2WbtGx9oeS1gYQ6z17P6FeDrfRt): protocol: write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection; write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection
Aug 14 07:25:10.978292891 (133h59m32.937390139s) [noise=true , address=104.36.82.51:4068 , piece_id=Q3AQZ6YGT2RSJVNH42FGYUKGH6D7UX4I7E7BJD4X6G5X3DIKKNDA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Lh9dYpHCxbs7gpZ4Xt7os5Gm5Nco6jrNW1V1FHddVUEMkFfPY): protocol: expected piece hash; context canceled; EOF
Aug 14 07:25:10.978321765 (133h59m32.937419014s) [noise=true , address=79.127.201.215:4344 , piece_id=KJF7LAUZHBT72YIHN3HMWHNSKAPTOL624UUJAPJ5I76L6GYPKEXA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 14 07:25:10.978386078 (133h59m32.937483327s) [noise=true , address=66.23.193.175:4561 , piece_id=DTXPGEWJ4J6TSG4Z7DB7XJQCUNBU4KVJTIVVBTLPEFTEKKRB5ZTQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection
Aug 14 07:25:10.978404766 (133h59m32.937502014s) [seg_pos={0 0}, upload=139577]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 07:25:10.978549466 (133h59m32.937646702s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 07:25:10.978556260 (133h59m32.937653495s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 07:25:11.265569461 (133h59m33.224666727s) [upload=139577]: Done uploading segments...
Aug 14 07:25:11.265589989 (133h59m33.224687228s) [upload=139577]: Upload finished. err: <nil>
Duration: 2.321935062s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
834.988132ms
FAIL (2025-08-14 08:05:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 07:47:11.992786671 (134h21m33.951883923s) [upload=139963]: Starting upload Aug 14 07:47:11.992860493 (134h21m33.951957737s) [upload=139963]: Done starting upload Aug 14 07:47:11.992934804 (134h21m33.952032051s) [upload=139963]: Uploading segments... Aug 14 07:47:11.993066452 (134h21m33.952163706s) [upload=139963]: Got next segment. Inline: true Aug 14 07:47:11.993074995 (134h21m33.95217223s) [upload=139963]: Waiting for error group managing segments... Aug 14 07:47:11.993140176 (134h21m33.95223741s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 07:47:11.993145821 (134h21m33.952243058s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 07:47:11.993149615 (134h21m33.95224685s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 07:47:12.080107026 (134h21m34.039204272s) [upload=139963]: Done uploading segments... Aug 14 07:47:12.080128377 (134h21m34.039225624s) [upload=139963]: Upload finished. err: metaclient: Too Many Requests
Duration: 835.019414ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.344321716s
FAIL (2025-08-14 08:05:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 07:25:09.956973924 (133h59m31.91607116s) [upload=139577]: Starting upload
Aug 14 07:25:09.957032907 (133h59m31.916130153s) [upload=139577]: Done starting upload
Aug 14 07:25:09.957129748 (133h59m31.916226993s) [upload=139577]: Uploading segments...
Aug 14 07:25:09.957339009 (133h59m31.916436247s) [upload=139577]: Got next segment. Inline: false
Aug 14 07:25:09.957436584 (133h59m31.91653383s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 07:25:09.957443440 (133h59m31.916540685s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 07:25:10.154380951 (133h59m32.113478197s) [seg_pos={0 0}, upload=139577]: Begin upload segment...
Aug 14 07:25:10.154468905 (133h59m32.113566151s) [seg_pos={0 0}, upload=139577]: Done begin upload segment.
Aug 14 07:25:10.154701354 (133h59m32.113798602s) [noise=true , address=77.90.31.12:4614 , piece_id=2HGLRMWPGEX2VE4EAOKW3AURGUOSLPYZJZ6ITWGJFBHHVOKEICKA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.154848318 (133h59m32.113945568s) [noise=true , address=66.23.193.175:4561 , piece_id=DTXPGEWJ4J6TSG4Z7DB7XJQCUNBU4KVJTIVVBTLPEFTEKKRB5ZTQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.155378855 (133h59m32.114476101s) [noise=true , address=104.36.82.39:4726 , piece_id=FNHEEZ32MIL5ETIJUIIPPNZZNKFZOEHSJORPY2B5RDJRWBCW3UBA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.156922693 (133h59m32.116019947s) [noise=true , address=104.36.82.34:4545 , piece_id=PDZLJ5YBBSZCTFEY2G5JUDYF4LKMUQQY3ZTJYKQCAWDYRQCLPIRA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.157691367 (133h59m32.116788622s) [noise=true , address=104.36.82.36:4651 , piece_id=LNFLTNNQQAYVTCFB5DE52K574RYCGC2ESEJLGLXTVNCLEG5DP56Q, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158149663 (133h59m32.117246915s) [noise=true , address=77.90.31.11:4580 , piece_id=RWGPCUVUIGHSZJEJZ2L2KSMRJ4D4ZLZ3H7KYIC3YT32YNL4IXLRA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158463935 (133h59m32.117561186s) [noise=true , address=104.36.82.23:4473 , piece_id=KRYJUMRXK5G3F4QKYH44SFZCI533STE5INLGKXWAVAKM5V7IT2XQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158774796 (133h59m32.117872047s) [noise=true , address=79.127.205.233:4635 , piece_id=CRUUHWDS7CL7C32M2Q65ZJ65RNTHP4NEJ6IH73CP2RCPI64FHMTA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159091926 (133h59m32.11818918s) [noise=true , address=77.90.31.14:4678 , piece_id=H3ZZXOABAEB5PETTSUA6H67A3ONHITRI42ZB7JMFEUGJBL4QWNVQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159433693 (133h59m32.118530973s) [noise=true , address=104.36.82.59:4320 , piece_id=2CDINXZFWNEALAQONUFKZOJXTAHKUR4NK7N5FZEB7LYWQXBQSFBA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159818042 (133h59m32.118915297s) [noise=true , address=77.90.31.18:4818 , piece_id=MWE2FGHHESHPG7I2M454MZKRRX5E3AVSKQGU5T4MYC2TYFW3YSAA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.160391987 (133h59m32.119489233s) [noise=true , address=77.90.31.15:4718 , piece_id=NLG3OVRC57PLR6TXQOFNWNKVMASOUJ3TEACQZ5WPJVPFLELQOXTQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.160892152 (133h59m32.119989383s) [noise=true , address=104.36.82.51:4068 , piece_id=Q3AQZ6YGT2RSJVNH42FGYUKGH6D7UX4I7E7BJD4X6G5X3DIKKNDA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.161379066 (133h59m32.120476321s) [noise=true , address=104.36.82.60:4341 , piece_id=RGUT4D2SW3X3DHQVWDYTGTJYKXDAAWUZYPTL7WMIR6ZEFMHNCYMA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.161738433 (133h59m32.120835689s) [noise=true , address=104.36.82.17:4336 , piece_id=NPMIKZGE5DMIVWUPZNYLJHS5EFHY7PNFWIJY2OBIDNKSZR27RM4Q, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.162169485 (133h59m32.121266732s) [noise=true , address=104.36.82.37:4680 , piece_id=25M2EO245Q66ZYHEIAWHT4B5U23A6GTMMJ3C42BEKTZRDSSBNTNQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.162572296 (133h59m32.121669548s) [noise=true , address=79.127.201.215:4344 , piece_id=KJF7LAUZHBT72YIHN3HMWHNSKAPTOL624UUJAPJ5I76L6GYPKEXA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.163864823 (133h59m32.12296208s) [noise=true , address=104.36.82.44:4881 , piece_id=WXKB4QHLTHHEQBABFNUVW75WAGRAFLF7KBPCD4WCGRARK6PNHK2A, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.725866433 (133h59m32.684963694s) [upload=139577]: Next returned nil segment
Aug 14 07:25:10.725904162 (133h59m32.685001419s) [upload=139577]: Waiting for error group managing segments...
Aug 14 07:25:10.862450158 (133h59m32.821547417s) [noise=true , address=77.90.31.12:4614 , piece_id=2HGLRMWPGEX2VE4EAOKW3AURGUOSLPYZJZ6ITWGJFBHHVOKEICKA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.862709772 (133h59m32.821807018s) [noise=true , address=77.90.31.14:4678 , piece_id=H3ZZXOABAEB5PETTSUA6H67A3ONHITRI42ZB7JMFEUGJBL4QWNVQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.866585589 (133h59m32.825682823s) [noise=true , address=77.90.31.18:4818 , piece_id=MWE2FGHHESHPG7I2M454MZKRRX5E3AVSKQGU5T4MYC2TYFW3YSAA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.874172708 (133h59m32.833270061s) [noise=true , address=77.90.31.15:4718 , piece_id=NLG3OVRC57PLR6TXQOFNWNKVMASOUJ3TEACQZ5WPJVPFLELQOXTQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.874505189 (133h59m32.833602423s) [noise=true , address=77.90.31.11:4580 , piece_id=RWGPCUVUIGHSZJEJZ2L2KSMRJ4D4ZLZ3H7KYIC3YT32YNL4IXLRA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.878471514 (133h59m32.837568761s) [noise=true , address=104.36.82.59:4320 , piece_id=2CDINXZFWNEALAQONUFKZOJXTAHKUR4NK7N5FZEB7LYWQXBQSFBA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.881638470 (133h59m32.840735716s) [noise=true , address=104.36.82.17:4336 , piece_id=NPMIKZGE5DMIVWUPZNYLJHS5EFHY7PNFWIJY2OBIDNKSZR27RM4Q, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.886865828 (133h59m32.845963074s) [noise=true , address=104.36.82.44:4881 , piece_id=WXKB4QHLTHHEQBABFNUVW75WAGRAFLF7KBPCD4WCGRARK6PNHK2A, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.889413475 (133h59m32.848510725s) [noise=true , address=104.36.82.39:4726 , piece_id=FNHEEZ32MIL5ETIJUIIPPNZZNKFZOEHSJORPY2B5RDJRWBCW3UBA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.906945117 (133h59m32.866042362s) [noise=true , address=104.36.82.34:4545 , piece_id=PDZLJ5YBBSZCTFEY2G5JUDYF4LKMUQQY3ZTJYKQCAWDYRQCLPIRA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.907087156 (133h59m32.866184406s) [noise=true , address=104.36.82.37:4680 , piece_id=25M2EO245Q66ZYHEIAWHT4B5U23A6GTMMJ3C42BEKTZRDSSBNTNQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.908961498 (133h59m32.86805873s) [noise=true , address=104.36.82.60:4341 , piece_id=RGUT4D2SW3X3DHQVWDYTGTJYKXDAAWUZYPTL7WMIR6ZEFMHNCYMA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.969332098 (133h59m32.928429338s) [noise=true , address=104.36.82.36:4651 , piece_id=LNFLTNNQQAYVTCFB5DE52K574RYCGC2ESEJLGLXTVNCLEG5DP56Q, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.977796980 (133h59m32.936894233s) [noise=true , address=104.36.82.23:4473 , piece_id=KRYJUMRXK5G3F4QKYH44SFZCI533STE5INLGKXWAVAKM5V7IT2XQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.977845819 (133h59m32.936943071s) [seg_pos={0 0}, upload=139577]: Segment reached optimal threshold of 14 pieces.
Aug 14 07:25:10.978277534 (133h59m32.937374783s) [noise=true , address=79.127.205.233:4635 , piece_id=CRUUHWDS7CL7C32M2Q65ZJ65RNTHP4NEJ6IH73CP2RCPI64FHMTA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZmShGfgfvurAu2DYTpX85R2WbtGx9oeS1gYQ6z17P6FeDrfRt): protocol: write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection; write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection
Aug 14 07:25:10.978292891 (133h59m32.937390139s) [noise=true , address=104.36.82.51:4068 , piece_id=Q3AQZ6YGT2RSJVNH42FGYUKGH6D7UX4I7E7BJD4X6G5X3DIKKNDA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Lh9dYpHCxbs7gpZ4Xt7os5Gm5Nco6jrNW1V1FHddVUEMkFfPY): protocol: expected piece hash; context canceled; EOF
Aug 14 07:25:10.978321765 (133h59m32.937419014s) [noise=true , address=79.127.201.215:4344 , piece_id=KJF7LAUZHBT72YIHN3HMWHNSKAPTOL624UUJAPJ5I76L6GYPKEXA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 14 07:25:10.978386078 (133h59m32.937483327s) [noise=true , address=66.23.193.175:4561 , piece_id=DTXPGEWJ4J6TSG4Z7DB7XJQCUNBU4KVJTIVVBTLPEFTEKKRB5ZTQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection
Aug 14 07:25:10.978404766 (133h59m32.937502014s) [seg_pos={0 0}, upload=139577]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 07:25:10.978549466 (133h59m32.937646702s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 07:25:10.978556260 (133h59m32.937653495s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 07:25:11.265569461 (133h59m33.224666727s) [upload=139577]: Done uploading segments...
Aug 14 07:25:11.265589989 (133h59m33.224687228s) [upload=139577]: Upload finished. err: <nil>
Duration: 2.344358285s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
855.383178ms
FAIL (2025-08-14 08:04:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 07:47:11.992786671 (134h21m33.951883923s) [upload=139963]: Starting upload Aug 14 07:47:11.992860493 (134h21m33.951957737s) [upload=139963]: Done starting upload Aug 14 07:47:11.992934804 (134h21m33.952032051s) [upload=139963]: Uploading segments... Aug 14 07:47:11.993066452 (134h21m33.952163706s) [upload=139963]: Got next segment. Inline: true Aug 14 07:47:11.993074995 (134h21m33.95217223s) [upload=139963]: Waiting for error group managing segments... Aug 14 07:47:11.993140176 (134h21m33.95223741s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 07:47:11.993145821 (134h21m33.952243058s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 07:47:11.993149615 (134h21m33.95224685s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 07:47:12.080107026 (134h21m34.039204272s) [upload=139963]: Done uploading segments... Aug 14 07:47:12.080128377 (134h21m34.039225624s) [upload=139963]: Upload finished. err: metaclient: Too Many Requests
Duration: 855.471898ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.511913113s
FAIL (2025-08-14 08:04:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 07:25:09.956973924 (133h59m31.91607116s) [upload=139577]: Starting upload
Aug 14 07:25:09.957032907 (133h59m31.916130153s) [upload=139577]: Done starting upload
Aug 14 07:25:09.957129748 (133h59m31.916226993s) [upload=139577]: Uploading segments...
Aug 14 07:25:09.957339009 (133h59m31.916436247s) [upload=139577]: Got next segment. Inline: false
Aug 14 07:25:09.957436584 (133h59m31.91653383s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 07:25:09.957443440 (133h59m31.916540685s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 07:25:10.154380951 (133h59m32.113478197s) [seg_pos={0 0}, upload=139577]: Begin upload segment...
Aug 14 07:25:10.154468905 (133h59m32.113566151s) [seg_pos={0 0}, upload=139577]: Done begin upload segment.
Aug 14 07:25:10.154701354 (133h59m32.113798602s) [noise=true , address=77.90.31.12:4614 , piece_id=2HGLRMWPGEX2VE4EAOKW3AURGUOSLPYZJZ6ITWGJFBHHVOKEICKA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.154848318 (133h59m32.113945568s) [noise=true , address=66.23.193.175:4561 , piece_id=DTXPGEWJ4J6TSG4Z7DB7XJQCUNBU4KVJTIVVBTLPEFTEKKRB5ZTQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.155378855 (133h59m32.114476101s) [noise=true , address=104.36.82.39:4726 , piece_id=FNHEEZ32MIL5ETIJUIIPPNZZNKFZOEHSJORPY2B5RDJRWBCW3UBA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.156922693 (133h59m32.116019947s) [noise=true , address=104.36.82.34:4545 , piece_id=PDZLJ5YBBSZCTFEY2G5JUDYF4LKMUQQY3ZTJYKQCAWDYRQCLPIRA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.157691367 (133h59m32.116788622s) [noise=true , address=104.36.82.36:4651 , piece_id=LNFLTNNQQAYVTCFB5DE52K574RYCGC2ESEJLGLXTVNCLEG5DP56Q, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158149663 (133h59m32.117246915s) [noise=true , address=77.90.31.11:4580 , piece_id=RWGPCUVUIGHSZJEJZ2L2KSMRJ4D4ZLZ3H7KYIC3YT32YNL4IXLRA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158463935 (133h59m32.117561186s) [noise=true , address=104.36.82.23:4473 , piece_id=KRYJUMRXK5G3F4QKYH44SFZCI533STE5INLGKXWAVAKM5V7IT2XQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158774796 (133h59m32.117872047s) [noise=true , address=79.127.205.233:4635 , piece_id=CRUUHWDS7CL7C32M2Q65ZJ65RNTHP4NEJ6IH73CP2RCPI64FHMTA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159091926 (133h59m32.11818918s) [noise=true , address=77.90.31.14:4678 , piece_id=H3ZZXOABAEB5PETTSUA6H67A3ONHITRI42ZB7JMFEUGJBL4QWNVQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159433693 (133h59m32.118530973s) [noise=true , address=104.36.82.59:4320 , piece_id=2CDINXZFWNEALAQONUFKZOJXTAHKUR4NK7N5FZEB7LYWQXBQSFBA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159818042 (133h59m32.118915297s) [noise=true , address=77.90.31.18:4818 , piece_id=MWE2FGHHESHPG7I2M454MZKRRX5E3AVSKQGU5T4MYC2TYFW3YSAA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.160391987 (133h59m32.119489233s) [noise=true , address=77.90.31.15:4718 , piece_id=NLG3OVRC57PLR6TXQOFNWNKVMASOUJ3TEACQZ5WPJVPFLELQOXTQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.160892152 (133h59m32.119989383s) [noise=true , address=104.36.82.51:4068 , piece_id=Q3AQZ6YGT2RSJVNH42FGYUKGH6D7UX4I7E7BJD4X6G5X3DIKKNDA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.161379066 (133h59m32.120476321s) [noise=true , address=104.36.82.60:4341 , piece_id=RGUT4D2SW3X3DHQVWDYTGTJYKXDAAWUZYPTL7WMIR6ZEFMHNCYMA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.161738433 (133h59m32.120835689s) [noise=true , address=104.36.82.17:4336 , piece_id=NPMIKZGE5DMIVWUPZNYLJHS5EFHY7PNFWIJY2OBIDNKSZR27RM4Q, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.162169485 (133h59m32.121266732s) [noise=true , address=104.36.82.37:4680 , piece_id=25M2EO245Q66ZYHEIAWHT4B5U23A6GTMMJ3C42BEKTZRDSSBNTNQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.162572296 (133h59m32.121669548s) [noise=true , address=79.127.201.215:4344 , piece_id=KJF7LAUZHBT72YIHN3HMWHNSKAPTOL624UUJAPJ5I76L6GYPKEXA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.163864823 (133h59m32.12296208s) [noise=true , address=104.36.82.44:4881 , piece_id=WXKB4QHLTHHEQBABFNUVW75WAGRAFLF7KBPCD4WCGRARK6PNHK2A, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.725866433 (133h59m32.684963694s) [upload=139577]: Next returned nil segment
Aug 14 07:25:10.725904162 (133h59m32.685001419s) [upload=139577]: Waiting for error group managing segments...
Aug 14 07:25:10.862450158 (133h59m32.821547417s) [noise=true , address=77.90.31.12:4614 , piece_id=2HGLRMWPGEX2VE4EAOKW3AURGUOSLPYZJZ6ITWGJFBHHVOKEICKA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.862709772 (133h59m32.821807018s) [noise=true , address=77.90.31.14:4678 , piece_id=H3ZZXOABAEB5PETTSUA6H67A3ONHITRI42ZB7JMFEUGJBL4QWNVQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.866585589 (133h59m32.825682823s) [noise=true , address=77.90.31.18:4818 , piece_id=MWE2FGHHESHPG7I2M454MZKRRX5E3AVSKQGU5T4MYC2TYFW3YSAA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.874172708 (133h59m32.833270061s) [noise=true , address=77.90.31.15:4718 , piece_id=NLG3OVRC57PLR6TXQOFNWNKVMASOUJ3TEACQZ5WPJVPFLELQOXTQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.874505189 (133h59m32.833602423s) [noise=true , address=77.90.31.11:4580 , piece_id=RWGPCUVUIGHSZJEJZ2L2KSMRJ4D4ZLZ3H7KYIC3YT32YNL4IXLRA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.878471514 (133h59m32.837568761s) [noise=true , address=104.36.82.59:4320 , piece_id=2CDINXZFWNEALAQONUFKZOJXTAHKUR4NK7N5FZEB7LYWQXBQSFBA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.881638470 (133h59m32.840735716s) [noise=true , address=104.36.82.17:4336 , piece_id=NPMIKZGE5DMIVWUPZNYLJHS5EFHY7PNFWIJY2OBIDNKSZR27RM4Q, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.886865828 (133h59m32.845963074s) [noise=true , address=104.36.82.44:4881 , piece_id=WXKB4QHLTHHEQBABFNUVW75WAGRAFLF7KBPCD4WCGRARK6PNHK2A, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.889413475 (133h59m32.848510725s) [noise=true , address=104.36.82.39:4726 , piece_id=FNHEEZ32MIL5ETIJUIIPPNZZNKFZOEHSJORPY2B5RDJRWBCW3UBA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.906945117 (133h59m32.866042362s) [noise=true , address=104.36.82.34:4545 , piece_id=PDZLJ5YBBSZCTFEY2G5JUDYF4LKMUQQY3ZTJYKQCAWDYRQCLPIRA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.907087156 (133h59m32.866184406s) [noise=true , address=104.36.82.37:4680 , piece_id=25M2EO245Q66ZYHEIAWHT4B5U23A6GTMMJ3C42BEKTZRDSSBNTNQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.908961498 (133h59m32.86805873s) [noise=true , address=104.36.82.60:4341 , piece_id=RGUT4D2SW3X3DHQVWDYTGTJYKXDAAWUZYPTL7WMIR6ZEFMHNCYMA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.969332098 (133h59m32.928429338s) [noise=true , address=104.36.82.36:4651 , piece_id=LNFLTNNQQAYVTCFB5DE52K574RYCGC2ESEJLGLXTVNCLEG5DP56Q, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.977796980 (133h59m32.936894233s) [noise=true , address=104.36.82.23:4473 , piece_id=KRYJUMRXK5G3F4QKYH44SFZCI533STE5INLGKXWAVAKM5V7IT2XQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.977845819 (133h59m32.936943071s) [seg_pos={0 0}, upload=139577]: Segment reached optimal threshold of 14 pieces.
Aug 14 07:25:10.978277534 (133h59m32.937374783s) [noise=true , address=79.127.205.233:4635 , piece_id=CRUUHWDS7CL7C32M2Q65ZJ65RNTHP4NEJ6IH73CP2RCPI64FHMTA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZmShGfgfvurAu2DYTpX85R2WbtGx9oeS1gYQ6z17P6FeDrfRt): protocol: write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection; write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection
Aug 14 07:25:10.978292891 (133h59m32.937390139s) [noise=true , address=104.36.82.51:4068 , piece_id=Q3AQZ6YGT2RSJVNH42FGYUKGH6D7UX4I7E7BJD4X6G5X3DIKKNDA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Lh9dYpHCxbs7gpZ4Xt7os5Gm5Nco6jrNW1V1FHddVUEMkFfPY): protocol: expected piece hash; context canceled; EOF
Aug 14 07:25:10.978321765 (133h59m32.937419014s) [noise=true , address=79.127.201.215:4344 , piece_id=KJF7LAUZHBT72YIHN3HMWHNSKAPTOL624UUJAPJ5I76L6GYPKEXA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 14 07:25:10.978386078 (133h59m32.937483327s) [noise=true , address=66.23.193.175:4561 , piece_id=DTXPGEWJ4J6TSG4Z7DB7XJQCUNBU4KVJTIVVBTLPEFTEKKRB5ZTQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection
Aug 14 07:25:10.978404766 (133h59m32.937502014s) [seg_pos={0 0}, upload=139577]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 07:25:10.978549466 (133h59m32.937646702s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 07:25:10.978556260 (133h59m32.937653495s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 07:25:11.265569461 (133h59m33.224666727s) [upload=139577]: Done uploading segments...
Aug 14 07:25:11.265589989 (133h59m33.224687228s) [upload=139577]: Upload finished. err: <nil>
Duration: 2.511953884s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
1.082304205s
FAIL (2025-08-14 08:03:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 07:47:11.992786671 (134h21m33.951883923s) [upload=139963]: Starting upload Aug 14 07:47:11.992860493 (134h21m33.951957737s) [upload=139963]: Done starting upload Aug 14 07:47:11.992934804 (134h21m33.952032051s) [upload=139963]: Uploading segments... Aug 14 07:47:11.993066452 (134h21m33.952163706s) [upload=139963]: Got next segment. Inline: true Aug 14 07:47:11.993074995 (134h21m33.95217223s) [upload=139963]: Waiting for error group managing segments... Aug 14 07:47:11.993140176 (134h21m33.95223741s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 07:47:11.993145821 (134h21m33.952243058s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 07:47:11.993149615 (134h21m33.95224685s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 07:47:12.080107026 (134h21m34.039204272s) [upload=139963]: Done uploading segments... Aug 14 07:47:12.080128377 (134h21m34.039225624s) [upload=139963]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.082376016s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.401237979s
FAIL (2025-08-14 08:03:10 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 07:25:09.956973924 (133h59m31.91607116s) [upload=139577]: Starting upload
Aug 14 07:25:09.957032907 (133h59m31.916130153s) [upload=139577]: Done starting upload
Aug 14 07:25:09.957129748 (133h59m31.916226993s) [upload=139577]: Uploading segments...
Aug 14 07:25:09.957339009 (133h59m31.916436247s) [upload=139577]: Got next segment. Inline: false
Aug 14 07:25:09.957436584 (133h59m31.91653383s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 07:25:09.957443440 (133h59m31.916540685s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 07:25:10.154380951 (133h59m32.113478197s) [seg_pos={0 0}, upload=139577]: Begin upload segment...
Aug 14 07:25:10.154468905 (133h59m32.113566151s) [seg_pos={0 0}, upload=139577]: Done begin upload segment.
Aug 14 07:25:10.154701354 (133h59m32.113798602s) [noise=true , address=77.90.31.12:4614 , piece_id=2HGLRMWPGEX2VE4EAOKW3AURGUOSLPYZJZ6ITWGJFBHHVOKEICKA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.154848318 (133h59m32.113945568s) [noise=true , address=66.23.193.175:4561 , piece_id=DTXPGEWJ4J6TSG4Z7DB7XJQCUNBU4KVJTIVVBTLPEFTEKKRB5ZTQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.155378855 (133h59m32.114476101s) [noise=true , address=104.36.82.39:4726 , piece_id=FNHEEZ32MIL5ETIJUIIPPNZZNKFZOEHSJORPY2B5RDJRWBCW3UBA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.156922693 (133h59m32.116019947s) [noise=true , address=104.36.82.34:4545 , piece_id=PDZLJ5YBBSZCTFEY2G5JUDYF4LKMUQQY3ZTJYKQCAWDYRQCLPIRA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.157691367 (133h59m32.116788622s) [noise=true , address=104.36.82.36:4651 , piece_id=LNFLTNNQQAYVTCFB5DE52K574RYCGC2ESEJLGLXTVNCLEG5DP56Q, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158149663 (133h59m32.117246915s) [noise=true , address=77.90.31.11:4580 , piece_id=RWGPCUVUIGHSZJEJZ2L2KSMRJ4D4ZLZ3H7KYIC3YT32YNL4IXLRA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158463935 (133h59m32.117561186s) [noise=true , address=104.36.82.23:4473 , piece_id=KRYJUMRXK5G3F4QKYH44SFZCI533STE5INLGKXWAVAKM5V7IT2XQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158774796 (133h59m32.117872047s) [noise=true , address=79.127.205.233:4635 , piece_id=CRUUHWDS7CL7C32M2Q65ZJ65RNTHP4NEJ6IH73CP2RCPI64FHMTA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159091926 (133h59m32.11818918s) [noise=true , address=77.90.31.14:4678 , piece_id=H3ZZXOABAEB5PETTSUA6H67A3ONHITRI42ZB7JMFEUGJBL4QWNVQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159433693 (133h59m32.118530973s) [noise=true , address=104.36.82.59:4320 , piece_id=2CDINXZFWNEALAQONUFKZOJXTAHKUR4NK7N5FZEB7LYWQXBQSFBA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159818042 (133h59m32.118915297s) [noise=true , address=77.90.31.18:4818 , piece_id=MWE2FGHHESHPG7I2M454MZKRRX5E3AVSKQGU5T4MYC2TYFW3YSAA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.160391987 (133h59m32.119489233s) [noise=true , address=77.90.31.15:4718 , piece_id=NLG3OVRC57PLR6TXQOFNWNKVMASOUJ3TEACQZ5WPJVPFLELQOXTQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.160892152 (133h59m32.119989383s) [noise=true , address=104.36.82.51:4068 , piece_id=Q3AQZ6YGT2RSJVNH42FGYUKGH6D7UX4I7E7BJD4X6G5X3DIKKNDA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.161379066 (133h59m32.120476321s) [noise=true , address=104.36.82.60:4341 , piece_id=RGUT4D2SW3X3DHQVWDYTGTJYKXDAAWUZYPTL7WMIR6ZEFMHNCYMA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.161738433 (133h59m32.120835689s) [noise=true , address=104.36.82.17:4336 , piece_id=NPMIKZGE5DMIVWUPZNYLJHS5EFHY7PNFWIJY2OBIDNKSZR27RM4Q, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.162169485 (133h59m32.121266732s) [noise=true , address=104.36.82.37:4680 , piece_id=25M2EO245Q66ZYHEIAWHT4B5U23A6GTMMJ3C42BEKTZRDSSBNTNQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.162572296 (133h59m32.121669548s) [noise=true , address=79.127.201.215:4344 , piece_id=KJF7LAUZHBT72YIHN3HMWHNSKAPTOL624UUJAPJ5I76L6GYPKEXA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.163864823 (133h59m32.12296208s) [noise=true , address=104.36.82.44:4881 , piece_id=WXKB4QHLTHHEQBABFNUVW75WAGRAFLF7KBPCD4WCGRARK6PNHK2A, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.725866433 (133h59m32.684963694s) [upload=139577]: Next returned nil segment
Aug 14 07:25:10.725904162 (133h59m32.685001419s) [upload=139577]: Waiting for error group managing segments...
Aug 14 07:25:10.862450158 (133h59m32.821547417s) [noise=true , address=77.90.31.12:4614 , piece_id=2HGLRMWPGEX2VE4EAOKW3AURGUOSLPYZJZ6ITWGJFBHHVOKEICKA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.862709772 (133h59m32.821807018s) [noise=true , address=77.90.31.14:4678 , piece_id=H3ZZXOABAEB5PETTSUA6H67A3ONHITRI42ZB7JMFEUGJBL4QWNVQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.866585589 (133h59m32.825682823s) [noise=true , address=77.90.31.18:4818 , piece_id=MWE2FGHHESHPG7I2M454MZKRRX5E3AVSKQGU5T4MYC2TYFW3YSAA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.874172708 (133h59m32.833270061s) [noise=true , address=77.90.31.15:4718 , piece_id=NLG3OVRC57PLR6TXQOFNWNKVMASOUJ3TEACQZ5WPJVPFLELQOXTQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.874505189 (133h59m32.833602423s) [noise=true , address=77.90.31.11:4580 , piece_id=RWGPCUVUIGHSZJEJZ2L2KSMRJ4D4ZLZ3H7KYIC3YT32YNL4IXLRA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.878471514 (133h59m32.837568761s) [noise=true , address=104.36.82.59:4320 , piece_id=2CDINXZFWNEALAQONUFKZOJXTAHKUR4NK7N5FZEB7LYWQXBQSFBA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.881638470 (133h59m32.840735716s) [noise=true , address=104.36.82.17:4336 , piece_id=NPMIKZGE5DMIVWUPZNYLJHS5EFHY7PNFWIJY2OBIDNKSZR27RM4Q, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.886865828 (133h59m32.845963074s) [noise=true , address=104.36.82.44:4881 , piece_id=WXKB4QHLTHHEQBABFNUVW75WAGRAFLF7KBPCD4WCGRARK6PNHK2A, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.889413475 (133h59m32.848510725s) [noise=true , address=104.36.82.39:4726 , piece_id=FNHEEZ32MIL5ETIJUIIPPNZZNKFZOEHSJORPY2B5RDJRWBCW3UBA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.906945117 (133h59m32.866042362s) [noise=true , address=104.36.82.34:4545 , piece_id=PDZLJ5YBBSZCTFEY2G5JUDYF4LKMUQQY3ZTJYKQCAWDYRQCLPIRA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.907087156 (133h59m32.866184406s) [noise=true , address=104.36.82.37:4680 , piece_id=25M2EO245Q66ZYHEIAWHT4B5U23A6GTMMJ3C42BEKTZRDSSBNTNQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.908961498 (133h59m32.86805873s) [noise=true , address=104.36.82.60:4341 , piece_id=RGUT4D2SW3X3DHQVWDYTGTJYKXDAAWUZYPTL7WMIR6ZEFMHNCYMA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.969332098 (133h59m32.928429338s) [noise=true , address=104.36.82.36:4651 , piece_id=LNFLTNNQQAYVTCFB5DE52K574RYCGC2ESEJLGLXTVNCLEG5DP56Q, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.977796980 (133h59m32.936894233s) [noise=true , address=104.36.82.23:4473 , piece_id=KRYJUMRXK5G3F4QKYH44SFZCI533STE5INLGKXWAVAKM5V7IT2XQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.977845819 (133h59m32.936943071s) [seg_pos={0 0}, upload=139577]: Segment reached optimal threshold of 14 pieces.
Aug 14 07:25:10.978277534 (133h59m32.937374783s) [noise=true , address=79.127.205.233:4635 , piece_id=CRUUHWDS7CL7C32M2Q65ZJ65RNTHP4NEJ6IH73CP2RCPI64FHMTA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZmShGfgfvurAu2DYTpX85R2WbtGx9oeS1gYQ6z17P6FeDrfRt): protocol: write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection; write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection
Aug 14 07:25:10.978292891 (133h59m32.937390139s) [noise=true , address=104.36.82.51:4068 , piece_id=Q3AQZ6YGT2RSJVNH42FGYUKGH6D7UX4I7E7BJD4X6G5X3DIKKNDA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Lh9dYpHCxbs7gpZ4Xt7os5Gm5Nco6jrNW1V1FHddVUEMkFfPY): protocol: expected piece hash; context canceled; EOF
Aug 14 07:25:10.978321765 (133h59m32.937419014s) [noise=true , address=79.127.201.215:4344 , piece_id=KJF7LAUZHBT72YIHN3HMWHNSKAPTOL624UUJAPJ5I76L6GYPKEXA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 14 07:25:10.978386078 (133h59m32.937483327s) [noise=true , address=66.23.193.175:4561 , piece_id=DTXPGEWJ4J6TSG4Z7DB7XJQCUNBU4KVJTIVVBTLPEFTEKKRB5ZTQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection
Aug 14 07:25:10.978404766 (133h59m32.937502014s) [seg_pos={0 0}, upload=139577]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 07:25:10.978549466 (133h59m32.937646702s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 07:25:10.978556260 (133h59m32.937653495s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 07:25:11.265569461 (133h59m33.224666727s) [upload=139577]: Done uploading segments...
Aug 14 07:25:11.265589989 (133h59m33.224687228s) [upload=139577]: Upload finished. err: <nil>
Duration: 2.401268706s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.391275909s
FAIL (2025-08-14 08:02:18 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 07:25:09.956973924 (133h59m31.91607116s) [upload=139577]: Starting upload
Aug 14 07:25:09.957032907 (133h59m31.916130153s) [upload=139577]: Done starting upload
Aug 14 07:25:09.957129748 (133h59m31.916226993s) [upload=139577]: Uploading segments...
Aug 14 07:25:09.957339009 (133h59m31.916436247s) [upload=139577]: Got next segment. Inline: false
Aug 14 07:25:09.957436584 (133h59m31.91653383s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 07:25:09.957443440 (133h59m31.916540685s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 07:25:10.154380951 (133h59m32.113478197s) [seg_pos={0 0}, upload=139577]: Begin upload segment...
Aug 14 07:25:10.154468905 (133h59m32.113566151s) [seg_pos={0 0}, upload=139577]: Done begin upload segment.
Aug 14 07:25:10.154701354 (133h59m32.113798602s) [noise=true , address=77.90.31.12:4614 , piece_id=2HGLRMWPGEX2VE4EAOKW3AURGUOSLPYZJZ6ITWGJFBHHVOKEICKA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.154848318 (133h59m32.113945568s) [noise=true , address=66.23.193.175:4561 , piece_id=DTXPGEWJ4J6TSG4Z7DB7XJQCUNBU4KVJTIVVBTLPEFTEKKRB5ZTQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.155378855 (133h59m32.114476101s) [noise=true , address=104.36.82.39:4726 , piece_id=FNHEEZ32MIL5ETIJUIIPPNZZNKFZOEHSJORPY2B5RDJRWBCW3UBA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.156922693 (133h59m32.116019947s) [noise=true , address=104.36.82.34:4545 , piece_id=PDZLJ5YBBSZCTFEY2G5JUDYF4LKMUQQY3ZTJYKQCAWDYRQCLPIRA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.157691367 (133h59m32.116788622s) [noise=true , address=104.36.82.36:4651 , piece_id=LNFLTNNQQAYVTCFB5DE52K574RYCGC2ESEJLGLXTVNCLEG5DP56Q, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158149663 (133h59m32.117246915s) [noise=true , address=77.90.31.11:4580 , piece_id=RWGPCUVUIGHSZJEJZ2L2KSMRJ4D4ZLZ3H7KYIC3YT32YNL4IXLRA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158463935 (133h59m32.117561186s) [noise=true , address=104.36.82.23:4473 , piece_id=KRYJUMRXK5G3F4QKYH44SFZCI533STE5INLGKXWAVAKM5V7IT2XQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158774796 (133h59m32.117872047s) [noise=true , address=79.127.205.233:4635 , piece_id=CRUUHWDS7CL7C32M2Q65ZJ65RNTHP4NEJ6IH73CP2RCPI64FHMTA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159091926 (133h59m32.11818918s) [noise=true , address=77.90.31.14:4678 , piece_id=H3ZZXOABAEB5PETTSUA6H67A3ONHITRI42ZB7JMFEUGJBL4QWNVQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159433693 (133h59m32.118530973s) [noise=true , address=104.36.82.59:4320 , piece_id=2CDINXZFWNEALAQONUFKZOJXTAHKUR4NK7N5FZEB7LYWQXBQSFBA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159818042 (133h59m32.118915297s) [noise=true , address=77.90.31.18:4818 , piece_id=MWE2FGHHESHPG7I2M454MZKRRX5E3AVSKQGU5T4MYC2TYFW3YSAA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.160391987 (133h59m32.119489233s) [noise=true , address=77.90.31.15:4718 , piece_id=NLG3OVRC57PLR6TXQOFNWNKVMASOUJ3TEACQZ5WPJVPFLELQOXTQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.160892152 (133h59m32.119989383s) [noise=true , address=104.36.82.51:4068 , piece_id=Q3AQZ6YGT2RSJVNH42FGYUKGH6D7UX4I7E7BJD4X6G5X3DIKKNDA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.161379066 (133h59m32.120476321s) [noise=true , address=104.36.82.60:4341 , piece_id=RGUT4D2SW3X3DHQVWDYTGTJYKXDAAWUZYPTL7WMIR6ZEFMHNCYMA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.161738433 (133h59m32.120835689s) [noise=true , address=104.36.82.17:4336 , piece_id=NPMIKZGE5DMIVWUPZNYLJHS5EFHY7PNFWIJY2OBIDNKSZR27RM4Q, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.162169485 (133h59m32.121266732s) [noise=true , address=104.36.82.37:4680 , piece_id=25M2EO245Q66ZYHEIAWHT4B5U23A6GTMMJ3C42BEKTZRDSSBNTNQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.162572296 (133h59m32.121669548s) [noise=true , address=79.127.201.215:4344 , piece_id=KJF7LAUZHBT72YIHN3HMWHNSKAPTOL624UUJAPJ5I76L6GYPKEXA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.163864823 (133h59m32.12296208s) [noise=true , address=104.36.82.44:4881 , piece_id=WXKB4QHLTHHEQBABFNUVW75WAGRAFLF7KBPCD4WCGRARK6PNHK2A, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.725866433 (133h59m32.684963694s) [upload=139577]: Next returned nil segment
Aug 14 07:25:10.725904162 (133h59m32.685001419s) [upload=139577]: Waiting for error group managing segments...
Aug 14 07:25:10.862450158 (133h59m32.821547417s) [noise=true , address=77.90.31.12:4614 , piece_id=2HGLRMWPGEX2VE4EAOKW3AURGUOSLPYZJZ6ITWGJFBHHVOKEICKA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.862709772 (133h59m32.821807018s) [noise=true , address=77.90.31.14:4678 , piece_id=H3ZZXOABAEB5PETTSUA6H67A3ONHITRI42ZB7JMFEUGJBL4QWNVQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.866585589 (133h59m32.825682823s) [noise=true , address=77.90.31.18:4818 , piece_id=MWE2FGHHESHPG7I2M454MZKRRX5E3AVSKQGU5T4MYC2TYFW3YSAA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.874172708 (133h59m32.833270061s) [noise=true , address=77.90.31.15:4718 , piece_id=NLG3OVRC57PLR6TXQOFNWNKVMASOUJ3TEACQZ5WPJVPFLELQOXTQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.874505189 (133h59m32.833602423s) [noise=true , address=77.90.31.11:4580 , piece_id=RWGPCUVUIGHSZJEJZ2L2KSMRJ4D4ZLZ3H7KYIC3YT32YNL4IXLRA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.878471514 (133h59m32.837568761s) [noise=true , address=104.36.82.59:4320 , piece_id=2CDINXZFWNEALAQONUFKZOJXTAHKUR4NK7N5FZEB7LYWQXBQSFBA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.881638470 (133h59m32.840735716s) [noise=true , address=104.36.82.17:4336 , piece_id=NPMIKZGE5DMIVWUPZNYLJHS5EFHY7PNFWIJY2OBIDNKSZR27RM4Q, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.886865828 (133h59m32.845963074s) [noise=true , address=104.36.82.44:4881 , piece_id=WXKB4QHLTHHEQBABFNUVW75WAGRAFLF7KBPCD4WCGRARK6PNHK2A, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.889413475 (133h59m32.848510725s) [noise=true , address=104.36.82.39:4726 , piece_id=FNHEEZ32MIL5ETIJUIIPPNZZNKFZOEHSJORPY2B5RDJRWBCW3UBA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.906945117 (133h59m32.866042362s) [noise=true , address=104.36.82.34:4545 , piece_id=PDZLJ5YBBSZCTFEY2G5JUDYF4LKMUQQY3ZTJYKQCAWDYRQCLPIRA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.907087156 (133h59m32.866184406s) [noise=true , address=104.36.82.37:4680 , piece_id=25M2EO245Q66ZYHEIAWHT4B5U23A6GTMMJ3C42BEKTZRDSSBNTNQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.908961498 (133h59m32.86805873s) [noise=true , address=104.36.82.60:4341 , piece_id=RGUT4D2SW3X3DHQVWDYTGTJYKXDAAWUZYPTL7WMIR6ZEFMHNCYMA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.969332098 (133h59m32.928429338s) [noise=true , address=104.36.82.36:4651 , piece_id=LNFLTNNQQAYVTCFB5DE52K574RYCGC2ESEJLGLXTVNCLEG5DP56Q, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.977796980 (133h59m32.936894233s) [noise=true , address=104.36.82.23:4473 , piece_id=KRYJUMRXK5G3F4QKYH44SFZCI533STE5INLGKXWAVAKM5V7IT2XQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.977845819 (133h59m32.936943071s) [seg_pos={0 0}, upload=139577]: Segment reached optimal threshold of 14 pieces.
Aug 14 07:25:10.978277534 (133h59m32.937374783s) [noise=true , address=79.127.205.233:4635 , piece_id=CRUUHWDS7CL7C32M2Q65ZJ65RNTHP4NEJ6IH73CP2RCPI64FHMTA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZmShGfgfvurAu2DYTpX85R2WbtGx9oeS1gYQ6z17P6FeDrfRt): protocol: write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection; write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection
Aug 14 07:25:10.978292891 (133h59m32.937390139s) [noise=true , address=104.36.82.51:4068 , piece_id=Q3AQZ6YGT2RSJVNH42FGYUKGH6D7UX4I7E7BJD4X6G5X3DIKKNDA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Lh9dYpHCxbs7gpZ4Xt7os5Gm5Nco6jrNW1V1FHddVUEMkFfPY): protocol: expected piece hash; context canceled; EOF
Aug 14 07:25:10.978321765 (133h59m32.937419014s) [noise=true , address=79.127.201.215:4344 , piece_id=KJF7LAUZHBT72YIHN3HMWHNSKAPTOL624UUJAPJ5I76L6GYPKEXA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 14 07:25:10.978386078 (133h59m32.937483327s) [noise=true , address=66.23.193.175:4561 , piece_id=DTXPGEWJ4J6TSG4Z7DB7XJQCUNBU4KVJTIVVBTLPEFTEKKRB5ZTQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection
Aug 14 07:25:10.978404766 (133h59m32.937502014s) [seg_pos={0 0}, upload=139577]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 07:25:10.978549466 (133h59m32.937646702s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 07:25:10.978556260 (133h59m32.937653495s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 07:25:11.265569461 (133h59m33.224666727s) [upload=139577]: Done uploading segments...
Aug 14 07:25:11.265589989 (133h59m33.224687228s) [upload=139577]: Upload finished. err: <nil>
Duration: 2.391307309s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
831.948466ms
FAIL (2025-08-14 08:02:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 07:47:11.992786671 (134h21m33.951883923s) [upload=139963]: Starting upload Aug 14 07:47:11.992860493 (134h21m33.951957737s) [upload=139963]: Done starting upload Aug 14 07:47:11.992934804 (134h21m33.952032051s) [upload=139963]: Uploading segments... Aug 14 07:47:11.993066452 (134h21m33.952163706s) [upload=139963]: Got next segment. Inline: true Aug 14 07:47:11.993074995 (134h21m33.95217223s) [upload=139963]: Waiting for error group managing segments... Aug 14 07:47:11.993140176 (134h21m33.95223741s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 07:47:11.993145821 (134h21m33.952243058s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 07:47:11.993149615 (134h21m33.95224685s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 07:47:12.080107026 (134h21m34.039204272s) [upload=139963]: Done uploading segments... Aug 14 07:47:12.080128377 (134h21m34.039225624s) [upload=139963]: Upload finished. err: metaclient: Too Many Requests
Duration: 831.99685ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
3.002975188s
FAIL (2025-08-14 08:01:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 07:25:09.956973924 (133h59m31.91607116s) [upload=139577]: Starting upload
Aug 14 07:25:09.957032907 (133h59m31.916130153s) [upload=139577]: Done starting upload
Aug 14 07:25:09.957129748 (133h59m31.916226993s) [upload=139577]: Uploading segments...
Aug 14 07:25:09.957339009 (133h59m31.916436247s) [upload=139577]: Got next segment. Inline: false
Aug 14 07:25:09.957436584 (133h59m31.91653383s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 07:25:09.957443440 (133h59m31.916540685s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 07:25:10.154380951 (133h59m32.113478197s) [seg_pos={0 0}, upload=139577]: Begin upload segment...
Aug 14 07:25:10.154468905 (133h59m32.113566151s) [seg_pos={0 0}, upload=139577]: Done begin upload segment.
Aug 14 07:25:10.154701354 (133h59m32.113798602s) [noise=true , address=77.90.31.12:4614 , piece_id=2HGLRMWPGEX2VE4EAOKW3AURGUOSLPYZJZ6ITWGJFBHHVOKEICKA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.154848318 (133h59m32.113945568s) [noise=true , address=66.23.193.175:4561 , piece_id=DTXPGEWJ4J6TSG4Z7DB7XJQCUNBU4KVJTIVVBTLPEFTEKKRB5ZTQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.155378855 (133h59m32.114476101s) [noise=true , address=104.36.82.39:4726 , piece_id=FNHEEZ32MIL5ETIJUIIPPNZZNKFZOEHSJORPY2B5RDJRWBCW3UBA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.156922693 (133h59m32.116019947s) [noise=true , address=104.36.82.34:4545 , piece_id=PDZLJ5YBBSZCTFEY2G5JUDYF4LKMUQQY3ZTJYKQCAWDYRQCLPIRA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.157691367 (133h59m32.116788622s) [noise=true , address=104.36.82.36:4651 , piece_id=LNFLTNNQQAYVTCFB5DE52K574RYCGC2ESEJLGLXTVNCLEG5DP56Q, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158149663 (133h59m32.117246915s) [noise=true , address=77.90.31.11:4580 , piece_id=RWGPCUVUIGHSZJEJZ2L2KSMRJ4D4ZLZ3H7KYIC3YT32YNL4IXLRA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158463935 (133h59m32.117561186s) [noise=true , address=104.36.82.23:4473 , piece_id=KRYJUMRXK5G3F4QKYH44SFZCI533STE5INLGKXWAVAKM5V7IT2XQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158774796 (133h59m32.117872047s) [noise=true , address=79.127.205.233:4635 , piece_id=CRUUHWDS7CL7C32M2Q65ZJ65RNTHP4NEJ6IH73CP2RCPI64FHMTA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159091926 (133h59m32.11818918s) [noise=true , address=77.90.31.14:4678 , piece_id=H3ZZXOABAEB5PETTSUA6H67A3ONHITRI42ZB7JMFEUGJBL4QWNVQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159433693 (133h59m32.118530973s) [noise=true , address=104.36.82.59:4320 , piece_id=2CDINXZFWNEALAQONUFKZOJXTAHKUR4NK7N5FZEB7LYWQXBQSFBA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159818042 (133h59m32.118915297s) [noise=true , address=77.90.31.18:4818 , piece_id=MWE2FGHHESHPG7I2M454MZKRRX5E3AVSKQGU5T4MYC2TYFW3YSAA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.160391987 (133h59m32.119489233s) [noise=true , address=77.90.31.15:4718 , piece_id=NLG3OVRC57PLR6TXQOFNWNKVMASOUJ3TEACQZ5WPJVPFLELQOXTQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.160892152 (133h59m32.119989383s) [noise=true , address=104.36.82.51:4068 , piece_id=Q3AQZ6YGT2RSJVNH42FGYUKGH6D7UX4I7E7BJD4X6G5X3DIKKNDA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.161379066 (133h59m32.120476321s) [noise=true , address=104.36.82.60:4341 , piece_id=RGUT4D2SW3X3DHQVWDYTGTJYKXDAAWUZYPTL7WMIR6ZEFMHNCYMA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.161738433 (133h59m32.120835689s) [noise=true , address=104.36.82.17:4336 , piece_id=NPMIKZGE5DMIVWUPZNYLJHS5EFHY7PNFWIJY2OBIDNKSZR27RM4Q, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.162169485 (133h59m32.121266732s) [noise=true , address=104.36.82.37:4680 , piece_id=25M2EO245Q66ZYHEIAWHT4B5U23A6GTMMJ3C42BEKTZRDSSBNTNQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.162572296 (133h59m32.121669548s) [noise=true , address=79.127.201.215:4344 , piece_id=KJF7LAUZHBT72YIHN3HMWHNSKAPTOL624UUJAPJ5I76L6GYPKEXA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.163864823 (133h59m32.12296208s) [noise=true , address=104.36.82.44:4881 , piece_id=WXKB4QHLTHHEQBABFNUVW75WAGRAFLF7KBPCD4WCGRARK6PNHK2A, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.725866433 (133h59m32.684963694s) [upload=139577]: Next returned nil segment
Aug 14 07:25:10.725904162 (133h59m32.685001419s) [upload=139577]: Waiting for error group managing segments...
Aug 14 07:25:10.862450158 (133h59m32.821547417s) [noise=true , address=77.90.31.12:4614 , piece_id=2HGLRMWPGEX2VE4EAOKW3AURGUOSLPYZJZ6ITWGJFBHHVOKEICKA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.862709772 (133h59m32.821807018s) [noise=true , address=77.90.31.14:4678 , piece_id=H3ZZXOABAEB5PETTSUA6H67A3ONHITRI42ZB7JMFEUGJBL4QWNVQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.866585589 (133h59m32.825682823s) [noise=true , address=77.90.31.18:4818 , piece_id=MWE2FGHHESHPG7I2M454MZKRRX5E3AVSKQGU5T4MYC2TYFW3YSAA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.874172708 (133h59m32.833270061s) [noise=true , address=77.90.31.15:4718 , piece_id=NLG3OVRC57PLR6TXQOFNWNKVMASOUJ3TEACQZ5WPJVPFLELQOXTQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.874505189 (133h59m32.833602423s) [noise=true , address=77.90.31.11:4580 , piece_id=RWGPCUVUIGHSZJEJZ2L2KSMRJ4D4ZLZ3H7KYIC3YT32YNL4IXLRA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.878471514 (133h59m32.837568761s) [noise=true , address=104.36.82.59:4320 , piece_id=2CDINXZFWNEALAQONUFKZOJXTAHKUR4NK7N5FZEB7LYWQXBQSFBA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.881638470 (133h59m32.840735716s) [noise=true , address=104.36.82.17:4336 , piece_id=NPMIKZGE5DMIVWUPZNYLJHS5EFHY7PNFWIJY2OBIDNKSZR27RM4Q, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.886865828 (133h59m32.845963074s) [noise=true , address=104.36.82.44:4881 , piece_id=WXKB4QHLTHHEQBABFNUVW75WAGRAFLF7KBPCD4WCGRARK6PNHK2A, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.889413475 (133h59m32.848510725s) [noise=true , address=104.36.82.39:4726 , piece_id=FNHEEZ32MIL5ETIJUIIPPNZZNKFZOEHSJORPY2B5RDJRWBCW3UBA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.906945117 (133h59m32.866042362s) [noise=true , address=104.36.82.34:4545 , piece_id=PDZLJ5YBBSZCTFEY2G5JUDYF4LKMUQQY3ZTJYKQCAWDYRQCLPIRA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.907087156 (133h59m32.866184406s) [noise=true , address=104.36.82.37:4680 , piece_id=25M2EO245Q66ZYHEIAWHT4B5U23A6GTMMJ3C42BEKTZRDSSBNTNQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.908961498 (133h59m32.86805873s) [noise=true , address=104.36.82.60:4341 , piece_id=RGUT4D2SW3X3DHQVWDYTGTJYKXDAAWUZYPTL7WMIR6ZEFMHNCYMA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.969332098 (133h59m32.928429338s) [noise=true , address=104.36.82.36:4651 , piece_id=LNFLTNNQQAYVTCFB5DE52K574RYCGC2ESEJLGLXTVNCLEG5DP56Q, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.977796980 (133h59m32.936894233s) [noise=true , address=104.36.82.23:4473 , piece_id=KRYJUMRXK5G3F4QKYH44SFZCI533STE5INLGKXWAVAKM5V7IT2XQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.977845819 (133h59m32.936943071s) [seg_pos={0 0}, upload=139577]: Segment reached optimal threshold of 14 pieces.
Aug 14 07:25:10.978277534 (133h59m32.937374783s) [noise=true , address=79.127.205.233:4635 , piece_id=CRUUHWDS7CL7C32M2Q65ZJ65RNTHP4NEJ6IH73CP2RCPI64FHMTA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZmShGfgfvurAu2DYTpX85R2WbtGx9oeS1gYQ6z17P6FeDrfRt): protocol: write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection; write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection
Aug 14 07:25:10.978292891 (133h59m32.937390139s) [noise=true , address=104.36.82.51:4068 , piece_id=Q3AQZ6YGT2RSJVNH42FGYUKGH6D7UX4I7E7BJD4X6G5X3DIKKNDA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Lh9dYpHCxbs7gpZ4Xt7os5Gm5Nco6jrNW1V1FHddVUEMkFfPY): protocol: expected piece hash; context canceled; EOF
Aug 14 07:25:10.978321765 (133h59m32.937419014s) [noise=true , address=79.127.201.215:4344 , piece_id=KJF7LAUZHBT72YIHN3HMWHNSKAPTOL624UUJAPJ5I76L6GYPKEXA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 14 07:25:10.978386078 (133h59m32.937483327s) [noise=true , address=66.23.193.175:4561 , piece_id=DTXPGEWJ4J6TSG4Z7DB7XJQCUNBU4KVJTIVVBTLPEFTEKKRB5ZTQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection
Aug 14 07:25:10.978404766 (133h59m32.937502014s) [seg_pos={0 0}, upload=139577]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 07:25:10.978549466 (133h59m32.937646702s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 07:25:10.978556260 (133h59m32.937653495s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 07:25:11.265569461 (133h59m33.224666727s) [upload=139577]: Done uploading segments...
Aug 14 07:25:11.265589989 (133h59m33.224687228s) [upload=139577]: Upload finished. err: <nil>
Duration: 3.003015355s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
830.039341ms
FAIL (2025-08-14 08:01:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 07:47:11.992786671 (134h21m33.951883923s) [upload=139963]: Starting upload Aug 14 07:47:11.992860493 (134h21m33.951957737s) [upload=139963]: Done starting upload Aug 14 07:47:11.992934804 (134h21m33.952032051s) [upload=139963]: Uploading segments... Aug 14 07:47:11.993066452 (134h21m33.952163706s) [upload=139963]: Got next segment. Inline: true Aug 14 07:47:11.993074995 (134h21m33.95217223s) [upload=139963]: Waiting for error group managing segments... Aug 14 07:47:11.993140176 (134h21m33.95223741s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 07:47:11.993145821 (134h21m33.952243058s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 07:47:11.993149615 (134h21m33.95224685s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 07:47:12.080107026 (134h21m34.039204272s) [upload=139963]: Done uploading segments... Aug 14 07:47:12.080128377 (134h21m34.039225624s) [upload=139963]: Upload finished. err: metaclient: Too Many Requests
Duration: 830.080386ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.467764551s
FAIL (2025-08-14 08:00:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 07:25:09.956973924 (133h59m31.91607116s) [upload=139577]: Starting upload
Aug 14 07:25:09.957032907 (133h59m31.916130153s) [upload=139577]: Done starting upload
Aug 14 07:25:09.957129748 (133h59m31.916226993s) [upload=139577]: Uploading segments...
Aug 14 07:25:09.957339009 (133h59m31.916436247s) [upload=139577]: Got next segment. Inline: false
Aug 14 07:25:09.957436584 (133h59m31.91653383s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 07:25:09.957443440 (133h59m31.916540685s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 07:25:10.154380951 (133h59m32.113478197s) [seg_pos={0 0}, upload=139577]: Begin upload segment...
Aug 14 07:25:10.154468905 (133h59m32.113566151s) [seg_pos={0 0}, upload=139577]: Done begin upload segment.
Aug 14 07:25:10.154701354 (133h59m32.113798602s) [noise=true , address=77.90.31.12:4614 , piece_id=2HGLRMWPGEX2VE4EAOKW3AURGUOSLPYZJZ6ITWGJFBHHVOKEICKA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.154848318 (133h59m32.113945568s) [noise=true , address=66.23.193.175:4561 , piece_id=DTXPGEWJ4J6TSG4Z7DB7XJQCUNBU4KVJTIVVBTLPEFTEKKRB5ZTQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.155378855 (133h59m32.114476101s) [noise=true , address=104.36.82.39:4726 , piece_id=FNHEEZ32MIL5ETIJUIIPPNZZNKFZOEHSJORPY2B5RDJRWBCW3UBA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.156922693 (133h59m32.116019947s) [noise=true , address=104.36.82.34:4545 , piece_id=PDZLJ5YBBSZCTFEY2G5JUDYF4LKMUQQY3ZTJYKQCAWDYRQCLPIRA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.157691367 (133h59m32.116788622s) [noise=true , address=104.36.82.36:4651 , piece_id=LNFLTNNQQAYVTCFB5DE52K574RYCGC2ESEJLGLXTVNCLEG5DP56Q, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158149663 (133h59m32.117246915s) [noise=true , address=77.90.31.11:4580 , piece_id=RWGPCUVUIGHSZJEJZ2L2KSMRJ4D4ZLZ3H7KYIC3YT32YNL4IXLRA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158463935 (133h59m32.117561186s) [noise=true , address=104.36.82.23:4473 , piece_id=KRYJUMRXK5G3F4QKYH44SFZCI533STE5INLGKXWAVAKM5V7IT2XQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158774796 (133h59m32.117872047s) [noise=true , address=79.127.205.233:4635 , piece_id=CRUUHWDS7CL7C32M2Q65ZJ65RNTHP4NEJ6IH73CP2RCPI64FHMTA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159091926 (133h59m32.11818918s) [noise=true , address=77.90.31.14:4678 , piece_id=H3ZZXOABAEB5PETTSUA6H67A3ONHITRI42ZB7JMFEUGJBL4QWNVQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159433693 (133h59m32.118530973s) [noise=true , address=104.36.82.59:4320 , piece_id=2CDINXZFWNEALAQONUFKZOJXTAHKUR4NK7N5FZEB7LYWQXBQSFBA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159818042 (133h59m32.118915297s) [noise=true , address=77.90.31.18:4818 , piece_id=MWE2FGHHESHPG7I2M454MZKRRX5E3AVSKQGU5T4MYC2TYFW3YSAA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.160391987 (133h59m32.119489233s) [noise=true , address=77.90.31.15:4718 , piece_id=NLG3OVRC57PLR6TXQOFNWNKVMASOUJ3TEACQZ5WPJVPFLELQOXTQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.160892152 (133h59m32.119989383s) [noise=true , address=104.36.82.51:4068 , piece_id=Q3AQZ6YGT2RSJVNH42FGYUKGH6D7UX4I7E7BJD4X6G5X3DIKKNDA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.161379066 (133h59m32.120476321s) [noise=true , address=104.36.82.60:4341 , piece_id=RGUT4D2SW3X3DHQVWDYTGTJYKXDAAWUZYPTL7WMIR6ZEFMHNCYMA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.161738433 (133h59m32.120835689s) [noise=true , address=104.36.82.17:4336 , piece_id=NPMIKZGE5DMIVWUPZNYLJHS5EFHY7PNFWIJY2OBIDNKSZR27RM4Q, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.162169485 (133h59m32.121266732s) [noise=true , address=104.36.82.37:4680 , piece_id=25M2EO245Q66ZYHEIAWHT4B5U23A6GTMMJ3C42BEKTZRDSSBNTNQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.162572296 (133h59m32.121669548s) [noise=true , address=79.127.201.215:4344 , piece_id=KJF7LAUZHBT72YIHN3HMWHNSKAPTOL624UUJAPJ5I76L6GYPKEXA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.163864823 (133h59m32.12296208s) [noise=true , address=104.36.82.44:4881 , piece_id=WXKB4QHLTHHEQBABFNUVW75WAGRAFLF7KBPCD4WCGRARK6PNHK2A, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.725866433 (133h59m32.684963694s) [upload=139577]: Next returned nil segment
Aug 14 07:25:10.725904162 (133h59m32.685001419s) [upload=139577]: Waiting for error group managing segments...
Aug 14 07:25:10.862450158 (133h59m32.821547417s) [noise=true , address=77.90.31.12:4614 , piece_id=2HGLRMWPGEX2VE4EAOKW3AURGUOSLPYZJZ6ITWGJFBHHVOKEICKA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.862709772 (133h59m32.821807018s) [noise=true , address=77.90.31.14:4678 , piece_id=H3ZZXOABAEB5PETTSUA6H67A3ONHITRI42ZB7JMFEUGJBL4QWNVQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.866585589 (133h59m32.825682823s) [noise=true , address=77.90.31.18:4818 , piece_id=MWE2FGHHESHPG7I2M454MZKRRX5E3AVSKQGU5T4MYC2TYFW3YSAA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.874172708 (133h59m32.833270061s) [noise=true , address=77.90.31.15:4718 , piece_id=NLG3OVRC57PLR6TXQOFNWNKVMASOUJ3TEACQZ5WPJVPFLELQOXTQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.874505189 (133h59m32.833602423s) [noise=true , address=77.90.31.11:4580 , piece_id=RWGPCUVUIGHSZJEJZ2L2KSMRJ4D4ZLZ3H7KYIC3YT32YNL4IXLRA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.878471514 (133h59m32.837568761s) [noise=true , address=104.36.82.59:4320 , piece_id=2CDINXZFWNEALAQONUFKZOJXTAHKUR4NK7N5FZEB7LYWQXBQSFBA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.881638470 (133h59m32.840735716s) [noise=true , address=104.36.82.17:4336 , piece_id=NPMIKZGE5DMIVWUPZNYLJHS5EFHY7PNFWIJY2OBIDNKSZR27RM4Q, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.886865828 (133h59m32.845963074s) [noise=true , address=104.36.82.44:4881 , piece_id=WXKB4QHLTHHEQBABFNUVW75WAGRAFLF7KBPCD4WCGRARK6PNHK2A, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.889413475 (133h59m32.848510725s) [noise=true , address=104.36.82.39:4726 , piece_id=FNHEEZ32MIL5ETIJUIIPPNZZNKFZOEHSJORPY2B5RDJRWBCW3UBA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.906945117 (133h59m32.866042362s) [noise=true , address=104.36.82.34:4545 , piece_id=PDZLJ5YBBSZCTFEY2G5JUDYF4LKMUQQY3ZTJYKQCAWDYRQCLPIRA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.907087156 (133h59m32.866184406s) [noise=true , address=104.36.82.37:4680 , piece_id=25M2EO245Q66ZYHEIAWHT4B5U23A6GTMMJ3C42BEKTZRDSSBNTNQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.908961498 (133h59m32.86805873s) [noise=true , address=104.36.82.60:4341 , piece_id=RGUT4D2SW3X3DHQVWDYTGTJYKXDAAWUZYPTL7WMIR6ZEFMHNCYMA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.969332098 (133h59m32.928429338s) [noise=true , address=104.36.82.36:4651 , piece_id=LNFLTNNQQAYVTCFB5DE52K574RYCGC2ESEJLGLXTVNCLEG5DP56Q, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.977796980 (133h59m32.936894233s) [noise=true , address=104.36.82.23:4473 , piece_id=KRYJUMRXK5G3F4QKYH44SFZCI533STE5INLGKXWAVAKM5V7IT2XQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.977845819 (133h59m32.936943071s) [seg_pos={0 0}, upload=139577]: Segment reached optimal threshold of 14 pieces.
Aug 14 07:25:10.978277534 (133h59m32.937374783s) [noise=true , address=79.127.205.233:4635 , piece_id=CRUUHWDS7CL7C32M2Q65ZJ65RNTHP4NEJ6IH73CP2RCPI64FHMTA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZmShGfgfvurAu2DYTpX85R2WbtGx9oeS1gYQ6z17P6FeDrfRt): protocol: write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection; write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection
Aug 14 07:25:10.978292891 (133h59m32.937390139s) [noise=true , address=104.36.82.51:4068 , piece_id=Q3AQZ6YGT2RSJVNH42FGYUKGH6D7UX4I7E7BJD4X6G5X3DIKKNDA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Lh9dYpHCxbs7gpZ4Xt7os5Gm5Nco6jrNW1V1FHddVUEMkFfPY): protocol: expected piece hash; context canceled; EOF
Aug 14 07:25:10.978321765 (133h59m32.937419014s) [noise=true , address=79.127.201.215:4344 , piece_id=KJF7LAUZHBT72YIHN3HMWHNSKAPTOL624UUJAPJ5I76L6GYPKEXA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 14 07:25:10.978386078 (133h59m32.937483327s) [noise=true , address=66.23.193.175:4561 , piece_id=DTXPGEWJ4J6TSG4Z7DB7XJQCUNBU4KVJTIVVBTLPEFTEKKRB5ZTQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection
Aug 14 07:25:10.978404766 (133h59m32.937502014s) [seg_pos={0 0}, upload=139577]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 07:25:10.978549466 (133h59m32.937646702s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 07:25:10.978556260 (133h59m32.937653495s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 07:25:11.265569461 (133h59m33.224666727s) [upload=139577]: Done uploading segments...
Aug 14 07:25:11.265589989 (133h59m33.224687228s) [upload=139577]: Upload finished. err: <nil>
Duration: 2.467859857s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
949.177013ms
FAIL (2025-08-14 08:00:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 07:47:11.992786671 (134h21m33.951883923s) [upload=139963]: Starting upload Aug 14 07:47:11.992860493 (134h21m33.951957737s) [upload=139963]: Done starting upload Aug 14 07:47:11.992934804 (134h21m33.952032051s) [upload=139963]: Uploading segments... Aug 14 07:47:11.993066452 (134h21m33.952163706s) [upload=139963]: Got next segment. Inline: true Aug 14 07:47:11.993074995 (134h21m33.95217223s) [upload=139963]: Waiting for error group managing segments... Aug 14 07:47:11.993140176 (134h21m33.95223741s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 07:47:11.993145821 (134h21m33.952243058s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 07:47:11.993149615 (134h21m33.95224685s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 07:47:12.080107026 (134h21m34.039204272s) [upload=139963]: Done uploading segments... Aug 14 07:47:12.080128377 (134h21m34.039225624s) [upload=139963]: Upload finished. err: metaclient: Too Many Requests
Duration: 949.232953ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
2.302828783s
FAIL (2025-08-14 07:59:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 07:25:09.956973924 (133h59m31.91607116s) [upload=139577]: Starting upload
Aug 14 07:25:09.957032907 (133h59m31.916130153s) [upload=139577]: Done starting upload
Aug 14 07:25:09.957129748 (133h59m31.916226993s) [upload=139577]: Uploading segments...
Aug 14 07:25:09.957339009 (133h59m31.916436247s) [upload=139577]: Got next segment. Inline: false
Aug 14 07:25:09.957436584 (133h59m31.91653383s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 07:25:09.957443440 (133h59m31.916540685s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 07:25:10.154380951 (133h59m32.113478197s) [seg_pos={0 0}, upload=139577]: Begin upload segment...
Aug 14 07:25:10.154468905 (133h59m32.113566151s) [seg_pos={0 0}, upload=139577]: Done begin upload segment.
Aug 14 07:25:10.154701354 (133h59m32.113798602s) [noise=true , address=77.90.31.12:4614 , piece_id=2HGLRMWPGEX2VE4EAOKW3AURGUOSLPYZJZ6ITWGJFBHHVOKEICKA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.154848318 (133h59m32.113945568s) [noise=true , address=66.23.193.175:4561 , piece_id=DTXPGEWJ4J6TSG4Z7DB7XJQCUNBU4KVJTIVVBTLPEFTEKKRB5ZTQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.155378855 (133h59m32.114476101s) [noise=true , address=104.36.82.39:4726 , piece_id=FNHEEZ32MIL5ETIJUIIPPNZZNKFZOEHSJORPY2B5RDJRWBCW3UBA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.156922693 (133h59m32.116019947s) [noise=true , address=104.36.82.34:4545 , piece_id=PDZLJ5YBBSZCTFEY2G5JUDYF4LKMUQQY3ZTJYKQCAWDYRQCLPIRA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.157691367 (133h59m32.116788622s) [noise=true , address=104.36.82.36:4651 , piece_id=LNFLTNNQQAYVTCFB5DE52K574RYCGC2ESEJLGLXTVNCLEG5DP56Q, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158149663 (133h59m32.117246915s) [noise=true , address=77.90.31.11:4580 , piece_id=RWGPCUVUIGHSZJEJZ2L2KSMRJ4D4ZLZ3H7KYIC3YT32YNL4IXLRA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158463935 (133h59m32.117561186s) [noise=true , address=104.36.82.23:4473 , piece_id=KRYJUMRXK5G3F4QKYH44SFZCI533STE5INLGKXWAVAKM5V7IT2XQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158774796 (133h59m32.117872047s) [noise=true , address=79.127.205.233:4635 , piece_id=CRUUHWDS7CL7C32M2Q65ZJ65RNTHP4NEJ6IH73CP2RCPI64FHMTA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159091926 (133h59m32.11818918s) [noise=true , address=77.90.31.14:4678 , piece_id=H3ZZXOABAEB5PETTSUA6H67A3ONHITRI42ZB7JMFEUGJBL4QWNVQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159433693 (133h59m32.118530973s) [noise=true , address=104.36.82.59:4320 , piece_id=2CDINXZFWNEALAQONUFKZOJXTAHKUR4NK7N5FZEB7LYWQXBQSFBA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159818042 (133h59m32.118915297s) [noise=true , address=77.90.31.18:4818 , piece_id=MWE2FGHHESHPG7I2M454MZKRRX5E3AVSKQGU5T4MYC2TYFW3YSAA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.160391987 (133h59m32.119489233s) [noise=true , address=77.90.31.15:4718 , piece_id=NLG3OVRC57PLR6TXQOFNWNKVMASOUJ3TEACQZ5WPJVPFLELQOXTQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.160892152 (133h59m32.119989383s) [noise=true , address=104.36.82.51:4068 , piece_id=Q3AQZ6YGT2RSJVNH42FGYUKGH6D7UX4I7E7BJD4X6G5X3DIKKNDA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.161379066 (133h59m32.120476321s) [noise=true , address=104.36.82.60:4341 , piece_id=RGUT4D2SW3X3DHQVWDYTGTJYKXDAAWUZYPTL7WMIR6ZEFMHNCYMA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.161738433 (133h59m32.120835689s) [noise=true , address=104.36.82.17:4336 , piece_id=NPMIKZGE5DMIVWUPZNYLJHS5EFHY7PNFWIJY2OBIDNKSZR27RM4Q, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.162169485 (133h59m32.121266732s) [noise=true , address=104.36.82.37:4680 , piece_id=25M2EO245Q66ZYHEIAWHT4B5U23A6GTMMJ3C42BEKTZRDSSBNTNQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.162572296 (133h59m32.121669548s) [noise=true , address=79.127.201.215:4344 , piece_id=KJF7LAUZHBT72YIHN3HMWHNSKAPTOL624UUJAPJ5I76L6GYPKEXA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.163864823 (133h59m32.12296208s) [noise=true , address=104.36.82.44:4881 , piece_id=WXKB4QHLTHHEQBABFNUVW75WAGRAFLF7KBPCD4WCGRARK6PNHK2A, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.725866433 (133h59m32.684963694s) [upload=139577]: Next returned nil segment
Aug 14 07:25:10.725904162 (133h59m32.685001419s) [upload=139577]: Waiting for error group managing segments...
Aug 14 07:25:10.862450158 (133h59m32.821547417s) [noise=true , address=77.90.31.12:4614 , piece_id=2HGLRMWPGEX2VE4EAOKW3AURGUOSLPYZJZ6ITWGJFBHHVOKEICKA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.862709772 (133h59m32.821807018s) [noise=true , address=77.90.31.14:4678 , piece_id=H3ZZXOABAEB5PETTSUA6H67A3ONHITRI42ZB7JMFEUGJBL4QWNVQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.866585589 (133h59m32.825682823s) [noise=true , address=77.90.31.18:4818 , piece_id=MWE2FGHHESHPG7I2M454MZKRRX5E3AVSKQGU5T4MYC2TYFW3YSAA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.874172708 (133h59m32.833270061s) [noise=true , address=77.90.31.15:4718 , piece_id=NLG3OVRC57PLR6TXQOFNWNKVMASOUJ3TEACQZ5WPJVPFLELQOXTQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.874505189 (133h59m32.833602423s) [noise=true , address=77.90.31.11:4580 , piece_id=RWGPCUVUIGHSZJEJZ2L2KSMRJ4D4ZLZ3H7KYIC3YT32YNL4IXLRA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.878471514 (133h59m32.837568761s) [noise=true , address=104.36.82.59:4320 , piece_id=2CDINXZFWNEALAQONUFKZOJXTAHKUR4NK7N5FZEB7LYWQXBQSFBA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.881638470 (133h59m32.840735716s) [noise=true , address=104.36.82.17:4336 , piece_id=NPMIKZGE5DMIVWUPZNYLJHS5EFHY7PNFWIJY2OBIDNKSZR27RM4Q, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.886865828 (133h59m32.845963074s) [noise=true , address=104.36.82.44:4881 , piece_id=WXKB4QHLTHHEQBABFNUVW75WAGRAFLF7KBPCD4WCGRARK6PNHK2A, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.889413475 (133h59m32.848510725s) [noise=true , address=104.36.82.39:4726 , piece_id=FNHEEZ32MIL5ETIJUIIPPNZZNKFZOEHSJORPY2B5RDJRWBCW3UBA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.906945117 (133h59m32.866042362s) [noise=true , address=104.36.82.34:4545 , piece_id=PDZLJ5YBBSZCTFEY2G5JUDYF4LKMUQQY3ZTJYKQCAWDYRQCLPIRA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.907087156 (133h59m32.866184406s) [noise=true , address=104.36.82.37:4680 , piece_id=25M2EO245Q66ZYHEIAWHT4B5U23A6GTMMJ3C42BEKTZRDSSBNTNQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.908961498 (133h59m32.86805873s) [noise=true , address=104.36.82.60:4341 , piece_id=RGUT4D2SW3X3DHQVWDYTGTJYKXDAAWUZYPTL7WMIR6ZEFMHNCYMA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.969332098 (133h59m32.928429338s) [noise=true , address=104.36.82.36:4651 , piece_id=LNFLTNNQQAYVTCFB5DE52K574RYCGC2ESEJLGLXTVNCLEG5DP56Q, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.977796980 (133h59m32.936894233s) [noise=true , address=104.36.82.23:4473 , piece_id=KRYJUMRXK5G3F4QKYH44SFZCI533STE5INLGKXWAVAKM5V7IT2XQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.977845819 (133h59m32.936943071s) [seg_pos={0 0}, upload=139577]: Segment reached optimal threshold of 14 pieces.
Aug 14 07:25:10.978277534 (133h59m32.937374783s) [noise=true , address=79.127.205.233:4635 , piece_id=CRUUHWDS7CL7C32M2Q65ZJ65RNTHP4NEJ6IH73CP2RCPI64FHMTA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZmShGfgfvurAu2DYTpX85R2WbtGx9oeS1gYQ6z17P6FeDrfRt): protocol: write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection; write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection
Aug 14 07:25:10.978292891 (133h59m32.937390139s) [noise=true , address=104.36.82.51:4068 , piece_id=Q3AQZ6YGT2RSJVNH42FGYUKGH6D7UX4I7E7BJD4X6G5X3DIKKNDA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Lh9dYpHCxbs7gpZ4Xt7os5Gm5Nco6jrNW1V1FHddVUEMkFfPY): protocol: expected piece hash; context canceled; EOF
Aug 14 07:25:10.978321765 (133h59m32.937419014s) [noise=true , address=79.127.201.215:4344 , piece_id=KJF7LAUZHBT72YIHN3HMWHNSKAPTOL624UUJAPJ5I76L6GYPKEXA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 14 07:25:10.978386078 (133h59m32.937483327s) [noise=true , address=66.23.193.175:4561 , piece_id=DTXPGEWJ4J6TSG4Z7DB7XJQCUNBU4KVJTIVVBTLPEFTEKKRB5ZTQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection
Aug 14 07:25:10.978404766 (133h59m32.937502014s) [seg_pos={0 0}, upload=139577]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 07:25:10.978549466 (133h59m32.937646702s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 07:25:10.978556260 (133h59m32.937653495s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 07:25:11.265569461 (133h59m33.224666727s) [upload=139577]: Done uploading segments...
Aug 14 07:25:11.265589989 (133h59m33.224687228s) [upload=139577]: Upload finished. err: <nil>
Duration: 2.30286001s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
837.915528ms
FAIL (2025-08-14 07:59:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 07:47:11.992786671 (134h21m33.951883923s) [upload=139963]: Starting upload Aug 14 07:47:11.992860493 (134h21m33.951957737s) [upload=139963]: Done starting upload Aug 14 07:47:11.992934804 (134h21m33.952032051s) [upload=139963]: Uploading segments... Aug 14 07:47:11.993066452 (134h21m33.952163706s) [upload=139963]: Got next segment. Inline: true Aug 14 07:47:11.993074995 (134h21m33.95217223s) [upload=139963]: Waiting for error group managing segments... Aug 14 07:47:11.993140176 (134h21m33.95223741s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 07:47:11.993145821 (134h21m33.952243058s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 07:47:11.993149615 (134h21m33.95224685s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 07:47:12.080107026 (134h21m34.039204272s) [upload=139963]: Done uploading segments... Aug 14 07:47:12.080128377 (134h21m34.039225624s) [upload=139963]: Upload finished. err: metaclient: Too Many Requests
Duration: 838.022852ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
905.369886ms
FAIL (2025-08-14 07:59:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 07:47:11.992786671 (134h21m33.951883923s) [upload=139963]: Starting upload Aug 14 07:47:11.992860493 (134h21m33.951957737s) [upload=139963]: Done starting upload Aug 14 07:47:11.992934804 (134h21m33.952032051s) [upload=139963]: Uploading segments... Aug 14 07:47:11.993066452 (134h21m33.952163706s) [upload=139963]: Got next segment. Inline: true Aug 14 07:47:11.993074995 (134h21m33.95217223s) [upload=139963]: Waiting for error group managing segments... Aug 14 07:47:11.993140176 (134h21m33.95223741s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 07:47:11.993145821 (134h21m33.952243058s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 07:47:11.993149615 (134h21m33.95224685s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 07:47:12.080107026 (134h21m34.039204272s) [upload=139963]: Done uploading segments... Aug 14 07:47:12.080128377 (134h21m34.039225624s) [upload=139963]: Upload finished. err: metaclient: Too Many Requests
Duration: 905.422035ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
1.878597243s
FAIL (2025-08-14 07:59:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 07:47:11.992786671 (134h21m33.951883923s) [upload=139963]: Starting upload Aug 14 07:47:11.992860493 (134h21m33.951957737s) [upload=139963]: Done starting upload Aug 14 07:47:11.992934804 (134h21m33.952032051s) [upload=139963]: Uploading segments... Aug 14 07:47:11.993066452 (134h21m33.952163706s) [upload=139963]: Got next segment. Inline: true Aug 14 07:47:11.993074995 (134h21m33.95217223s) [upload=139963]: Waiting for error group managing segments... Aug 14 07:47:11.993140176 (134h21m33.95223741s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 07:47:11.993145821 (134h21m33.952243058s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 07:47:11.993149615 (134h21m33.95224685s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 07:47:12.080107026 (134h21m34.039204272s) [upload=139963]: Done uploading segments... Aug 14 07:47:12.080128377 (134h21m34.039225624s) [upload=139963]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.878629547s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
2.322913269s
FAIL (2025-08-14 07:58:44 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 07:25:09.956973924 (133h59m31.91607116s) [upload=139577]: Starting upload
Aug 14 07:25:09.957032907 (133h59m31.916130153s) [upload=139577]: Done starting upload
Aug 14 07:25:09.957129748 (133h59m31.916226993s) [upload=139577]: Uploading segments...
Aug 14 07:25:09.957339009 (133h59m31.916436247s) [upload=139577]: Got next segment. Inline: false
Aug 14 07:25:09.957436584 (133h59m31.91653383s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 07:25:09.957443440 (133h59m31.916540685s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 07:25:10.154380951 (133h59m32.113478197s) [seg_pos={0 0}, upload=139577]: Begin upload segment...
Aug 14 07:25:10.154468905 (133h59m32.113566151s) [seg_pos={0 0}, upload=139577]: Done begin upload segment.
Aug 14 07:25:10.154701354 (133h59m32.113798602s) [noise=true , address=77.90.31.12:4614 , piece_id=2HGLRMWPGEX2VE4EAOKW3AURGUOSLPYZJZ6ITWGJFBHHVOKEICKA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.154848318 (133h59m32.113945568s) [noise=true , address=66.23.193.175:4561 , piece_id=DTXPGEWJ4J6TSG4Z7DB7XJQCUNBU4KVJTIVVBTLPEFTEKKRB5ZTQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.155378855 (133h59m32.114476101s) [noise=true , address=104.36.82.39:4726 , piece_id=FNHEEZ32MIL5ETIJUIIPPNZZNKFZOEHSJORPY2B5RDJRWBCW3UBA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.156922693 (133h59m32.116019947s) [noise=true , address=104.36.82.34:4545 , piece_id=PDZLJ5YBBSZCTFEY2G5JUDYF4LKMUQQY3ZTJYKQCAWDYRQCLPIRA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.157691367 (133h59m32.116788622s) [noise=true , address=104.36.82.36:4651 , piece_id=LNFLTNNQQAYVTCFB5DE52K574RYCGC2ESEJLGLXTVNCLEG5DP56Q, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158149663 (133h59m32.117246915s) [noise=true , address=77.90.31.11:4580 , piece_id=RWGPCUVUIGHSZJEJZ2L2KSMRJ4D4ZLZ3H7KYIC3YT32YNL4IXLRA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158463935 (133h59m32.117561186s) [noise=true , address=104.36.82.23:4473 , piece_id=KRYJUMRXK5G3F4QKYH44SFZCI533STE5INLGKXWAVAKM5V7IT2XQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.158774796 (133h59m32.117872047s) [noise=true , address=79.127.205.233:4635 , piece_id=CRUUHWDS7CL7C32M2Q65ZJ65RNTHP4NEJ6IH73CP2RCPI64FHMTA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159091926 (133h59m32.11818918s) [noise=true , address=77.90.31.14:4678 , piece_id=H3ZZXOABAEB5PETTSUA6H67A3ONHITRI42ZB7JMFEUGJBL4QWNVQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159433693 (133h59m32.118530973s) [noise=true , address=104.36.82.59:4320 , piece_id=2CDINXZFWNEALAQONUFKZOJXTAHKUR4NK7N5FZEB7LYWQXBQSFBA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.159818042 (133h59m32.118915297s) [noise=true , address=77.90.31.18:4818 , piece_id=MWE2FGHHESHPG7I2M454MZKRRX5E3AVSKQGU5T4MYC2TYFW3YSAA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.160391987 (133h59m32.119489233s) [noise=true , address=77.90.31.15:4718 , piece_id=NLG3OVRC57PLR6TXQOFNWNKVMASOUJ3TEACQZ5WPJVPFLELQOXTQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.160892152 (133h59m32.119989383s) [noise=true , address=104.36.82.51:4068 , piece_id=Q3AQZ6YGT2RSJVNH42FGYUKGH6D7UX4I7E7BJD4X6G5X3DIKKNDA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.161379066 (133h59m32.120476321s) [noise=true , address=104.36.82.60:4341 , piece_id=RGUT4D2SW3X3DHQVWDYTGTJYKXDAAWUZYPTL7WMIR6ZEFMHNCYMA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.161738433 (133h59m32.120835689s) [noise=true , address=104.36.82.17:4336 , piece_id=NPMIKZGE5DMIVWUPZNYLJHS5EFHY7PNFWIJY2OBIDNKSZR27RM4Q, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.162169485 (133h59m32.121266732s) [noise=true , address=104.36.82.37:4680 , piece_id=25M2EO245Q66ZYHEIAWHT4B5U23A6GTMMJ3C42BEKTZRDSSBNTNQ, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.162572296 (133h59m32.121669548s) [noise=true , address=79.127.201.215:4344 , piece_id=KJF7LAUZHBT72YIHN3HMWHNSKAPTOL624UUJAPJ5I76L6GYPKEXA, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.163864823 (133h59m32.12296208s) [noise=true , address=104.36.82.44:4881 , piece_id=WXKB4QHLTHHEQBABFNUVW75WAGRAFLF7KBPCD4WCGRARK6PNHK2A, seg_pos={0 0}, upload=139577]: Uploading piece...
Aug 14 07:25:10.725866433 (133h59m32.684963694s) [upload=139577]: Next returned nil segment
Aug 14 07:25:10.725904162 (133h59m32.685001419s) [upload=139577]: Waiting for error group managing segments...
Aug 14 07:25:10.862450158 (133h59m32.821547417s) [noise=true , address=77.90.31.12:4614 , piece_id=2HGLRMWPGEX2VE4EAOKW3AURGUOSLPYZJZ6ITWGJFBHHVOKEICKA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.862709772 (133h59m32.821807018s) [noise=true , address=77.90.31.14:4678 , piece_id=H3ZZXOABAEB5PETTSUA6H67A3ONHITRI42ZB7JMFEUGJBL4QWNVQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.866585589 (133h59m32.825682823s) [noise=true , address=77.90.31.18:4818 , piece_id=MWE2FGHHESHPG7I2M454MZKRRX5E3AVSKQGU5T4MYC2TYFW3YSAA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.874172708 (133h59m32.833270061s) [noise=true , address=77.90.31.15:4718 , piece_id=NLG3OVRC57PLR6TXQOFNWNKVMASOUJ3TEACQZ5WPJVPFLELQOXTQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.874505189 (133h59m32.833602423s) [noise=true , address=77.90.31.11:4580 , piece_id=RWGPCUVUIGHSZJEJZ2L2KSMRJ4D4ZLZ3H7KYIC3YT32YNL4IXLRA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.878471514 (133h59m32.837568761s) [noise=true , address=104.36.82.59:4320 , piece_id=2CDINXZFWNEALAQONUFKZOJXTAHKUR4NK7N5FZEB7LYWQXBQSFBA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.881638470 (133h59m32.840735716s) [noise=true , address=104.36.82.17:4336 , piece_id=NPMIKZGE5DMIVWUPZNYLJHS5EFHY7PNFWIJY2OBIDNKSZR27RM4Q, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.886865828 (133h59m32.845963074s) [noise=true , address=104.36.82.44:4881 , piece_id=WXKB4QHLTHHEQBABFNUVW75WAGRAFLF7KBPCD4WCGRARK6PNHK2A, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.889413475 (133h59m32.848510725s) [noise=true , address=104.36.82.39:4726 , piece_id=FNHEEZ32MIL5ETIJUIIPPNZZNKFZOEHSJORPY2B5RDJRWBCW3UBA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.906945117 (133h59m32.866042362s) [noise=true , address=104.36.82.34:4545 , piece_id=PDZLJ5YBBSZCTFEY2G5JUDYF4LKMUQQY3ZTJYKQCAWDYRQCLPIRA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.907087156 (133h59m32.866184406s) [noise=true , address=104.36.82.37:4680 , piece_id=25M2EO245Q66ZYHEIAWHT4B5U23A6GTMMJ3C42BEKTZRDSSBNTNQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.908961498 (133h59m32.86805873s) [noise=true , address=104.36.82.60:4341 , piece_id=RGUT4D2SW3X3DHQVWDYTGTJYKXDAAWUZYPTL7WMIR6ZEFMHNCYMA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.969332098 (133h59m32.928429338s) [noise=true , address=104.36.82.36:4651 , piece_id=LNFLTNNQQAYVTCFB5DE52K574RYCGC2ESEJLGLXTVNCLEG5DP56Q, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.977796980 (133h59m32.936894233s) [noise=true , address=104.36.82.23:4473 , piece_id=KRYJUMRXK5G3F4QKYH44SFZCI533STE5INLGKXWAVAKM5V7IT2XQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: <nil>
Aug 14 07:25:10.977845819 (133h59m32.936943071s) [seg_pos={0 0}, upload=139577]: Segment reached optimal threshold of 14 pieces.
Aug 14 07:25:10.978277534 (133h59m32.937374783s) [noise=true , address=79.127.205.233:4635 , piece_id=CRUUHWDS7CL7C32M2Q65ZJ65RNTHP4NEJ6IH73CP2RCPI64FHMTA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZmShGfgfvurAu2DYTpX85R2WbtGx9oeS1gYQ6z17P6FeDrfRt): protocol: write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection; write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44874->79.127.205.233:4635: use of closed network connection
Aug 14 07:25:10.978292891 (133h59m32.937390139s) [noise=true , address=104.36.82.51:4068 , piece_id=Q3AQZ6YGT2RSJVNH42FGYUKGH6D7UX4I7E7BJD4X6G5X3DIKKNDA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Lh9dYpHCxbs7gpZ4Xt7os5Gm5Nco6jrNW1V1FHddVUEMkFfPY): protocol: expected piece hash; context canceled; EOF
Aug 14 07:25:10.978321765 (133h59m32.937419014s) [noise=true , address=79.127.201.215:4344 , piece_id=KJF7LAUZHBT72YIHN3HMWHNSKAPTOL624UUJAPJ5I76L6GYPKEXA, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 14 07:25:10.978386078 (133h59m32.937483327s) [noise=true , address=66.23.193.175:4561 , piece_id=DTXPGEWJ4J6TSG4Z7DB7XJQCUNBU4KVJTIVVBTLPEFTEKKRB5ZTQ, seg_pos={0 0}, upload=139577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51446->66.23.193.175:4561: use of closed network connection
Aug 14 07:25:10.978404766 (133h59m32.937502014s) [seg_pos={0 0}, upload=139577]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 07:25:10.978549466 (133h59m32.937646702s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 07:25:10.978556260 (133h59m32.937653495s) [upload=139577]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 07:25:11.265569461 (133h59m33.224666727s) [upload=139577]: Done uploading segments...
Aug 14 07:25:11.265589989 (133h59m33.224687228s) [upload=139577]: Upload finished. err: <nil>
Duration: 2.322947289s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
813.028075ms
FAIL (2025-08-14 07:58:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 07:47:11.992786671 (134h21m33.951883923s) [upload=139963]: Starting upload Aug 14 07:47:11.992860493 (134h21m33.951957737s) [upload=139963]: Done starting upload Aug 14 07:47:11.992934804 (134h21m33.952032051s) [upload=139963]: Uploading segments... Aug 14 07:47:11.993066452 (134h21m33.952163706s) [upload=139963]: Got next segment. Inline: true Aug 14 07:47:11.993074995 (134h21m33.95217223s) [upload=139963]: Waiting for error group managing segments... Aug 14 07:47:11.993140176 (134h21m33.95223741s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 07:47:11.993145821 (134h21m33.952243058s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 07:47:11.993149615 (134h21m33.95224685s) [upload=139963]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 07:47:12.080107026 (134h21m34.039204272s) [upload=139963]: Done uploading segments... Aug 14 07:47:12.080128377 (134h21m34.039225624s) [upload=139963]: Upload finished. err: metaclient: Too Many Requests
Duration: 813.060503ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|