Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
820.603904ms
FAIL (2025-08-09 10:10:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 820.641868ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
1.083126306s
FAIL (2025-08-09 10:09:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.083167467s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
864.454139ms
FAIL (2025-08-09 10:08:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 864.514038ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
827.508705ms
FAIL (2025-08-09 10:08:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 827.546558ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
1.078697523s
FAIL (2025-08-09 10:07:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.078727776s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
819.247124ms
FAIL (2025-08-09 10:07:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 819.276351ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
937.170574ms
FAIL (2025-08-09 10:06:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 937.207161ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
976.263273ms
FAIL (2025-08-09 10:06:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 976.291734ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
887.695993ms
FAIL (2025-08-09 10:05:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 887.724859ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
823.660537ms
FAIL (2025-08-09 10:04:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 823.691793ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
883.58242ms
FAIL (2025-08-09 10:04:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 883.620839ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
842.965226ms
FAIL (2025-08-09 10:03:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 842.995001ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
842.764797ms
FAIL (2025-08-09 10:02:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 842.841472ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
869.770384ms
FAIL (2025-08-09 10:01:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 869.808031ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
843.157109ms
FAIL (2025-08-09 10:00:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 843.259106ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
942.756397ms
FAIL (2025-08-09 09:59:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 942.792183ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
851.633925ms
FAIL (2025-08-09 09:58:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 851.661091ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
844.038642ms
FAIL (2025-08-09 09:58:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 844.066597ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
838.951984ms
FAIL (2025-08-09 09:57:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 838.978774ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
1.043284255s
FAIL (2025-08-09 09:56:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.043311123s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
841.946522ms
FAIL (2025-08-09 09:56:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 842.11119ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
853.74527ms
FAIL (2025-08-09 09:55:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 853.773865ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
941.410941ms
FAIL (2025-08-09 09:54:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 941.442681ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
1.14585231s
FAIL (2025-08-09 09:54:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.145877997s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
890.266835ms
FAIL (2025-08-09 09:53:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 890.30522ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
846.913104ms
FAIL (2025-08-09 09:53:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 846.951402ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
824.906854ms
FAIL (2025-08-09 09:51:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 824.93764ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
848.078891ms
FAIL (2025-08-09 09:50:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 848.103019ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
871.849955ms
FAIL (2025-08-09 09:50:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 871.880559ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
948.668359ms
FAIL (2025-08-09 09:49:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 948.695977ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
837.406189ms
FAIL (2025-08-09 09:48:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 837.440162ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.269475677s
FAIL (2025-08-09 09:48:24 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload
Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload
Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments...
Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false
Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment...
Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment.
Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment
Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments...
Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces.
Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF
Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection
Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection
Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection
Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments...
Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil>
Duration: 2.269532438s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
858.301199ms
FAIL (2025-08-09 09:47:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 858.345956ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.381596004s
FAIL (2025-08-09 09:47:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload
Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload
Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments...
Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false
Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment...
Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment.
Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment
Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments...
Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces.
Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF
Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection
Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection
Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection
Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments...
Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil>
Duration: 2.38162389s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
832.089594ms
FAIL (2025-08-09 09:46:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 832.115752ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X.X.........................................................] duration:
2.345685895s
FAIL (2025-08-09 09:46:49 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload
Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload
Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments...
Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false
Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment...
Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment.
Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment
Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments...
Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces.
Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF
Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection
Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection
Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection
Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments...
Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil>
Duration: 2.345715882s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
829.266087ms
FAIL (2025-08-09 09:46:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 829.293671ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X.X........................................................] duration:
2.367088629s
FAIL (2025-08-09 09:45:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload
Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload
Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments...
Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false
Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment...
Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment.
Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment
Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments...
Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces.
Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF
Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection
Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection
Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection
Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments...
Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil>
Duration: 2.367123887s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X.X.......................................................] duration:
2.33476596s
FAIL (2025-08-09 09:45:08 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload
Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload
Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments...
Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false
Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment...
Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment.
Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment
Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments...
Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces.
Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF
Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection
Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection
Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection
Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments...
Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil>
Duration: 2.334799645s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
857.487672ms
FAIL (2025-08-09 09:45:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 857.518686ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X.X......................................................] duration:
2.269429275s
FAIL (2025-08-09 09:44:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload
Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload
Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments...
Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false
Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment...
Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment.
Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment
Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments...
Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces.
Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF
Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection
Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection
Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection
Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments...
Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil>
Duration: 2.269463116s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
1.00522477s
FAIL (2025-08-09 09:44:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.005271747s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X.X.....................................................] duration:
2.420747224s
FAIL (2025-08-09 09:44:09 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload
Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload
Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments...
Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false
Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment...
Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment.
Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment
Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments...
Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces.
Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF
Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection
Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection
Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection
Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments...
Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil>
Duration: 2.420798616s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
995.522112ms
FAIL (2025-08-09 09:43:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 995.569791ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
876.915378ms
FAIL (2025-08-09 09:42:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 876.947627ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X.X....................................................] duration:
2.357804341s
FAIL (2025-08-09 09:42:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload
Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload
Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments...
Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false
Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment...
Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment.
Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment
Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments...
Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces.
Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF
Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection
Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection
Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection
Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments...
Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil>
Duration: 2.357834212s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
871.93249ms
FAIL (2025-08-09 09:42:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 871.98779ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
928.60679ms
FAIL (2025-08-09 09:42:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests
Duration: 928.637997ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X.X...................................................] duration:
2.3186054s
FAIL (2025-08-09 09:42:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload
Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload
Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments...
Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false
Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment...
Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment.
Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment
Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments...
Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces.
Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF
Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection
Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection
Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection
Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments...
Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil>
Duration: 2.318634048s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X.X..................................................] duration:
2.461787208s
FAIL (2025-08-09 09:42:02 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload
Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload
Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments...
Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false
Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment...
Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment.
Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece...
Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment
Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments...
Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil>
Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces.
Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF
Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection
Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection
Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection
Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments...
Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil>
Duration: 2.461841584s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|