Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
943.011278ms
FAIL (2025-08-12 08:41:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after f638f9e463a399b5e4bd8a29745117e2be2e7e211769c7cd4aae6d0f9b466d19 != before b427316b5031d407cb8e31f4738dd507a7ff392362839ad5014a83e396f2a6a6 ======LOGS====== Aug 12 08:37:24.476485002 (87h11m46.43558224s) [upload=90889]: Starting upload Aug 12 08:37:24.476542338 (87h11m46.435639575s) [upload=90889]: Done starting upload Aug 12 08:37:24.476629762 (87h11m46.435727006s) [upload=90889]: Uploading segments... Aug 12 08:37:24.476758152 (87h11m46.435855407s) [upload=90889]: Got next segment. Inline: true Aug 12 08:37:24.476766766 (87h11m46.435864022s) [upload=90889]: Waiting for error group managing segments... Aug 12 08:37:24.476841329 (87h11m46.435938593s) [upload=90889]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:37:24.476851258 (87h11m46.435948518s) [upload=90889]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:37:24.476855547 (87h11m46.435952795s) [upload=90889]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:37:34.746524878 (87h11m56.705622133s) [upload=90889]: Done uploading segments... Aug 12 08:37:34.746550137 (87h11m56.705647391s) [upload=90889]: Upload finished. err: <nil>
Duration: 943.042961ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
850.455096ms
FAIL (2025-08-12 08:41:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after f638f9e463a399b5e4bd8a29745117e2be2e7e211769c7cd4aae6d0f9b466d19 != before b427316b5031d407cb8e31f4738dd507a7ff392362839ad5014a83e396f2a6a6 ======LOGS====== Aug 12 08:37:24.476485002 (87h11m46.43558224s) [upload=90889]: Starting upload Aug 12 08:37:24.476542338 (87h11m46.435639575s) [upload=90889]: Done starting upload Aug 12 08:37:24.476629762 (87h11m46.435727006s) [upload=90889]: Uploading segments... Aug 12 08:37:24.476758152 (87h11m46.435855407s) [upload=90889]: Got next segment. Inline: true Aug 12 08:37:24.476766766 (87h11m46.435864022s) [upload=90889]: Waiting for error group managing segments... Aug 12 08:37:24.476841329 (87h11m46.435938593s) [upload=90889]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:37:24.476851258 (87h11m46.435948518s) [upload=90889]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:37:24.476855547 (87h11m46.435952795s) [upload=90889]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:37:34.746524878 (87h11m56.705622133s) [upload=90889]: Done uploading segments... Aug 12 08:37:34.746550137 (87h11m56.705647391s) [upload=90889]: Upload finished. err: <nil>
Duration: 850.488141ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
867.354769ms
FAIL (2025-08-12 08:40:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after f638f9e463a399b5e4bd8a29745117e2be2e7e211769c7cd4aae6d0f9b466d19 != before b427316b5031d407cb8e31f4738dd507a7ff392362839ad5014a83e396f2a6a6 ======LOGS====== Aug 12 08:37:24.476485002 (87h11m46.43558224s) [upload=90889]: Starting upload Aug 12 08:37:24.476542338 (87h11m46.435639575s) [upload=90889]: Done starting upload Aug 12 08:37:24.476629762 (87h11m46.435727006s) [upload=90889]: Uploading segments... Aug 12 08:37:24.476758152 (87h11m46.435855407s) [upload=90889]: Got next segment. Inline: true Aug 12 08:37:24.476766766 (87h11m46.435864022s) [upload=90889]: Waiting for error group managing segments... Aug 12 08:37:24.476841329 (87h11m46.435938593s) [upload=90889]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:37:24.476851258 (87h11m46.435948518s) [upload=90889]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:37:24.476855547 (87h11m46.435952795s) [upload=90889]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:37:34.746524878 (87h11m56.705622133s) [upload=90889]: Done uploading segments... Aug 12 08:37:34.746550137 (87h11m56.705647391s) [upload=90889]: Upload finished. err: <nil>
Duration: 867.476685ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
851.213715ms
FAIL (2025-08-12 08:39:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after f638f9e463a399b5e4bd8a29745117e2be2e7e211769c7cd4aae6d0f9b466d19 != before b427316b5031d407cb8e31f4738dd507a7ff392362839ad5014a83e396f2a6a6 ======LOGS====== Aug 12 08:37:24.476485002 (87h11m46.43558224s) [upload=90889]: Starting upload Aug 12 08:37:24.476542338 (87h11m46.435639575s) [upload=90889]: Done starting upload Aug 12 08:37:24.476629762 (87h11m46.435727006s) [upload=90889]: Uploading segments... Aug 12 08:37:24.476758152 (87h11m46.435855407s) [upload=90889]: Got next segment. Inline: true Aug 12 08:37:24.476766766 (87h11m46.435864022s) [upload=90889]: Waiting for error group managing segments... Aug 12 08:37:24.476841329 (87h11m46.435938593s) [upload=90889]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:37:24.476851258 (87h11m46.435948518s) [upload=90889]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:37:24.476855547 (87h11m46.435952795s) [upload=90889]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:37:34.746524878 (87h11m56.705622133s) [upload=90889]: Done uploading segments... Aug 12 08:37:34.746550137 (87h11m56.705647391s) [upload=90889]: Upload finished. err: <nil>
Duration: 851.250227ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
861.315934ms
FAIL (2025-08-12 08:39:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after f638f9e463a399b5e4bd8a29745117e2be2e7e211769c7cd4aae6d0f9b466d19 != before b427316b5031d407cb8e31f4738dd507a7ff392362839ad5014a83e396f2a6a6 ======LOGS====== Aug 12 08:37:24.476485002 (87h11m46.43558224s) [upload=90889]: Starting upload Aug 12 08:37:24.476542338 (87h11m46.435639575s) [upload=90889]: Done starting upload Aug 12 08:37:24.476629762 (87h11m46.435727006s) [upload=90889]: Uploading segments... Aug 12 08:37:24.476758152 (87h11m46.435855407s) [upload=90889]: Got next segment. Inline: true Aug 12 08:37:24.476766766 (87h11m46.435864022s) [upload=90889]: Waiting for error group managing segments... Aug 12 08:37:24.476841329 (87h11m46.435938593s) [upload=90889]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:37:24.476851258 (87h11m46.435948518s) [upload=90889]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:37:24.476855547 (87h11m46.435952795s) [upload=90889]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:37:34.746524878 (87h11m56.705622133s) [upload=90889]: Done uploading segments... Aug 12 08:37:34.746550137 (87h11m56.705647391s) [upload=90889]: Upload finished. err: <nil>
Duration: 861.356602ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
1.27798858s
FAIL (2025-08-12 08:37:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after f638f9e463a399b5e4bd8a29745117e2be2e7e211769c7cd4aae6d0f9b466d19 != before b427316b5031d407cb8e31f4738dd507a7ff392362839ad5014a83e396f2a6a6 ======LOGS====== Aug 12 08:37:24.476485002 (87h11m46.43558224s) [upload=90889]: Starting upload Aug 12 08:37:24.476542338 (87h11m46.435639575s) [upload=90889]: Done starting upload Aug 12 08:37:24.476629762 (87h11m46.435727006s) [upload=90889]: Uploading segments... Aug 12 08:37:24.476758152 (87h11m46.435855407s) [upload=90889]: Got next segment. Inline: true Aug 12 08:37:24.476766766 (87h11m46.435864022s) [upload=90889]: Waiting for error group managing segments... Aug 12 08:37:24.476841329 (87h11m46.435938593s) [upload=90889]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:37:24.476851258 (87h11m46.435948518s) [upload=90889]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:37:24.476855547 (87h11m46.435952795s) [upload=90889]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:37:34.746524878 (87h11m56.705622133s) [upload=90889]: Done uploading segments... Aug 12 08:37:34.746550137 (87h11m56.705647391s) [upload=90889]: Upload finished. err: <nil>
Duration: 1.278093735s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
11.115065261s
FAIL (2025-08-12 08:37:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after f638f9e463a399b5e4bd8a29745117e2be2e7e211769c7cd4aae6d0f9b466d19 != before b427316b5031d407cb8e31f4738dd507a7ff392362839ad5014a83e396f2a6a6 ======LOGS====== Aug 12 08:37:24.476485002 (87h11m46.43558224s) [upload=90889]: Starting upload Aug 12 08:37:24.476542338 (87h11m46.435639575s) [upload=90889]: Done starting upload Aug 12 08:37:24.476629762 (87h11m46.435727006s) [upload=90889]: Uploading segments... Aug 12 08:37:24.476758152 (87h11m46.435855407s) [upload=90889]: Got next segment. Inline: true Aug 12 08:37:24.476766766 (87h11m46.435864022s) [upload=90889]: Waiting for error group managing segments... Aug 12 08:37:24.476841329 (87h11m46.435938593s) [upload=90889]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:37:24.476851258 (87h11m46.435948518s) [upload=90889]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:37:24.476855547 (87h11m46.435952795s) [upload=90889]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:37:34.746524878 (87h11m56.705622133s) [upload=90889]: Done uploading segments... Aug 12 08:37:34.746550137 (87h11m56.705647391s) [upload=90889]: Upload finished. err: <nil>
Duration: 11.115099702s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
852.609883ms
FAIL (2025-08-12 08:33:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 07:48:59.843550821 (86h23m21.802648066s) [upload=90065]: Starting upload Aug 12 07:48:59.843665323 (86h23m21.80276257s) [upload=90065]: Done starting upload Aug 12 07:48:59.843805919 (86h23m21.802903157s) [upload=90065]: Uploading segments... Aug 12 07:48:59.843865214 (86h23m21.80296246s) [upload=90065]: Got next segment. Inline: true Aug 12 07:48:59.843870966 (86h23m21.802968211s) [upload=90065]: Waiting for error group managing segments... Aug 12 07:48:59.843916743 (86h23m21.803013989s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 07:48:59.843922059 (86h23m21.803019304s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 07:48:59.843925700 (86h23m21.803022945s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 07:48:59.933867301 (86h23m21.892964556s) [upload=90065]: Done uploading segments... Aug 12 07:48:59.933890446 (86h23m21.892987699s) [upload=90065]: Upload finished. err: metaclient: Too Many Requests
Duration: 852.640232ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
825.587162ms
FAIL (2025-08-12 08:31:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 07:48:59.843550821 (86h23m21.802648066s) [upload=90065]: Starting upload Aug 12 07:48:59.843665323 (86h23m21.80276257s) [upload=90065]: Done starting upload Aug 12 07:48:59.843805919 (86h23m21.802903157s) [upload=90065]: Uploading segments... Aug 12 07:48:59.843865214 (86h23m21.80296246s) [upload=90065]: Got next segment. Inline: true Aug 12 07:48:59.843870966 (86h23m21.802968211s) [upload=90065]: Waiting for error group managing segments... Aug 12 07:48:59.843916743 (86h23m21.803013989s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 07:48:59.843922059 (86h23m21.803019304s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 07:48:59.843925700 (86h23m21.803022945s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 07:48:59.933867301 (86h23m21.892964556s) [upload=90065]: Done uploading segments... Aug 12 07:48:59.933890446 (86h23m21.892987699s) [upload=90065]: Upload finished. err: metaclient: Too Many Requests
Duration: 825.613668ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
820.914009ms
FAIL (2025-08-12 08:30:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 07:48:59.843550821 (86h23m21.802648066s) [upload=90065]: Starting upload Aug 12 07:48:59.843665323 (86h23m21.80276257s) [upload=90065]: Done starting upload Aug 12 07:48:59.843805919 (86h23m21.802903157s) [upload=90065]: Uploading segments... Aug 12 07:48:59.843865214 (86h23m21.80296246s) [upload=90065]: Got next segment. Inline: true Aug 12 07:48:59.843870966 (86h23m21.802968211s) [upload=90065]: Waiting for error group managing segments... Aug 12 07:48:59.843916743 (86h23m21.803013989s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 07:48:59.843922059 (86h23m21.803019304s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 07:48:59.843925700 (86h23m21.803022945s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 07:48:59.933867301 (86h23m21.892964556s) [upload=90065]: Done uploading segments... Aug 12 07:48:59.933890446 (86h23m21.892987699s) [upload=90065]: Upload finished. err: metaclient: Too Many Requests
Duration: 820.996978ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
1.150004571s
FAIL (2025-08-12 08:30:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 07:48:59.843550821 (86h23m21.802648066s) [upload=90065]: Starting upload Aug 12 07:48:59.843665323 (86h23m21.80276257s) [upload=90065]: Done starting upload Aug 12 07:48:59.843805919 (86h23m21.802903157s) [upload=90065]: Uploading segments... Aug 12 07:48:59.843865214 (86h23m21.80296246s) [upload=90065]: Got next segment. Inline: true Aug 12 07:48:59.843870966 (86h23m21.802968211s) [upload=90065]: Waiting for error group managing segments... Aug 12 07:48:59.843916743 (86h23m21.803013989s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 07:48:59.843922059 (86h23m21.803019304s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 07:48:59.843925700 (86h23m21.803022945s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 07:48:59.933867301 (86h23m21.892964556s) [upload=90065]: Done uploading segments... Aug 12 07:48:59.933890446 (86h23m21.892987699s) [upload=90065]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.150040761s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
864.717166ms
FAIL (2025-08-12 08:29:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 07:48:59.843550821 (86h23m21.802648066s) [upload=90065]: Starting upload Aug 12 07:48:59.843665323 (86h23m21.80276257s) [upload=90065]: Done starting upload Aug 12 07:48:59.843805919 (86h23m21.802903157s) [upload=90065]: Uploading segments... Aug 12 07:48:59.843865214 (86h23m21.80296246s) [upload=90065]: Got next segment. Inline: true Aug 12 07:48:59.843870966 (86h23m21.802968211s) [upload=90065]: Waiting for error group managing segments... Aug 12 07:48:59.843916743 (86h23m21.803013989s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 07:48:59.843922059 (86h23m21.803019304s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 07:48:59.843925700 (86h23m21.803022945s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 07:48:59.933867301 (86h23m21.892964556s) [upload=90065]: Done uploading segments... Aug 12 07:48:59.933890446 (86h23m21.892987699s) [upload=90065]: Upload finished. err: metaclient: Too Many Requests
Duration: 864.739291ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
855.201551ms
FAIL (2025-08-12 08:28:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 07:48:59.843550821 (86h23m21.802648066s) [upload=90065]: Starting upload Aug 12 07:48:59.843665323 (86h23m21.80276257s) [upload=90065]: Done starting upload Aug 12 07:48:59.843805919 (86h23m21.802903157s) [upload=90065]: Uploading segments... Aug 12 07:48:59.843865214 (86h23m21.80296246s) [upload=90065]: Got next segment. Inline: true Aug 12 07:48:59.843870966 (86h23m21.802968211s) [upload=90065]: Waiting for error group managing segments... Aug 12 07:48:59.843916743 (86h23m21.803013989s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 07:48:59.843922059 (86h23m21.803019304s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 07:48:59.843925700 (86h23m21.803022945s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 07:48:59.933867301 (86h23m21.892964556s) [upload=90065]: Done uploading segments... Aug 12 07:48:59.933890446 (86h23m21.892987699s) [upload=90065]: Upload finished. err: metaclient: Too Many Requests
Duration: 855.245446ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
1.328615896s
FAIL (2025-08-12 08:27:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 07:48:59.843550821 (86h23m21.802648066s) [upload=90065]: Starting upload Aug 12 07:48:59.843665323 (86h23m21.80276257s) [upload=90065]: Done starting upload Aug 12 07:48:59.843805919 (86h23m21.802903157s) [upload=90065]: Uploading segments... Aug 12 07:48:59.843865214 (86h23m21.80296246s) [upload=90065]: Got next segment. Inline: true Aug 12 07:48:59.843870966 (86h23m21.802968211s) [upload=90065]: Waiting for error group managing segments... Aug 12 07:48:59.843916743 (86h23m21.803013989s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 07:48:59.843922059 (86h23m21.803019304s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 07:48:59.843925700 (86h23m21.803022945s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 07:48:59.933867301 (86h23m21.892964556s) [upload=90065]: Done uploading segments... Aug 12 07:48:59.933890446 (86h23m21.892987699s) [upload=90065]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.328648058s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
829.737351ms
FAIL (2025-08-12 08:27:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 07:48:59.843550821 (86h23m21.802648066s) [upload=90065]: Starting upload Aug 12 07:48:59.843665323 (86h23m21.80276257s) [upload=90065]: Done starting upload Aug 12 07:48:59.843805919 (86h23m21.802903157s) [upload=90065]: Uploading segments... Aug 12 07:48:59.843865214 (86h23m21.80296246s) [upload=90065]: Got next segment. Inline: true Aug 12 07:48:59.843870966 (86h23m21.802968211s) [upload=90065]: Waiting for error group managing segments... Aug 12 07:48:59.843916743 (86h23m21.803013989s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 07:48:59.843922059 (86h23m21.803019304s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 07:48:59.843925700 (86h23m21.803022945s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 07:48:59.933867301 (86h23m21.892964556s) [upload=90065]: Done uploading segments... Aug 12 07:48:59.933890446 (86h23m21.892987699s) [upload=90065]: Upload finished. err: metaclient: Too Many Requests
Duration: 829.768875ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.338380254s
FAIL (2025-08-12 08:26:57 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 07:39:39.033059184 (86h14m0.992156426s) [upload=89902]: Starting upload
Aug 12 07:39:39.033152120 (86h14m0.992249364s) [upload=89902]: Done starting upload
Aug 12 07:39:39.033297583 (86h14m0.992394828s) [upload=89902]: Uploading segments...
Aug 12 07:39:39.033614288 (86h14m0.992711534s) [upload=89902]: Got next segment. Inline: false
Aug 12 07:39:39.033650349 (86h14m0.992747593s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 07:39:39.033656004 (86h14m0.992753239s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 07:39:39.229399173 (86h14m1.188496429s) [seg_pos={0 0}, upload=89902]: Begin upload segment...
Aug 12 07:39:39.229536336 (86h14m1.18863362s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.229583075 (86h14m1.18868033s) [seg_pos={0 0}, upload=89902]: Done begin upload segment.
Aug 12 07:39:39.229632693 (86h14m1.18872995s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.230249524 (86h14m1.189346784s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231168815 (86h14m1.190266069s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231653615 (86h14m1.190750871s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231708320 (86h14m1.190805578s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232087037 (86h14m1.19118429s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232124852 (86h14m1.191222109s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232451654 (86h14m1.191548899s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232726108 (86h14m1.191823361s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232998908 (86h14m1.192096156s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233322723 (86h14m1.192419973s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233681215 (86h14m1.192778467s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234038674 (86h14m1.193135925s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234617189 (86h14m1.193714435s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.235225598 (86h14m1.194322854s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236117344 (86h14m1.1952146s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236656502 (86h14m1.195753759s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.809708997 (86h14m1.768806234s) [upload=89902]: Next returned nil segment
Aug 12 07:39:39.809729179 (86h14m1.768826427s) [upload=89902]: Waiting for error group managing segments...
Aug 12 07:39:39.955449038 (86h14m1.914546289s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.963009445 (86h14m1.922106685s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964027666 (86h14m1.923124903s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964137955 (86h14m1.923235189s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.967444571 (86h14m1.926541844s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.971467265 (86h14m1.930564514s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.975455659 (86h14m1.934552911s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.976817364 (86h14m1.935914613s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.982854369 (86h14m1.941951625s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988427330 (86h14m1.947524564s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988927474 (86h14m1.948024767s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.993577207 (86h14m1.952674453s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.007387925 (86h14m1.966485164s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016441684 (86h14m1.975538926s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016473817 (86h14m1.975571082s) [seg_pos={0 0}, upload=89902]: Segment reached optimal threshold of 14 pieces.
Aug 12 07:39:40.016693696 (86h14m1.975790944s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016867797 (86h14m1.975965043s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124BC3547CnJ34CsBzFawJz9kFot4tZ6MTuRXa7Jed8JMSTe72D): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016945944 (86h14m1.976043189s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLCXYP6sppXZcmj49C8jjgXbLGzgyowtpb1um9XZguzfVnM2r): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017069802 (86h14m1.976167041s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017101045 (86h14m1.97619828s) [seg_pos={0 0}, upload=89902]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 07:39:40.017197440 (86h14m1.976294685s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 07:39:40.017203455 (86h14m1.976300702s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 07:39:40.172728058 (86h14m2.131825312s) [upload=89902]: Done uploading segments...
Aug 12 07:39:40.172750765 (86h14m2.13184801s) [upload=89902]: Upload finished. err: <nil>
Duration: 2.338407659s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
811.412816ms
FAIL (2025-08-12 08:26:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 07:48:59.843550821 (86h23m21.802648066s) [upload=90065]: Starting upload Aug 12 07:48:59.843665323 (86h23m21.80276257s) [upload=90065]: Done starting upload Aug 12 07:48:59.843805919 (86h23m21.802903157s) [upload=90065]: Uploading segments... Aug 12 07:48:59.843865214 (86h23m21.80296246s) [upload=90065]: Got next segment. Inline: true Aug 12 07:48:59.843870966 (86h23m21.802968211s) [upload=90065]: Waiting for error group managing segments... Aug 12 07:48:59.843916743 (86h23m21.803013989s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 07:48:59.843922059 (86h23m21.803019304s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 07:48:59.843925700 (86h23m21.803022945s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 07:48:59.933867301 (86h23m21.892964556s) [upload=90065]: Done uploading segments... Aug 12 07:48:59.933890446 (86h23m21.892987699s) [upload=90065]: Upload finished. err: metaclient: Too Many Requests
Duration: 811.453805ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.482827161s
FAIL (2025-08-12 08:26:15 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 07:39:39.033059184 (86h14m0.992156426s) [upload=89902]: Starting upload
Aug 12 07:39:39.033152120 (86h14m0.992249364s) [upload=89902]: Done starting upload
Aug 12 07:39:39.033297583 (86h14m0.992394828s) [upload=89902]: Uploading segments...
Aug 12 07:39:39.033614288 (86h14m0.992711534s) [upload=89902]: Got next segment. Inline: false
Aug 12 07:39:39.033650349 (86h14m0.992747593s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 07:39:39.033656004 (86h14m0.992753239s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 07:39:39.229399173 (86h14m1.188496429s) [seg_pos={0 0}, upload=89902]: Begin upload segment...
Aug 12 07:39:39.229536336 (86h14m1.18863362s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.229583075 (86h14m1.18868033s) [seg_pos={0 0}, upload=89902]: Done begin upload segment.
Aug 12 07:39:39.229632693 (86h14m1.18872995s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.230249524 (86h14m1.189346784s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231168815 (86h14m1.190266069s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231653615 (86h14m1.190750871s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231708320 (86h14m1.190805578s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232087037 (86h14m1.19118429s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232124852 (86h14m1.191222109s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232451654 (86h14m1.191548899s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232726108 (86h14m1.191823361s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232998908 (86h14m1.192096156s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233322723 (86h14m1.192419973s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233681215 (86h14m1.192778467s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234038674 (86h14m1.193135925s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234617189 (86h14m1.193714435s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.235225598 (86h14m1.194322854s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236117344 (86h14m1.1952146s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236656502 (86h14m1.195753759s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.809708997 (86h14m1.768806234s) [upload=89902]: Next returned nil segment
Aug 12 07:39:39.809729179 (86h14m1.768826427s) [upload=89902]: Waiting for error group managing segments...
Aug 12 07:39:39.955449038 (86h14m1.914546289s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.963009445 (86h14m1.922106685s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964027666 (86h14m1.923124903s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964137955 (86h14m1.923235189s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.967444571 (86h14m1.926541844s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.971467265 (86h14m1.930564514s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.975455659 (86h14m1.934552911s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.976817364 (86h14m1.935914613s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.982854369 (86h14m1.941951625s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988427330 (86h14m1.947524564s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988927474 (86h14m1.948024767s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.993577207 (86h14m1.952674453s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.007387925 (86h14m1.966485164s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016441684 (86h14m1.975538926s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016473817 (86h14m1.975571082s) [seg_pos={0 0}, upload=89902]: Segment reached optimal threshold of 14 pieces.
Aug 12 07:39:40.016693696 (86h14m1.975790944s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016867797 (86h14m1.975965043s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124BC3547CnJ34CsBzFawJz9kFot4tZ6MTuRXa7Jed8JMSTe72D): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016945944 (86h14m1.976043189s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLCXYP6sppXZcmj49C8jjgXbLGzgyowtpb1um9XZguzfVnM2r): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017069802 (86h14m1.976167041s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017101045 (86h14m1.97619828s) [seg_pos={0 0}, upload=89902]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 07:39:40.017197440 (86h14m1.976294685s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 07:39:40.017203455 (86h14m1.976300702s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 07:39:40.172728058 (86h14m2.131825312s) [upload=89902]: Done uploading segments...
Aug 12 07:39:40.172750765 (86h14m2.13184801s) [upload=89902]: Upload finished. err: <nil>
Duration: 2.4828514s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
813.360163ms
FAIL (2025-08-12 08:25:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 07:48:59.843550821 (86h23m21.802648066s) [upload=90065]: Starting upload Aug 12 07:48:59.843665323 (86h23m21.80276257s) [upload=90065]: Done starting upload Aug 12 07:48:59.843805919 (86h23m21.802903157s) [upload=90065]: Uploading segments... Aug 12 07:48:59.843865214 (86h23m21.80296246s) [upload=90065]: Got next segment. Inline: true Aug 12 07:48:59.843870966 (86h23m21.802968211s) [upload=90065]: Waiting for error group managing segments... Aug 12 07:48:59.843916743 (86h23m21.803013989s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 07:48:59.843922059 (86h23m21.803019304s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 07:48:59.843925700 (86h23m21.803022945s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 07:48:59.933867301 (86h23m21.892964556s) [upload=90065]: Done uploading segments... Aug 12 07:48:59.933890446 (86h23m21.892987699s) [upload=90065]: Upload finished. err: metaclient: Too Many Requests
Duration: 813.395037ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.382505096s
FAIL (2025-08-12 08:25:43 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 07:39:39.033059184 (86h14m0.992156426s) [upload=89902]: Starting upload
Aug 12 07:39:39.033152120 (86h14m0.992249364s) [upload=89902]: Done starting upload
Aug 12 07:39:39.033297583 (86h14m0.992394828s) [upload=89902]: Uploading segments...
Aug 12 07:39:39.033614288 (86h14m0.992711534s) [upload=89902]: Got next segment. Inline: false
Aug 12 07:39:39.033650349 (86h14m0.992747593s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 07:39:39.033656004 (86h14m0.992753239s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 07:39:39.229399173 (86h14m1.188496429s) [seg_pos={0 0}, upload=89902]: Begin upload segment...
Aug 12 07:39:39.229536336 (86h14m1.18863362s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.229583075 (86h14m1.18868033s) [seg_pos={0 0}, upload=89902]: Done begin upload segment.
Aug 12 07:39:39.229632693 (86h14m1.18872995s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.230249524 (86h14m1.189346784s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231168815 (86h14m1.190266069s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231653615 (86h14m1.190750871s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231708320 (86h14m1.190805578s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232087037 (86h14m1.19118429s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232124852 (86h14m1.191222109s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232451654 (86h14m1.191548899s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232726108 (86h14m1.191823361s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232998908 (86h14m1.192096156s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233322723 (86h14m1.192419973s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233681215 (86h14m1.192778467s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234038674 (86h14m1.193135925s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234617189 (86h14m1.193714435s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.235225598 (86h14m1.194322854s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236117344 (86h14m1.1952146s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236656502 (86h14m1.195753759s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.809708997 (86h14m1.768806234s) [upload=89902]: Next returned nil segment
Aug 12 07:39:39.809729179 (86h14m1.768826427s) [upload=89902]: Waiting for error group managing segments...
Aug 12 07:39:39.955449038 (86h14m1.914546289s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.963009445 (86h14m1.922106685s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964027666 (86h14m1.923124903s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964137955 (86h14m1.923235189s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.967444571 (86h14m1.926541844s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.971467265 (86h14m1.930564514s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.975455659 (86h14m1.934552911s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.976817364 (86h14m1.935914613s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.982854369 (86h14m1.941951625s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988427330 (86h14m1.947524564s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988927474 (86h14m1.948024767s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.993577207 (86h14m1.952674453s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.007387925 (86h14m1.966485164s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016441684 (86h14m1.975538926s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016473817 (86h14m1.975571082s) [seg_pos={0 0}, upload=89902]: Segment reached optimal threshold of 14 pieces.
Aug 12 07:39:40.016693696 (86h14m1.975790944s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016867797 (86h14m1.975965043s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124BC3547CnJ34CsBzFawJz9kFot4tZ6MTuRXa7Jed8JMSTe72D): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016945944 (86h14m1.976043189s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLCXYP6sppXZcmj49C8jjgXbLGzgyowtpb1um9XZguzfVnM2r): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017069802 (86h14m1.976167041s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017101045 (86h14m1.97619828s) [seg_pos={0 0}, upload=89902]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 07:39:40.017197440 (86h14m1.976294685s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 07:39:40.017203455 (86h14m1.976300702s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 07:39:40.172728058 (86h14m2.131825312s) [upload=89902]: Done uploading segments...
Aug 12 07:39:40.172750765 (86h14m2.13184801s) [upload=89902]: Upload finished. err: <nil>
Duration: 2.382538029s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
1.060434223s
FAIL (2025-08-12 08:25:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 07:48:59.843550821 (86h23m21.802648066s) [upload=90065]: Starting upload Aug 12 07:48:59.843665323 (86h23m21.80276257s) [upload=90065]: Done starting upload Aug 12 07:48:59.843805919 (86h23m21.802903157s) [upload=90065]: Uploading segments... Aug 12 07:48:59.843865214 (86h23m21.80296246s) [upload=90065]: Got next segment. Inline: true Aug 12 07:48:59.843870966 (86h23m21.802968211s) [upload=90065]: Waiting for error group managing segments... Aug 12 07:48:59.843916743 (86h23m21.803013989s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 07:48:59.843922059 (86h23m21.803019304s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 07:48:59.843925700 (86h23m21.803022945s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 07:48:59.933867301 (86h23m21.892964556s) [upload=90065]: Done uploading segments... Aug 12 07:48:59.933890446 (86h23m21.892987699s) [upload=90065]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.060554725s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.444280454s
FAIL (2025-08-12 08:24:55 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 07:39:39.033059184 (86h14m0.992156426s) [upload=89902]: Starting upload
Aug 12 07:39:39.033152120 (86h14m0.992249364s) [upload=89902]: Done starting upload
Aug 12 07:39:39.033297583 (86h14m0.992394828s) [upload=89902]: Uploading segments...
Aug 12 07:39:39.033614288 (86h14m0.992711534s) [upload=89902]: Got next segment. Inline: false
Aug 12 07:39:39.033650349 (86h14m0.992747593s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 07:39:39.033656004 (86h14m0.992753239s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 07:39:39.229399173 (86h14m1.188496429s) [seg_pos={0 0}, upload=89902]: Begin upload segment...
Aug 12 07:39:39.229536336 (86h14m1.18863362s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.229583075 (86h14m1.18868033s) [seg_pos={0 0}, upload=89902]: Done begin upload segment.
Aug 12 07:39:39.229632693 (86h14m1.18872995s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.230249524 (86h14m1.189346784s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231168815 (86h14m1.190266069s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231653615 (86h14m1.190750871s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231708320 (86h14m1.190805578s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232087037 (86h14m1.19118429s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232124852 (86h14m1.191222109s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232451654 (86h14m1.191548899s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232726108 (86h14m1.191823361s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232998908 (86h14m1.192096156s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233322723 (86h14m1.192419973s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233681215 (86h14m1.192778467s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234038674 (86h14m1.193135925s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234617189 (86h14m1.193714435s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.235225598 (86h14m1.194322854s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236117344 (86h14m1.1952146s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236656502 (86h14m1.195753759s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.809708997 (86h14m1.768806234s) [upload=89902]: Next returned nil segment
Aug 12 07:39:39.809729179 (86h14m1.768826427s) [upload=89902]: Waiting for error group managing segments...
Aug 12 07:39:39.955449038 (86h14m1.914546289s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.963009445 (86h14m1.922106685s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964027666 (86h14m1.923124903s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964137955 (86h14m1.923235189s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.967444571 (86h14m1.926541844s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.971467265 (86h14m1.930564514s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.975455659 (86h14m1.934552911s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.976817364 (86h14m1.935914613s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.982854369 (86h14m1.941951625s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988427330 (86h14m1.947524564s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988927474 (86h14m1.948024767s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.993577207 (86h14m1.952674453s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.007387925 (86h14m1.966485164s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016441684 (86h14m1.975538926s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016473817 (86h14m1.975571082s) [seg_pos={0 0}, upload=89902]: Segment reached optimal threshold of 14 pieces.
Aug 12 07:39:40.016693696 (86h14m1.975790944s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016867797 (86h14m1.975965043s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124BC3547CnJ34CsBzFawJz9kFot4tZ6MTuRXa7Jed8JMSTe72D): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016945944 (86h14m1.976043189s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLCXYP6sppXZcmj49C8jjgXbLGzgyowtpb1um9XZguzfVnM2r): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017069802 (86h14m1.976167041s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017101045 (86h14m1.97619828s) [seg_pos={0 0}, upload=89902]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 07:39:40.017197440 (86h14m1.976294685s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 07:39:40.017203455 (86h14m1.976300702s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 07:39:40.172728058 (86h14m2.131825312s) [upload=89902]: Done uploading segments...
Aug 12 07:39:40.172750765 (86h14m2.13184801s) [upload=89902]: Upload finished. err: <nil>
Duration: 2.444315853s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.441312458s
FAIL (2025-08-12 08:23:54 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 07:39:39.033059184 (86h14m0.992156426s) [upload=89902]: Starting upload
Aug 12 07:39:39.033152120 (86h14m0.992249364s) [upload=89902]: Done starting upload
Aug 12 07:39:39.033297583 (86h14m0.992394828s) [upload=89902]: Uploading segments...
Aug 12 07:39:39.033614288 (86h14m0.992711534s) [upload=89902]: Got next segment. Inline: false
Aug 12 07:39:39.033650349 (86h14m0.992747593s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 07:39:39.033656004 (86h14m0.992753239s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 07:39:39.229399173 (86h14m1.188496429s) [seg_pos={0 0}, upload=89902]: Begin upload segment...
Aug 12 07:39:39.229536336 (86h14m1.18863362s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.229583075 (86h14m1.18868033s) [seg_pos={0 0}, upload=89902]: Done begin upload segment.
Aug 12 07:39:39.229632693 (86h14m1.18872995s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.230249524 (86h14m1.189346784s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231168815 (86h14m1.190266069s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231653615 (86h14m1.190750871s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231708320 (86h14m1.190805578s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232087037 (86h14m1.19118429s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232124852 (86h14m1.191222109s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232451654 (86h14m1.191548899s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232726108 (86h14m1.191823361s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232998908 (86h14m1.192096156s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233322723 (86h14m1.192419973s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233681215 (86h14m1.192778467s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234038674 (86h14m1.193135925s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234617189 (86h14m1.193714435s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.235225598 (86h14m1.194322854s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236117344 (86h14m1.1952146s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236656502 (86h14m1.195753759s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.809708997 (86h14m1.768806234s) [upload=89902]: Next returned nil segment
Aug 12 07:39:39.809729179 (86h14m1.768826427s) [upload=89902]: Waiting for error group managing segments...
Aug 12 07:39:39.955449038 (86h14m1.914546289s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.963009445 (86h14m1.922106685s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964027666 (86h14m1.923124903s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964137955 (86h14m1.923235189s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.967444571 (86h14m1.926541844s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.971467265 (86h14m1.930564514s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.975455659 (86h14m1.934552911s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.976817364 (86h14m1.935914613s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.982854369 (86h14m1.941951625s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988427330 (86h14m1.947524564s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988927474 (86h14m1.948024767s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.993577207 (86h14m1.952674453s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.007387925 (86h14m1.966485164s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016441684 (86h14m1.975538926s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016473817 (86h14m1.975571082s) [seg_pos={0 0}, upload=89902]: Segment reached optimal threshold of 14 pieces.
Aug 12 07:39:40.016693696 (86h14m1.975790944s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016867797 (86h14m1.975965043s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124BC3547CnJ34CsBzFawJz9kFot4tZ6MTuRXa7Jed8JMSTe72D): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016945944 (86h14m1.976043189s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLCXYP6sppXZcmj49C8jjgXbLGzgyowtpb1um9XZguzfVnM2r): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017069802 (86h14m1.976167041s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017101045 (86h14m1.97619828s) [seg_pos={0 0}, upload=89902]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 07:39:40.017197440 (86h14m1.976294685s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 07:39:40.017203455 (86h14m1.976300702s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 07:39:40.172728058 (86h14m2.131825312s) [upload=89902]: Done uploading segments...
Aug 12 07:39:40.172750765 (86h14m2.13184801s) [upload=89902]: Upload finished. err: <nil>
Duration: 2.441435374s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
862.379985ms
FAIL (2025-08-12 08:23:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 07:48:59.843550821 (86h23m21.802648066s) [upload=90065]: Starting upload Aug 12 07:48:59.843665323 (86h23m21.80276257s) [upload=90065]: Done starting upload Aug 12 07:48:59.843805919 (86h23m21.802903157s) [upload=90065]: Uploading segments... Aug 12 07:48:59.843865214 (86h23m21.80296246s) [upload=90065]: Got next segment. Inline: true Aug 12 07:48:59.843870966 (86h23m21.802968211s) [upload=90065]: Waiting for error group managing segments... Aug 12 07:48:59.843916743 (86h23m21.803013989s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 07:48:59.843922059 (86h23m21.803019304s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 07:48:59.843925700 (86h23m21.803022945s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 07:48:59.933867301 (86h23m21.892964556s) [upload=90065]: Done uploading segments... Aug 12 07:48:59.933890446 (86h23m21.892987699s) [upload=90065]: Upload finished. err: metaclient: Too Many Requests
Duration: 862.475893ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
870.059448ms
FAIL (2025-08-12 08:22:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 07:48:59.843550821 (86h23m21.802648066s) [upload=90065]: Starting upload Aug 12 07:48:59.843665323 (86h23m21.80276257s) [upload=90065]: Done starting upload Aug 12 07:48:59.843805919 (86h23m21.802903157s) [upload=90065]: Uploading segments... Aug 12 07:48:59.843865214 (86h23m21.80296246s) [upload=90065]: Got next segment. Inline: true Aug 12 07:48:59.843870966 (86h23m21.802968211s) [upload=90065]: Waiting for error group managing segments... Aug 12 07:48:59.843916743 (86h23m21.803013989s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 07:48:59.843922059 (86h23m21.803019304s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 07:48:59.843925700 (86h23m21.803022945s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 07:48:59.933867301 (86h23m21.892964556s) [upload=90065]: Done uploading segments... Aug 12 07:48:59.933890446 (86h23m21.892987699s) [upload=90065]: Upload finished. err: metaclient: Too Many Requests
Duration: 870.159191ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.48493734s
FAIL (2025-08-12 08:22:43 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 07:39:39.033059184 (86h14m0.992156426s) [upload=89902]: Starting upload
Aug 12 07:39:39.033152120 (86h14m0.992249364s) [upload=89902]: Done starting upload
Aug 12 07:39:39.033297583 (86h14m0.992394828s) [upload=89902]: Uploading segments...
Aug 12 07:39:39.033614288 (86h14m0.992711534s) [upload=89902]: Got next segment. Inline: false
Aug 12 07:39:39.033650349 (86h14m0.992747593s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 07:39:39.033656004 (86h14m0.992753239s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 07:39:39.229399173 (86h14m1.188496429s) [seg_pos={0 0}, upload=89902]: Begin upload segment...
Aug 12 07:39:39.229536336 (86h14m1.18863362s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.229583075 (86h14m1.18868033s) [seg_pos={0 0}, upload=89902]: Done begin upload segment.
Aug 12 07:39:39.229632693 (86h14m1.18872995s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.230249524 (86h14m1.189346784s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231168815 (86h14m1.190266069s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231653615 (86h14m1.190750871s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231708320 (86h14m1.190805578s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232087037 (86h14m1.19118429s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232124852 (86h14m1.191222109s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232451654 (86h14m1.191548899s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232726108 (86h14m1.191823361s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232998908 (86h14m1.192096156s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233322723 (86h14m1.192419973s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233681215 (86h14m1.192778467s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234038674 (86h14m1.193135925s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234617189 (86h14m1.193714435s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.235225598 (86h14m1.194322854s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236117344 (86h14m1.1952146s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236656502 (86h14m1.195753759s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.809708997 (86h14m1.768806234s) [upload=89902]: Next returned nil segment
Aug 12 07:39:39.809729179 (86h14m1.768826427s) [upload=89902]: Waiting for error group managing segments...
Aug 12 07:39:39.955449038 (86h14m1.914546289s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.963009445 (86h14m1.922106685s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964027666 (86h14m1.923124903s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964137955 (86h14m1.923235189s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.967444571 (86h14m1.926541844s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.971467265 (86h14m1.930564514s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.975455659 (86h14m1.934552911s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.976817364 (86h14m1.935914613s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.982854369 (86h14m1.941951625s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988427330 (86h14m1.947524564s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988927474 (86h14m1.948024767s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.993577207 (86h14m1.952674453s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.007387925 (86h14m1.966485164s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016441684 (86h14m1.975538926s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016473817 (86h14m1.975571082s) [seg_pos={0 0}, upload=89902]: Segment reached optimal threshold of 14 pieces.
Aug 12 07:39:40.016693696 (86h14m1.975790944s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016867797 (86h14m1.975965043s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124BC3547CnJ34CsBzFawJz9kFot4tZ6MTuRXa7Jed8JMSTe72D): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016945944 (86h14m1.976043189s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLCXYP6sppXZcmj49C8jjgXbLGzgyowtpb1um9XZguzfVnM2r): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017069802 (86h14m1.976167041s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017101045 (86h14m1.97619828s) [seg_pos={0 0}, upload=89902]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 07:39:40.017197440 (86h14m1.976294685s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 07:39:40.017203455 (86h14m1.976300702s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 07:39:40.172728058 (86h14m2.131825312s) [upload=89902]: Done uploading segments...
Aug 12 07:39:40.172750765 (86h14m2.13184801s) [upload=89902]: Upload finished. err: <nil>
Duration: 2.484963792s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.476566458s
FAIL (2025-08-12 08:22:07 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 07:39:39.033059184 (86h14m0.992156426s) [upload=89902]: Starting upload
Aug 12 07:39:39.033152120 (86h14m0.992249364s) [upload=89902]: Done starting upload
Aug 12 07:39:39.033297583 (86h14m0.992394828s) [upload=89902]: Uploading segments...
Aug 12 07:39:39.033614288 (86h14m0.992711534s) [upload=89902]: Got next segment. Inline: false
Aug 12 07:39:39.033650349 (86h14m0.992747593s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 07:39:39.033656004 (86h14m0.992753239s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 07:39:39.229399173 (86h14m1.188496429s) [seg_pos={0 0}, upload=89902]: Begin upload segment...
Aug 12 07:39:39.229536336 (86h14m1.18863362s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.229583075 (86h14m1.18868033s) [seg_pos={0 0}, upload=89902]: Done begin upload segment.
Aug 12 07:39:39.229632693 (86h14m1.18872995s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.230249524 (86h14m1.189346784s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231168815 (86h14m1.190266069s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231653615 (86h14m1.190750871s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231708320 (86h14m1.190805578s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232087037 (86h14m1.19118429s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232124852 (86h14m1.191222109s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232451654 (86h14m1.191548899s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232726108 (86h14m1.191823361s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232998908 (86h14m1.192096156s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233322723 (86h14m1.192419973s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233681215 (86h14m1.192778467s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234038674 (86h14m1.193135925s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234617189 (86h14m1.193714435s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.235225598 (86h14m1.194322854s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236117344 (86h14m1.1952146s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236656502 (86h14m1.195753759s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.809708997 (86h14m1.768806234s) [upload=89902]: Next returned nil segment
Aug 12 07:39:39.809729179 (86h14m1.768826427s) [upload=89902]: Waiting for error group managing segments...
Aug 12 07:39:39.955449038 (86h14m1.914546289s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.963009445 (86h14m1.922106685s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964027666 (86h14m1.923124903s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964137955 (86h14m1.923235189s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.967444571 (86h14m1.926541844s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.971467265 (86h14m1.930564514s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.975455659 (86h14m1.934552911s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.976817364 (86h14m1.935914613s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.982854369 (86h14m1.941951625s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988427330 (86h14m1.947524564s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988927474 (86h14m1.948024767s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.993577207 (86h14m1.952674453s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.007387925 (86h14m1.966485164s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016441684 (86h14m1.975538926s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016473817 (86h14m1.975571082s) [seg_pos={0 0}, upload=89902]: Segment reached optimal threshold of 14 pieces.
Aug 12 07:39:40.016693696 (86h14m1.975790944s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016867797 (86h14m1.975965043s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124BC3547CnJ34CsBzFawJz9kFot4tZ6MTuRXa7Jed8JMSTe72D): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016945944 (86h14m1.976043189s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLCXYP6sppXZcmj49C8jjgXbLGzgyowtpb1um9XZguzfVnM2r): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017069802 (86h14m1.976167041s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017101045 (86h14m1.97619828s) [seg_pos={0 0}, upload=89902]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 07:39:40.017197440 (86h14m1.976294685s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 07:39:40.017203455 (86h14m1.976300702s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 07:39:40.172728058 (86h14m2.131825312s) [upload=89902]: Done uploading segments...
Aug 12 07:39:40.172750765 (86h14m2.13184801s) [upload=89902]: Upload finished. err: <nil>
Duration: 2.476594622s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
833.488578ms
FAIL (2025-08-12 08:21:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 07:48:59.843550821 (86h23m21.802648066s) [upload=90065]: Starting upload Aug 12 07:48:59.843665323 (86h23m21.80276257s) [upload=90065]: Done starting upload Aug 12 07:48:59.843805919 (86h23m21.802903157s) [upload=90065]: Uploading segments... Aug 12 07:48:59.843865214 (86h23m21.80296246s) [upload=90065]: Got next segment. Inline: true Aug 12 07:48:59.843870966 (86h23m21.802968211s) [upload=90065]: Waiting for error group managing segments... Aug 12 07:48:59.843916743 (86h23m21.803013989s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 07:48:59.843922059 (86h23m21.803019304s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 07:48:59.843925700 (86h23m21.803022945s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 07:48:59.933867301 (86h23m21.892964556s) [upload=90065]: Done uploading segments... Aug 12 07:48:59.933890446 (86h23m21.892987699s) [upload=90065]: Upload finished. err: metaclient: Too Many Requests
Duration: 833.539954ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.430986609s
FAIL (2025-08-12 08:21:45 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 07:39:39.033059184 (86h14m0.992156426s) [upload=89902]: Starting upload
Aug 12 07:39:39.033152120 (86h14m0.992249364s) [upload=89902]: Done starting upload
Aug 12 07:39:39.033297583 (86h14m0.992394828s) [upload=89902]: Uploading segments...
Aug 12 07:39:39.033614288 (86h14m0.992711534s) [upload=89902]: Got next segment. Inline: false
Aug 12 07:39:39.033650349 (86h14m0.992747593s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 07:39:39.033656004 (86h14m0.992753239s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 07:39:39.229399173 (86h14m1.188496429s) [seg_pos={0 0}, upload=89902]: Begin upload segment...
Aug 12 07:39:39.229536336 (86h14m1.18863362s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.229583075 (86h14m1.18868033s) [seg_pos={0 0}, upload=89902]: Done begin upload segment.
Aug 12 07:39:39.229632693 (86h14m1.18872995s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.230249524 (86h14m1.189346784s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231168815 (86h14m1.190266069s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231653615 (86h14m1.190750871s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231708320 (86h14m1.190805578s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232087037 (86h14m1.19118429s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232124852 (86h14m1.191222109s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232451654 (86h14m1.191548899s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232726108 (86h14m1.191823361s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232998908 (86h14m1.192096156s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233322723 (86h14m1.192419973s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233681215 (86h14m1.192778467s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234038674 (86h14m1.193135925s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234617189 (86h14m1.193714435s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.235225598 (86h14m1.194322854s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236117344 (86h14m1.1952146s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236656502 (86h14m1.195753759s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.809708997 (86h14m1.768806234s) [upload=89902]: Next returned nil segment
Aug 12 07:39:39.809729179 (86h14m1.768826427s) [upload=89902]: Waiting for error group managing segments...
Aug 12 07:39:39.955449038 (86h14m1.914546289s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.963009445 (86h14m1.922106685s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964027666 (86h14m1.923124903s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964137955 (86h14m1.923235189s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.967444571 (86h14m1.926541844s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.971467265 (86h14m1.930564514s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.975455659 (86h14m1.934552911s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.976817364 (86h14m1.935914613s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.982854369 (86h14m1.941951625s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988427330 (86h14m1.947524564s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988927474 (86h14m1.948024767s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.993577207 (86h14m1.952674453s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.007387925 (86h14m1.966485164s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016441684 (86h14m1.975538926s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016473817 (86h14m1.975571082s) [seg_pos={0 0}, upload=89902]: Segment reached optimal threshold of 14 pieces.
Aug 12 07:39:40.016693696 (86h14m1.975790944s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016867797 (86h14m1.975965043s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124BC3547CnJ34CsBzFawJz9kFot4tZ6MTuRXa7Jed8JMSTe72D): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016945944 (86h14m1.976043189s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLCXYP6sppXZcmj49C8jjgXbLGzgyowtpb1um9XZguzfVnM2r): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017069802 (86h14m1.976167041s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017101045 (86h14m1.97619828s) [seg_pos={0 0}, upload=89902]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 07:39:40.017197440 (86h14m1.976294685s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 07:39:40.017203455 (86h14m1.976300702s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 07:39:40.172728058 (86h14m2.131825312s) [upload=89902]: Done uploading segments...
Aug 12 07:39:40.172750765 (86h14m2.13184801s) [upload=89902]: Upload finished. err: <nil>
Duration: 2.431051789s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
1.896345538s
FAIL (2025-08-12 08:21:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 07:48:59.843550821 (86h23m21.802648066s) [upload=90065]: Starting upload Aug 12 07:48:59.843665323 (86h23m21.80276257s) [upload=90065]: Done starting upload Aug 12 07:48:59.843805919 (86h23m21.802903157s) [upload=90065]: Uploading segments... Aug 12 07:48:59.843865214 (86h23m21.80296246s) [upload=90065]: Got next segment. Inline: true Aug 12 07:48:59.843870966 (86h23m21.802968211s) [upload=90065]: Waiting for error group managing segments... Aug 12 07:48:59.843916743 (86h23m21.803013989s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 07:48:59.843922059 (86h23m21.803019304s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 07:48:59.843925700 (86h23m21.803022945s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 07:48:59.933867301 (86h23m21.892964556s) [upload=90065]: Done uploading segments... Aug 12 07:48:59.933890446 (86h23m21.892987699s) [upload=90065]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.896381432s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.375598351s
FAIL (2025-08-12 08:21:09 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 07:39:39.033059184 (86h14m0.992156426s) [upload=89902]: Starting upload
Aug 12 07:39:39.033152120 (86h14m0.992249364s) [upload=89902]: Done starting upload
Aug 12 07:39:39.033297583 (86h14m0.992394828s) [upload=89902]: Uploading segments...
Aug 12 07:39:39.033614288 (86h14m0.992711534s) [upload=89902]: Got next segment. Inline: false
Aug 12 07:39:39.033650349 (86h14m0.992747593s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 07:39:39.033656004 (86h14m0.992753239s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 07:39:39.229399173 (86h14m1.188496429s) [seg_pos={0 0}, upload=89902]: Begin upload segment...
Aug 12 07:39:39.229536336 (86h14m1.18863362s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.229583075 (86h14m1.18868033s) [seg_pos={0 0}, upload=89902]: Done begin upload segment.
Aug 12 07:39:39.229632693 (86h14m1.18872995s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.230249524 (86h14m1.189346784s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231168815 (86h14m1.190266069s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231653615 (86h14m1.190750871s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231708320 (86h14m1.190805578s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232087037 (86h14m1.19118429s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232124852 (86h14m1.191222109s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232451654 (86h14m1.191548899s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232726108 (86h14m1.191823361s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232998908 (86h14m1.192096156s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233322723 (86h14m1.192419973s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233681215 (86h14m1.192778467s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234038674 (86h14m1.193135925s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234617189 (86h14m1.193714435s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.235225598 (86h14m1.194322854s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236117344 (86h14m1.1952146s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236656502 (86h14m1.195753759s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.809708997 (86h14m1.768806234s) [upload=89902]: Next returned nil segment
Aug 12 07:39:39.809729179 (86h14m1.768826427s) [upload=89902]: Waiting for error group managing segments...
Aug 12 07:39:39.955449038 (86h14m1.914546289s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.963009445 (86h14m1.922106685s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964027666 (86h14m1.923124903s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964137955 (86h14m1.923235189s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.967444571 (86h14m1.926541844s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.971467265 (86h14m1.930564514s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.975455659 (86h14m1.934552911s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.976817364 (86h14m1.935914613s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.982854369 (86h14m1.941951625s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988427330 (86h14m1.947524564s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988927474 (86h14m1.948024767s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.993577207 (86h14m1.952674453s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.007387925 (86h14m1.966485164s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016441684 (86h14m1.975538926s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016473817 (86h14m1.975571082s) [seg_pos={0 0}, upload=89902]: Segment reached optimal threshold of 14 pieces.
Aug 12 07:39:40.016693696 (86h14m1.975790944s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016867797 (86h14m1.975965043s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124BC3547CnJ34CsBzFawJz9kFot4tZ6MTuRXa7Jed8JMSTe72D): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016945944 (86h14m1.976043189s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLCXYP6sppXZcmj49C8jjgXbLGzgyowtpb1um9XZguzfVnM2r): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017069802 (86h14m1.976167041s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017101045 (86h14m1.97619828s) [seg_pos={0 0}, upload=89902]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 07:39:40.017197440 (86h14m1.976294685s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 07:39:40.017203455 (86h14m1.976300702s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 07:39:40.172728058 (86h14m2.131825312s) [upload=89902]: Done uploading segments...
Aug 12 07:39:40.172750765 (86h14m2.13184801s) [upload=89902]: Upload finished. err: <nil>
Duration: 2.375656384s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
852.221694ms
FAIL (2025-08-12 08:20:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 07:48:59.843550821 (86h23m21.802648066s) [upload=90065]: Starting upload Aug 12 07:48:59.843665323 (86h23m21.80276257s) [upload=90065]: Done starting upload Aug 12 07:48:59.843805919 (86h23m21.802903157s) [upload=90065]: Uploading segments... Aug 12 07:48:59.843865214 (86h23m21.80296246s) [upload=90065]: Got next segment. Inline: true Aug 12 07:48:59.843870966 (86h23m21.802968211s) [upload=90065]: Waiting for error group managing segments... Aug 12 07:48:59.843916743 (86h23m21.803013989s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 07:48:59.843922059 (86h23m21.803019304s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 07:48:59.843925700 (86h23m21.803022945s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 07:48:59.933867301 (86h23m21.892964556s) [upload=90065]: Done uploading segments... Aug 12 07:48:59.933890446 (86h23m21.892987699s) [upload=90065]: Upload finished. err: metaclient: Too Many Requests
Duration: 852.252606ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.397969637s
FAIL (2025-08-12 08:20:09 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 07:39:39.033059184 (86h14m0.992156426s) [upload=89902]: Starting upload
Aug 12 07:39:39.033152120 (86h14m0.992249364s) [upload=89902]: Done starting upload
Aug 12 07:39:39.033297583 (86h14m0.992394828s) [upload=89902]: Uploading segments...
Aug 12 07:39:39.033614288 (86h14m0.992711534s) [upload=89902]: Got next segment. Inline: false
Aug 12 07:39:39.033650349 (86h14m0.992747593s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 07:39:39.033656004 (86h14m0.992753239s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 07:39:39.229399173 (86h14m1.188496429s) [seg_pos={0 0}, upload=89902]: Begin upload segment...
Aug 12 07:39:39.229536336 (86h14m1.18863362s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.229583075 (86h14m1.18868033s) [seg_pos={0 0}, upload=89902]: Done begin upload segment.
Aug 12 07:39:39.229632693 (86h14m1.18872995s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.230249524 (86h14m1.189346784s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231168815 (86h14m1.190266069s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231653615 (86h14m1.190750871s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231708320 (86h14m1.190805578s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232087037 (86h14m1.19118429s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232124852 (86h14m1.191222109s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232451654 (86h14m1.191548899s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232726108 (86h14m1.191823361s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232998908 (86h14m1.192096156s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233322723 (86h14m1.192419973s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233681215 (86h14m1.192778467s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234038674 (86h14m1.193135925s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234617189 (86h14m1.193714435s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.235225598 (86h14m1.194322854s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236117344 (86h14m1.1952146s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236656502 (86h14m1.195753759s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.809708997 (86h14m1.768806234s) [upload=89902]: Next returned nil segment
Aug 12 07:39:39.809729179 (86h14m1.768826427s) [upload=89902]: Waiting for error group managing segments...
Aug 12 07:39:39.955449038 (86h14m1.914546289s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.963009445 (86h14m1.922106685s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964027666 (86h14m1.923124903s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964137955 (86h14m1.923235189s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.967444571 (86h14m1.926541844s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.971467265 (86h14m1.930564514s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.975455659 (86h14m1.934552911s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.976817364 (86h14m1.935914613s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.982854369 (86h14m1.941951625s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988427330 (86h14m1.947524564s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988927474 (86h14m1.948024767s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.993577207 (86h14m1.952674453s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.007387925 (86h14m1.966485164s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016441684 (86h14m1.975538926s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016473817 (86h14m1.975571082s) [seg_pos={0 0}, upload=89902]: Segment reached optimal threshold of 14 pieces.
Aug 12 07:39:40.016693696 (86h14m1.975790944s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016867797 (86h14m1.975965043s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124BC3547CnJ34CsBzFawJz9kFot4tZ6MTuRXa7Jed8JMSTe72D): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016945944 (86h14m1.976043189s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLCXYP6sppXZcmj49C8jjgXbLGzgyowtpb1um9XZguzfVnM2r): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017069802 (86h14m1.976167041s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017101045 (86h14m1.97619828s) [seg_pos={0 0}, upload=89902]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 07:39:40.017197440 (86h14m1.976294685s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 07:39:40.017203455 (86h14m1.976300702s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 07:39:40.172728058 (86h14m2.131825312s) [upload=89902]: Done uploading segments...
Aug 12 07:39:40.172750765 (86h14m2.13184801s) [upload=89902]: Upload finished. err: <nil>
Duration: 2.398094526s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
819.637336ms
FAIL (2025-08-12 08:19:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 07:48:59.843550821 (86h23m21.802648066s) [upload=90065]: Starting upload Aug 12 07:48:59.843665323 (86h23m21.80276257s) [upload=90065]: Done starting upload Aug 12 07:48:59.843805919 (86h23m21.802903157s) [upload=90065]: Uploading segments... Aug 12 07:48:59.843865214 (86h23m21.80296246s) [upload=90065]: Got next segment. Inline: true Aug 12 07:48:59.843870966 (86h23m21.802968211s) [upload=90065]: Waiting for error group managing segments... Aug 12 07:48:59.843916743 (86h23m21.803013989s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 07:48:59.843922059 (86h23m21.803019304s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 07:48:59.843925700 (86h23m21.803022945s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 07:48:59.933867301 (86h23m21.892964556s) [upload=90065]: Done uploading segments... Aug 12 07:48:59.933890446 (86h23m21.892987699s) [upload=90065]: Upload finished. err: metaclient: Too Many Requests
Duration: 819.665838ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.513985929s
FAIL (2025-08-12 08:19:20 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 07:39:39.033059184 (86h14m0.992156426s) [upload=89902]: Starting upload
Aug 12 07:39:39.033152120 (86h14m0.992249364s) [upload=89902]: Done starting upload
Aug 12 07:39:39.033297583 (86h14m0.992394828s) [upload=89902]: Uploading segments...
Aug 12 07:39:39.033614288 (86h14m0.992711534s) [upload=89902]: Got next segment. Inline: false
Aug 12 07:39:39.033650349 (86h14m0.992747593s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 07:39:39.033656004 (86h14m0.992753239s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 07:39:39.229399173 (86h14m1.188496429s) [seg_pos={0 0}, upload=89902]: Begin upload segment...
Aug 12 07:39:39.229536336 (86h14m1.18863362s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.229583075 (86h14m1.18868033s) [seg_pos={0 0}, upload=89902]: Done begin upload segment.
Aug 12 07:39:39.229632693 (86h14m1.18872995s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.230249524 (86h14m1.189346784s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231168815 (86h14m1.190266069s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231653615 (86h14m1.190750871s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231708320 (86h14m1.190805578s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232087037 (86h14m1.19118429s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232124852 (86h14m1.191222109s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232451654 (86h14m1.191548899s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232726108 (86h14m1.191823361s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232998908 (86h14m1.192096156s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233322723 (86h14m1.192419973s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233681215 (86h14m1.192778467s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234038674 (86h14m1.193135925s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234617189 (86h14m1.193714435s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.235225598 (86h14m1.194322854s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236117344 (86h14m1.1952146s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236656502 (86h14m1.195753759s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.809708997 (86h14m1.768806234s) [upload=89902]: Next returned nil segment
Aug 12 07:39:39.809729179 (86h14m1.768826427s) [upload=89902]: Waiting for error group managing segments...
Aug 12 07:39:39.955449038 (86h14m1.914546289s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.963009445 (86h14m1.922106685s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964027666 (86h14m1.923124903s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964137955 (86h14m1.923235189s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.967444571 (86h14m1.926541844s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.971467265 (86h14m1.930564514s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.975455659 (86h14m1.934552911s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.976817364 (86h14m1.935914613s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.982854369 (86h14m1.941951625s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988427330 (86h14m1.947524564s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988927474 (86h14m1.948024767s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.993577207 (86h14m1.952674453s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.007387925 (86h14m1.966485164s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016441684 (86h14m1.975538926s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016473817 (86h14m1.975571082s) [seg_pos={0 0}, upload=89902]: Segment reached optimal threshold of 14 pieces.
Aug 12 07:39:40.016693696 (86h14m1.975790944s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016867797 (86h14m1.975965043s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124BC3547CnJ34CsBzFawJz9kFot4tZ6MTuRXa7Jed8JMSTe72D): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016945944 (86h14m1.976043189s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLCXYP6sppXZcmj49C8jjgXbLGzgyowtpb1um9XZguzfVnM2r): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017069802 (86h14m1.976167041s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017101045 (86h14m1.97619828s) [seg_pos={0 0}, upload=89902]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 07:39:40.017197440 (86h14m1.976294685s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 07:39:40.017203455 (86h14m1.976300702s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 07:39:40.172728058 (86h14m2.131825312s) [upload=89902]: Done uploading segments...
Aug 12 07:39:40.172750765 (86h14m2.13184801s) [upload=89902]: Upload finished. err: <nil>
Duration: 2.514018461s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
839.23669ms
FAIL (2025-08-12 08:19:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 07:48:59.843550821 (86h23m21.802648066s) [upload=90065]: Starting upload Aug 12 07:48:59.843665323 (86h23m21.80276257s) [upload=90065]: Done starting upload Aug 12 07:48:59.843805919 (86h23m21.802903157s) [upload=90065]: Uploading segments... Aug 12 07:48:59.843865214 (86h23m21.80296246s) [upload=90065]: Got next segment. Inline: true Aug 12 07:48:59.843870966 (86h23m21.802968211s) [upload=90065]: Waiting for error group managing segments... Aug 12 07:48:59.843916743 (86h23m21.803013989s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 07:48:59.843922059 (86h23m21.803019304s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 07:48:59.843925700 (86h23m21.803022945s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 07:48:59.933867301 (86h23m21.892964556s) [upload=90065]: Done uploading segments... Aug 12 07:48:59.933890446 (86h23m21.892987699s) [upload=90065]: Upload finished. err: metaclient: Too Many Requests
Duration: 839.26742ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
839.423519ms
FAIL (2025-08-12 08:18:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 07:48:59.843550821 (86h23m21.802648066s) [upload=90065]: Starting upload Aug 12 07:48:59.843665323 (86h23m21.80276257s) [upload=90065]: Done starting upload Aug 12 07:48:59.843805919 (86h23m21.802903157s) [upload=90065]: Uploading segments... Aug 12 07:48:59.843865214 (86h23m21.80296246s) [upload=90065]: Got next segment. Inline: true Aug 12 07:48:59.843870966 (86h23m21.802968211s) [upload=90065]: Waiting for error group managing segments... Aug 12 07:48:59.843916743 (86h23m21.803013989s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 07:48:59.843922059 (86h23m21.803019304s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 07:48:59.843925700 (86h23m21.803022945s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 07:48:59.933867301 (86h23m21.892964556s) [upload=90065]: Done uploading segments... Aug 12 07:48:59.933890446 (86h23m21.892987699s) [upload=90065]: Upload finished. err: metaclient: Too Many Requests
Duration: 839.459489ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
2.377705302s
FAIL (2025-08-12 08:18:32 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 07:39:39.033059184 (86h14m0.992156426s) [upload=89902]: Starting upload
Aug 12 07:39:39.033152120 (86h14m0.992249364s) [upload=89902]: Done starting upload
Aug 12 07:39:39.033297583 (86h14m0.992394828s) [upload=89902]: Uploading segments...
Aug 12 07:39:39.033614288 (86h14m0.992711534s) [upload=89902]: Got next segment. Inline: false
Aug 12 07:39:39.033650349 (86h14m0.992747593s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 07:39:39.033656004 (86h14m0.992753239s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 07:39:39.229399173 (86h14m1.188496429s) [seg_pos={0 0}, upload=89902]: Begin upload segment...
Aug 12 07:39:39.229536336 (86h14m1.18863362s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.229583075 (86h14m1.18868033s) [seg_pos={0 0}, upload=89902]: Done begin upload segment.
Aug 12 07:39:39.229632693 (86h14m1.18872995s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.230249524 (86h14m1.189346784s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231168815 (86h14m1.190266069s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231653615 (86h14m1.190750871s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231708320 (86h14m1.190805578s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232087037 (86h14m1.19118429s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232124852 (86h14m1.191222109s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232451654 (86h14m1.191548899s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232726108 (86h14m1.191823361s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232998908 (86h14m1.192096156s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233322723 (86h14m1.192419973s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233681215 (86h14m1.192778467s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234038674 (86h14m1.193135925s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234617189 (86h14m1.193714435s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.235225598 (86h14m1.194322854s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236117344 (86h14m1.1952146s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236656502 (86h14m1.195753759s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.809708997 (86h14m1.768806234s) [upload=89902]: Next returned nil segment
Aug 12 07:39:39.809729179 (86h14m1.768826427s) [upload=89902]: Waiting for error group managing segments...
Aug 12 07:39:39.955449038 (86h14m1.914546289s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.963009445 (86h14m1.922106685s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964027666 (86h14m1.923124903s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964137955 (86h14m1.923235189s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.967444571 (86h14m1.926541844s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.971467265 (86h14m1.930564514s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.975455659 (86h14m1.934552911s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.976817364 (86h14m1.935914613s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.982854369 (86h14m1.941951625s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988427330 (86h14m1.947524564s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988927474 (86h14m1.948024767s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.993577207 (86h14m1.952674453s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.007387925 (86h14m1.966485164s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016441684 (86h14m1.975538926s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016473817 (86h14m1.975571082s) [seg_pos={0 0}, upload=89902]: Segment reached optimal threshold of 14 pieces.
Aug 12 07:39:40.016693696 (86h14m1.975790944s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016867797 (86h14m1.975965043s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124BC3547CnJ34CsBzFawJz9kFot4tZ6MTuRXa7Jed8JMSTe72D): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016945944 (86h14m1.976043189s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLCXYP6sppXZcmj49C8jjgXbLGzgyowtpb1um9XZguzfVnM2r): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017069802 (86h14m1.976167041s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017101045 (86h14m1.97619828s) [seg_pos={0 0}, upload=89902]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 07:39:40.017197440 (86h14m1.976294685s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 07:39:40.017203455 (86h14m1.976300702s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 07:39:40.172728058 (86h14m2.131825312s) [upload=89902]: Done uploading segments...
Aug 12 07:39:40.172750765 (86h14m2.13184801s) [upload=89902]: Upload finished. err: <nil>
Duration: 2.377734918s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.36952588s
FAIL (2025-08-12 08:18:07 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 07:39:39.033059184 (86h14m0.992156426s) [upload=89902]: Starting upload
Aug 12 07:39:39.033152120 (86h14m0.992249364s) [upload=89902]: Done starting upload
Aug 12 07:39:39.033297583 (86h14m0.992394828s) [upload=89902]: Uploading segments...
Aug 12 07:39:39.033614288 (86h14m0.992711534s) [upload=89902]: Got next segment. Inline: false
Aug 12 07:39:39.033650349 (86h14m0.992747593s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 07:39:39.033656004 (86h14m0.992753239s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 07:39:39.229399173 (86h14m1.188496429s) [seg_pos={0 0}, upload=89902]: Begin upload segment...
Aug 12 07:39:39.229536336 (86h14m1.18863362s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.229583075 (86h14m1.18868033s) [seg_pos={0 0}, upload=89902]: Done begin upload segment.
Aug 12 07:39:39.229632693 (86h14m1.18872995s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.230249524 (86h14m1.189346784s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231168815 (86h14m1.190266069s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231653615 (86h14m1.190750871s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231708320 (86h14m1.190805578s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232087037 (86h14m1.19118429s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232124852 (86h14m1.191222109s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232451654 (86h14m1.191548899s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232726108 (86h14m1.191823361s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232998908 (86h14m1.192096156s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233322723 (86h14m1.192419973s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233681215 (86h14m1.192778467s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234038674 (86h14m1.193135925s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234617189 (86h14m1.193714435s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.235225598 (86h14m1.194322854s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236117344 (86h14m1.1952146s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236656502 (86h14m1.195753759s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.809708997 (86h14m1.768806234s) [upload=89902]: Next returned nil segment
Aug 12 07:39:39.809729179 (86h14m1.768826427s) [upload=89902]: Waiting for error group managing segments...
Aug 12 07:39:39.955449038 (86h14m1.914546289s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.963009445 (86h14m1.922106685s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964027666 (86h14m1.923124903s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964137955 (86h14m1.923235189s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.967444571 (86h14m1.926541844s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.971467265 (86h14m1.930564514s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.975455659 (86h14m1.934552911s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.976817364 (86h14m1.935914613s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.982854369 (86h14m1.941951625s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988427330 (86h14m1.947524564s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988927474 (86h14m1.948024767s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.993577207 (86h14m1.952674453s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.007387925 (86h14m1.966485164s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016441684 (86h14m1.975538926s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016473817 (86h14m1.975571082s) [seg_pos={0 0}, upload=89902]: Segment reached optimal threshold of 14 pieces.
Aug 12 07:39:40.016693696 (86h14m1.975790944s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016867797 (86h14m1.975965043s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124BC3547CnJ34CsBzFawJz9kFot4tZ6MTuRXa7Jed8JMSTe72D): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016945944 (86h14m1.976043189s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLCXYP6sppXZcmj49C8jjgXbLGzgyowtpb1um9XZguzfVnM2r): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017069802 (86h14m1.976167041s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017101045 (86h14m1.97619828s) [seg_pos={0 0}, upload=89902]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 07:39:40.017197440 (86h14m1.976294685s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 07:39:40.017203455 (86h14m1.976300702s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 07:39:40.172728058 (86h14m2.131825312s) [upload=89902]: Done uploading segments...
Aug 12 07:39:40.172750765 (86h14m2.13184801s) [upload=89902]: Upload finished. err: <nil>
Duration: 2.369561979s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
871.292659ms
FAIL (2025-08-12 08:18:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 07:48:59.843550821 (86h23m21.802648066s) [upload=90065]: Starting upload Aug 12 07:48:59.843665323 (86h23m21.80276257s) [upload=90065]: Done starting upload Aug 12 07:48:59.843805919 (86h23m21.802903157s) [upload=90065]: Uploading segments... Aug 12 07:48:59.843865214 (86h23m21.80296246s) [upload=90065]: Got next segment. Inline: true Aug 12 07:48:59.843870966 (86h23m21.802968211s) [upload=90065]: Waiting for error group managing segments... Aug 12 07:48:59.843916743 (86h23m21.803013989s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 07:48:59.843922059 (86h23m21.803019304s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 07:48:59.843925700 (86h23m21.803022945s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 07:48:59.933867301 (86h23m21.892964556s) [upload=90065]: Done uploading segments... Aug 12 07:48:59.933890446 (86h23m21.892987699s) [upload=90065]: Upload finished. err: metaclient: Too Many Requests
Duration: 871.339705ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
2.790272446s
FAIL (2025-08-12 08:17:04 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 07:39:39.033059184 (86h14m0.992156426s) [upload=89902]: Starting upload
Aug 12 07:39:39.033152120 (86h14m0.992249364s) [upload=89902]: Done starting upload
Aug 12 07:39:39.033297583 (86h14m0.992394828s) [upload=89902]: Uploading segments...
Aug 12 07:39:39.033614288 (86h14m0.992711534s) [upload=89902]: Got next segment. Inline: false
Aug 12 07:39:39.033650349 (86h14m0.992747593s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 07:39:39.033656004 (86h14m0.992753239s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 07:39:39.229399173 (86h14m1.188496429s) [seg_pos={0 0}, upload=89902]: Begin upload segment...
Aug 12 07:39:39.229536336 (86h14m1.18863362s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.229583075 (86h14m1.18868033s) [seg_pos={0 0}, upload=89902]: Done begin upload segment.
Aug 12 07:39:39.229632693 (86h14m1.18872995s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.230249524 (86h14m1.189346784s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231168815 (86h14m1.190266069s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231653615 (86h14m1.190750871s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231708320 (86h14m1.190805578s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232087037 (86h14m1.19118429s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232124852 (86h14m1.191222109s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232451654 (86h14m1.191548899s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232726108 (86h14m1.191823361s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232998908 (86h14m1.192096156s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233322723 (86h14m1.192419973s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233681215 (86h14m1.192778467s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234038674 (86h14m1.193135925s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234617189 (86h14m1.193714435s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.235225598 (86h14m1.194322854s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236117344 (86h14m1.1952146s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236656502 (86h14m1.195753759s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.809708997 (86h14m1.768806234s) [upload=89902]: Next returned nil segment
Aug 12 07:39:39.809729179 (86h14m1.768826427s) [upload=89902]: Waiting for error group managing segments...
Aug 12 07:39:39.955449038 (86h14m1.914546289s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.963009445 (86h14m1.922106685s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964027666 (86h14m1.923124903s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964137955 (86h14m1.923235189s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.967444571 (86h14m1.926541844s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.971467265 (86h14m1.930564514s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.975455659 (86h14m1.934552911s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.976817364 (86h14m1.935914613s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.982854369 (86h14m1.941951625s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988427330 (86h14m1.947524564s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988927474 (86h14m1.948024767s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.993577207 (86h14m1.952674453s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.007387925 (86h14m1.966485164s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016441684 (86h14m1.975538926s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016473817 (86h14m1.975571082s) [seg_pos={0 0}, upload=89902]: Segment reached optimal threshold of 14 pieces.
Aug 12 07:39:40.016693696 (86h14m1.975790944s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016867797 (86h14m1.975965043s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124BC3547CnJ34CsBzFawJz9kFot4tZ6MTuRXa7Jed8JMSTe72D): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016945944 (86h14m1.976043189s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLCXYP6sppXZcmj49C8jjgXbLGzgyowtpb1um9XZguzfVnM2r): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017069802 (86h14m1.976167041s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017101045 (86h14m1.97619828s) [seg_pos={0 0}, upload=89902]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 07:39:40.017197440 (86h14m1.976294685s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 07:39:40.017203455 (86h14m1.976300702s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 07:39:40.172728058 (86h14m2.131825312s) [upload=89902]: Done uploading segments...
Aug 12 07:39:40.172750765 (86h14m2.13184801s) [upload=89902]: Upload finished. err: <nil>
Duration: 2.790358568s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
829.622374ms
FAIL (2025-08-12 08:16:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 07:48:59.843550821 (86h23m21.802648066s) [upload=90065]: Starting upload Aug 12 07:48:59.843665323 (86h23m21.80276257s) [upload=90065]: Done starting upload Aug 12 07:48:59.843805919 (86h23m21.802903157s) [upload=90065]: Uploading segments... Aug 12 07:48:59.843865214 (86h23m21.80296246s) [upload=90065]: Got next segment. Inline: true Aug 12 07:48:59.843870966 (86h23m21.802968211s) [upload=90065]: Waiting for error group managing segments... Aug 12 07:48:59.843916743 (86h23m21.803013989s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 07:48:59.843922059 (86h23m21.803019304s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 07:48:59.843925700 (86h23m21.803022945s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 07:48:59.933867301 (86h23m21.892964556s) [upload=90065]: Done uploading segments... Aug 12 07:48:59.933890446 (86h23m21.892987699s) [upload=90065]: Upload finished. err: metaclient: Too Many Requests
Duration: 829.679062ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
2.86360904s
FAIL (2025-08-12 08:16:04 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 07:39:39.033059184 (86h14m0.992156426s) [upload=89902]: Starting upload
Aug 12 07:39:39.033152120 (86h14m0.992249364s) [upload=89902]: Done starting upload
Aug 12 07:39:39.033297583 (86h14m0.992394828s) [upload=89902]: Uploading segments...
Aug 12 07:39:39.033614288 (86h14m0.992711534s) [upload=89902]: Got next segment. Inline: false
Aug 12 07:39:39.033650349 (86h14m0.992747593s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 07:39:39.033656004 (86h14m0.992753239s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 07:39:39.229399173 (86h14m1.188496429s) [seg_pos={0 0}, upload=89902]: Begin upload segment...
Aug 12 07:39:39.229536336 (86h14m1.18863362s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.229583075 (86h14m1.18868033s) [seg_pos={0 0}, upload=89902]: Done begin upload segment.
Aug 12 07:39:39.229632693 (86h14m1.18872995s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.230249524 (86h14m1.189346784s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231168815 (86h14m1.190266069s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231653615 (86h14m1.190750871s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231708320 (86h14m1.190805578s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232087037 (86h14m1.19118429s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232124852 (86h14m1.191222109s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232451654 (86h14m1.191548899s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232726108 (86h14m1.191823361s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232998908 (86h14m1.192096156s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233322723 (86h14m1.192419973s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233681215 (86h14m1.192778467s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234038674 (86h14m1.193135925s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234617189 (86h14m1.193714435s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.235225598 (86h14m1.194322854s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236117344 (86h14m1.1952146s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236656502 (86h14m1.195753759s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.809708997 (86h14m1.768806234s) [upload=89902]: Next returned nil segment
Aug 12 07:39:39.809729179 (86h14m1.768826427s) [upload=89902]: Waiting for error group managing segments...
Aug 12 07:39:39.955449038 (86h14m1.914546289s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.963009445 (86h14m1.922106685s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964027666 (86h14m1.923124903s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964137955 (86h14m1.923235189s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.967444571 (86h14m1.926541844s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.971467265 (86h14m1.930564514s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.975455659 (86h14m1.934552911s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.976817364 (86h14m1.935914613s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.982854369 (86h14m1.941951625s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988427330 (86h14m1.947524564s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988927474 (86h14m1.948024767s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.993577207 (86h14m1.952674453s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.007387925 (86h14m1.966485164s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016441684 (86h14m1.975538926s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016473817 (86h14m1.975571082s) [seg_pos={0 0}, upload=89902]: Segment reached optimal threshold of 14 pieces.
Aug 12 07:39:40.016693696 (86h14m1.975790944s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016867797 (86h14m1.975965043s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124BC3547CnJ34CsBzFawJz9kFot4tZ6MTuRXa7Jed8JMSTe72D): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016945944 (86h14m1.976043189s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLCXYP6sppXZcmj49C8jjgXbLGzgyowtpb1um9XZguzfVnM2r): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017069802 (86h14m1.976167041s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017101045 (86h14m1.97619828s) [seg_pos={0 0}, upload=89902]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 07:39:40.017197440 (86h14m1.976294685s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 07:39:40.017203455 (86h14m1.976300702s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 07:39:40.172728058 (86h14m2.131825312s) [upload=89902]: Done uploading segments...
Aug 12 07:39:40.172750765 (86h14m2.13184801s) [upload=89902]: Upload finished. err: <nil>
Duration: 2.863639224s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
809.566936ms
FAIL (2025-08-12 08:15:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 07:48:59.843550821 (86h23m21.802648066s) [upload=90065]: Starting upload Aug 12 07:48:59.843665323 (86h23m21.80276257s) [upload=90065]: Done starting upload Aug 12 07:48:59.843805919 (86h23m21.802903157s) [upload=90065]: Uploading segments... Aug 12 07:48:59.843865214 (86h23m21.80296246s) [upload=90065]: Got next segment. Inline: true Aug 12 07:48:59.843870966 (86h23m21.802968211s) [upload=90065]: Waiting for error group managing segments... Aug 12 07:48:59.843916743 (86h23m21.803013989s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 07:48:59.843922059 (86h23m21.803019304s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 07:48:59.843925700 (86h23m21.803022945s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 07:48:59.933867301 (86h23m21.892964556s) [upload=90065]: Done uploading segments... Aug 12 07:48:59.933890446 (86h23m21.892987699s) [upload=90065]: Upload finished. err: metaclient: Too Many Requests
Duration: 809.595354ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
2.538725594s
FAIL (2025-08-12 08:15:27 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 07:39:39.033059184 (86h14m0.992156426s) [upload=89902]: Starting upload
Aug 12 07:39:39.033152120 (86h14m0.992249364s) [upload=89902]: Done starting upload
Aug 12 07:39:39.033297583 (86h14m0.992394828s) [upload=89902]: Uploading segments...
Aug 12 07:39:39.033614288 (86h14m0.992711534s) [upload=89902]: Got next segment. Inline: false
Aug 12 07:39:39.033650349 (86h14m0.992747593s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 07:39:39.033656004 (86h14m0.992753239s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 07:39:39.229399173 (86h14m1.188496429s) [seg_pos={0 0}, upload=89902]: Begin upload segment...
Aug 12 07:39:39.229536336 (86h14m1.18863362s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.229583075 (86h14m1.18868033s) [seg_pos={0 0}, upload=89902]: Done begin upload segment.
Aug 12 07:39:39.229632693 (86h14m1.18872995s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.230249524 (86h14m1.189346784s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231168815 (86h14m1.190266069s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231653615 (86h14m1.190750871s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231708320 (86h14m1.190805578s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232087037 (86h14m1.19118429s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232124852 (86h14m1.191222109s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232451654 (86h14m1.191548899s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232726108 (86h14m1.191823361s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232998908 (86h14m1.192096156s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233322723 (86h14m1.192419973s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233681215 (86h14m1.192778467s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234038674 (86h14m1.193135925s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234617189 (86h14m1.193714435s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.235225598 (86h14m1.194322854s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236117344 (86h14m1.1952146s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236656502 (86h14m1.195753759s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.809708997 (86h14m1.768806234s) [upload=89902]: Next returned nil segment
Aug 12 07:39:39.809729179 (86h14m1.768826427s) [upload=89902]: Waiting for error group managing segments...
Aug 12 07:39:39.955449038 (86h14m1.914546289s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.963009445 (86h14m1.922106685s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964027666 (86h14m1.923124903s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964137955 (86h14m1.923235189s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.967444571 (86h14m1.926541844s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.971467265 (86h14m1.930564514s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.975455659 (86h14m1.934552911s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.976817364 (86h14m1.935914613s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.982854369 (86h14m1.941951625s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988427330 (86h14m1.947524564s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988927474 (86h14m1.948024767s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.993577207 (86h14m1.952674453s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.007387925 (86h14m1.966485164s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016441684 (86h14m1.975538926s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016473817 (86h14m1.975571082s) [seg_pos={0 0}, upload=89902]: Segment reached optimal threshold of 14 pieces.
Aug 12 07:39:40.016693696 (86h14m1.975790944s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016867797 (86h14m1.975965043s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124BC3547CnJ34CsBzFawJz9kFot4tZ6MTuRXa7Jed8JMSTe72D): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016945944 (86h14m1.976043189s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLCXYP6sppXZcmj49C8jjgXbLGzgyowtpb1um9XZguzfVnM2r): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017069802 (86h14m1.976167041s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017101045 (86h14m1.97619828s) [seg_pos={0 0}, upload=89902]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 07:39:40.017197440 (86h14m1.976294685s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 07:39:40.017203455 (86h14m1.976300702s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 07:39:40.172728058 (86h14m2.131825312s) [upload=89902]: Done uploading segments...
Aug 12 07:39:40.172750765 (86h14m2.13184801s) [upload=89902]: Upload finished. err: <nil>
Duration: 2.538762154s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
813.125905ms
FAIL (2025-08-12 08:14:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 07:48:59.843550821 (86h23m21.802648066s) [upload=90065]: Starting upload Aug 12 07:48:59.843665323 (86h23m21.80276257s) [upload=90065]: Done starting upload Aug 12 07:48:59.843805919 (86h23m21.802903157s) [upload=90065]: Uploading segments... Aug 12 07:48:59.843865214 (86h23m21.80296246s) [upload=90065]: Got next segment. Inline: true Aug 12 07:48:59.843870966 (86h23m21.802968211s) [upload=90065]: Waiting for error group managing segments... Aug 12 07:48:59.843916743 (86h23m21.803013989s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 07:48:59.843922059 (86h23m21.803019304s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 07:48:59.843925700 (86h23m21.803022945s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 07:48:59.933867301 (86h23m21.892964556s) [upload=90065]: Done uploading segments... Aug 12 07:48:59.933890446 (86h23m21.892987699s) [upload=90065]: Upload finished. err: metaclient: Too Many Requests
Duration: 813.218923ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
839.458257ms
FAIL (2025-08-12 08:14:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 07:48:59.843550821 (86h23m21.802648066s) [upload=90065]: Starting upload Aug 12 07:48:59.843665323 (86h23m21.80276257s) [upload=90065]: Done starting upload Aug 12 07:48:59.843805919 (86h23m21.802903157s) [upload=90065]: Uploading segments... Aug 12 07:48:59.843865214 (86h23m21.80296246s) [upload=90065]: Got next segment. Inline: true Aug 12 07:48:59.843870966 (86h23m21.802968211s) [upload=90065]: Waiting for error group managing segments... Aug 12 07:48:59.843916743 (86h23m21.803013989s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 07:48:59.843922059 (86h23m21.803019304s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 07:48:59.843925700 (86h23m21.803022945s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 07:48:59.933867301 (86h23m21.892964556s) [upload=90065]: Done uploading segments... Aug 12 07:48:59.933890446 (86h23m21.892987699s) [upload=90065]: Upload finished. err: metaclient: Too Many Requests
Duration: 839.49139ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.457685254s
FAIL (2025-08-12 08:14:16 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 07:39:39.033059184 (86h14m0.992156426s) [upload=89902]: Starting upload
Aug 12 07:39:39.033152120 (86h14m0.992249364s) [upload=89902]: Done starting upload
Aug 12 07:39:39.033297583 (86h14m0.992394828s) [upload=89902]: Uploading segments...
Aug 12 07:39:39.033614288 (86h14m0.992711534s) [upload=89902]: Got next segment. Inline: false
Aug 12 07:39:39.033650349 (86h14m0.992747593s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 07:39:39.033656004 (86h14m0.992753239s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 07:39:39.229399173 (86h14m1.188496429s) [seg_pos={0 0}, upload=89902]: Begin upload segment...
Aug 12 07:39:39.229536336 (86h14m1.18863362s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.229583075 (86h14m1.18868033s) [seg_pos={0 0}, upload=89902]: Done begin upload segment.
Aug 12 07:39:39.229632693 (86h14m1.18872995s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.230249524 (86h14m1.189346784s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231168815 (86h14m1.190266069s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231653615 (86h14m1.190750871s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231708320 (86h14m1.190805578s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232087037 (86h14m1.19118429s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232124852 (86h14m1.191222109s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232451654 (86h14m1.191548899s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232726108 (86h14m1.191823361s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232998908 (86h14m1.192096156s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233322723 (86h14m1.192419973s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233681215 (86h14m1.192778467s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234038674 (86h14m1.193135925s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234617189 (86h14m1.193714435s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.235225598 (86h14m1.194322854s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236117344 (86h14m1.1952146s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236656502 (86h14m1.195753759s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.809708997 (86h14m1.768806234s) [upload=89902]: Next returned nil segment
Aug 12 07:39:39.809729179 (86h14m1.768826427s) [upload=89902]: Waiting for error group managing segments...
Aug 12 07:39:39.955449038 (86h14m1.914546289s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.963009445 (86h14m1.922106685s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964027666 (86h14m1.923124903s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964137955 (86h14m1.923235189s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.967444571 (86h14m1.926541844s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.971467265 (86h14m1.930564514s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.975455659 (86h14m1.934552911s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.976817364 (86h14m1.935914613s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.982854369 (86h14m1.941951625s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988427330 (86h14m1.947524564s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988927474 (86h14m1.948024767s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.993577207 (86h14m1.952674453s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.007387925 (86h14m1.966485164s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016441684 (86h14m1.975538926s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016473817 (86h14m1.975571082s) [seg_pos={0 0}, upload=89902]: Segment reached optimal threshold of 14 pieces.
Aug 12 07:39:40.016693696 (86h14m1.975790944s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016867797 (86h14m1.975965043s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124BC3547CnJ34CsBzFawJz9kFot4tZ6MTuRXa7Jed8JMSTe72D): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016945944 (86h14m1.976043189s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLCXYP6sppXZcmj49C8jjgXbLGzgyowtpb1um9XZguzfVnM2r): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017069802 (86h14m1.976167041s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017101045 (86h14m1.97619828s) [seg_pos={0 0}, upload=89902]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 07:39:40.017197440 (86h14m1.976294685s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 07:39:40.017203455 (86h14m1.976300702s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 07:39:40.172728058 (86h14m2.131825312s) [upload=89902]: Done uploading segments...
Aug 12 07:39:40.172750765 (86h14m2.13184801s) [upload=89902]: Upload finished. err: <nil>
Duration: 2.457741714s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
2.315797648s
FAIL (2025-08-12 08:13:49 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 07:39:39.033059184 (86h14m0.992156426s) [upload=89902]: Starting upload
Aug 12 07:39:39.033152120 (86h14m0.992249364s) [upload=89902]: Done starting upload
Aug 12 07:39:39.033297583 (86h14m0.992394828s) [upload=89902]: Uploading segments...
Aug 12 07:39:39.033614288 (86h14m0.992711534s) [upload=89902]: Got next segment. Inline: false
Aug 12 07:39:39.033650349 (86h14m0.992747593s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 07:39:39.033656004 (86h14m0.992753239s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 07:39:39.229399173 (86h14m1.188496429s) [seg_pos={0 0}, upload=89902]: Begin upload segment...
Aug 12 07:39:39.229536336 (86h14m1.18863362s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.229583075 (86h14m1.18868033s) [seg_pos={0 0}, upload=89902]: Done begin upload segment.
Aug 12 07:39:39.229632693 (86h14m1.18872995s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.230249524 (86h14m1.189346784s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231168815 (86h14m1.190266069s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231653615 (86h14m1.190750871s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.231708320 (86h14m1.190805578s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232087037 (86h14m1.19118429s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232124852 (86h14m1.191222109s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232451654 (86h14m1.191548899s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232726108 (86h14m1.191823361s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.232998908 (86h14m1.192096156s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233322723 (86h14m1.192419973s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.233681215 (86h14m1.192778467s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234038674 (86h14m1.193135925s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.234617189 (86h14m1.193714435s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.235225598 (86h14m1.194322854s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236117344 (86h14m1.1952146s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.236656502 (86h14m1.195753759s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Uploading piece...
Aug 12 07:39:39.809708997 (86h14m1.768806234s) [upload=89902]: Next returned nil segment
Aug 12 07:39:39.809729179 (86h14m1.768826427s) [upload=89902]: Waiting for error group managing segments...
Aug 12 07:39:39.955449038 (86h14m1.914546289s) [noise=true , address=77.90.31.21:4897 , piece_id=YWXGEKO6SOCUD5MIPNLGMB3VSKGKVM3OZSDL7IGTVOTTFBDPHKUQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.963009445 (86h14m1.922106685s) [noise=true , address=104.36.82.39:4726 , piece_id=Q5XP2KYVOILJJ7CG7I4H56ME6Z6BK3A6HC6GMOVKZ6CPQNVDF5LQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964027666 (86h14m1.923124903s) [noise=true , address=104.36.82.43:4858 , piece_id=COMU2OIWPMD55NZL6TO6MYRLTMRKEQOIRYGNSDW3K3SLKRDULARQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.964137955 (86h14m1.923235189s) [noise=true , address=104.36.82.59:4302 , piece_id=Y3F7AM26VNYKUQPZXCECNETYMDHDRHPS3TLOOHO7J6IB7XYULOYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.967444571 (86h14m1.926541844s) [noise=true , address=104.36.82.50:4039 , piece_id=RYINHBFCIZJ5F3CXD4P7GZXJC36GOIA3VA2FRIPQXKINMNKSQBWQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.971467265 (86h14m1.930564514s) [noise=true , address=104.36.82.44:4892 , piece_id=EZEWXRYHOYJRC33TUL52S52NJK52DWVQMN4TA3FZ2ULCOTAZOGNQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.975455659 (86h14m1.934552911s) [noise=true , address=104.36.82.46:4488 , piece_id=SH4BBV3MVPVPHEVH23B43HFUELHSCJLIEKSQRMPT5XNFGE2YN7QQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.976817364 (86h14m1.935914613s) [noise=true , address=104.36.82.23:4461 , piece_id=B7AZXY4TK6A23J2W3534OTX6NTMMHBFZIKV7SYBKK7X22ZWZZIEQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.982854369 (86h14m1.941951625s) [noise=true , address=104.36.82.9:4038 , piece_id=HOBL43VWTIPKJ5CCJBJ3FOELE7TXXBN3VHLWW7NEYVDUCQ3NHSOA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988427330 (86h14m1.947524564s) [noise=true , address=104.36.82.37:4683 , piece_id=JXNXJ4MHETDY3XZRWDMQPSLWKQD52LDIYQ7TU33UYIHCIRAHNCMA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.988927474 (86h14m1.948024767s) [noise=true , address=104.36.82.36:4625 , piece_id=IALWQ6UTCZMYAFEACBOB7NK6Y5Z54VCYE2KRCA6GCVCI2MCZZD5A, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:39.993577207 (86h14m1.952674453s) [noise=true , address=104.36.82.22:4511 , piece_id=HW5EMXNWRCRY5MT4OIZW5UKWD7Y25X7EGDELJ5WKTHDTMLAI4BKA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.007387925 (86h14m1.966485164s) [noise=true , address=79.127.219.38:4007 , piece_id=563RLDTZOQOVXWU3Y2WOQOV7YMADBHGRVWHDP4ILMWZR4RKUBCCA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016441684 (86h14m1.975538926s) [noise=true , address=104.36.82.15:4276 , piece_id=MQ3BG53L3UAVB35RGY66UATSRWKEBLKN2OKW5Q36QGP2LREWHDQA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: <nil>
Aug 12 07:39:40.016473817 (86h14m1.975571082s) [seg_pos={0 0}, upload=89902]: Segment reached optimal threshold of 14 pieces.
Aug 12 07:39:40.016693696 (86h14m1.975790944s) [noise=true , address=104.36.82.59:4336 , piece_id=BKSQMRKUQHNKZPKNWPI4JYXGUQNISK73DM3XYWRJELROKGCOJRXA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016867797 (86h14m1.975965043s) [noise=true , address=79.127.201.215:4325 , piece_id=B7HXJJWVWP3GM5CLCAXRYRSPWNSTMHYNB4F5XGLGEV2EZCBYKRBQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124BC3547CnJ34CsBzFawJz9kFot4tZ6MTuRXa7Jed8JMSTe72D): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.016945944 (86h14m1.976043189s) [noise=true , address=79.127.201.214:4320 , piece_id=KRUS3U5TJBMA5VDELP6XP3343R4BVYBCTSVYLUW7E7VBCYHRTUYQ, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLCXYP6sppXZcmj49C8jjgXbLGzgyowtpb1um9XZguzfVnM2r): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017069802 (86h14m1.976167041s) [noise=true , address=104.36.82.62:4431 , piece_id=JF7F7JVTPCRM7UZOK53OOTT3N6EPYS64VUNUXVP4MGHJPIFUJRYA, seg_pos={0 0}, upload=89902]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 12 07:39:40.017101045 (86h14m1.97619828s) [seg_pos={0 0}, upload=89902]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 07:39:40.017197440 (86h14m1.976294685s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 07:39:40.017203455 (86h14m1.976300702s) [upload=89902]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 07:39:40.172728058 (86h14m2.131825312s) [upload=89902]: Done uploading segments...
Aug 12 07:39:40.172750765 (86h14m2.13184801s) [upload=89902]: Upload finished. err: <nil>
Duration: 2.315823356s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
826.434077ms
FAIL (2025-08-12 08:13:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 07:48:59.843550821 (86h23m21.802648066s) [upload=90065]: Starting upload Aug 12 07:48:59.843665323 (86h23m21.80276257s) [upload=90065]: Done starting upload Aug 12 07:48:59.843805919 (86h23m21.802903157s) [upload=90065]: Uploading segments... Aug 12 07:48:59.843865214 (86h23m21.80296246s) [upload=90065]: Got next segment. Inline: true Aug 12 07:48:59.843870966 (86h23m21.802968211s) [upload=90065]: Waiting for error group managing segments... Aug 12 07:48:59.843916743 (86h23m21.803013989s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 07:48:59.843922059 (86h23m21.803019304s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 07:48:59.843925700 (86h23m21.803022945s) [upload=90065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 07:48:59.933867301 (86h23m21.892964556s) [upload=90065]: Done uploading segments... Aug 12 07:48:59.933890446 (86h23m21.892987699s) [upload=90065]: Upload finished. err: metaclient: Too Many Requests
Duration: 826.484434ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|